-- Logs begin at Tue 2022-10-04 19:26:35 UTC, end at Tue 2022-10-04 21:41:58 UTC. -- Oct 04 20:18:46.929934 n-d-852085-12 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 20:18:46.939805 n-d-852085-12 devstack@n-api.service[107385]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 20:18:46.941901 n-d-852085-12 devstack@n-api.service[107385]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 20:18:46 2022] *** Oct 04 20:18:46.941901 n-d-852085-12 devstack@n-api.service[107385]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 20:18:46.941901 n-d-852085-12 devstack@n-api.service[107385]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 20:18:46.941901 n-d-852085-12 devstack@n-api.service[107385]: nodename: n-d-852085-12 Oct 04 20:18:46.941901 n-d-852085-12 devstack@n-api.service[107385]: machine: x86_64 Oct 04 20:18:46.941901 n-d-852085-12 devstack@n-api.service[107385]: clock source: unix Oct 04 20:18:46.941901 n-d-852085-12 devstack@n-api.service[107385]: pcre jit disabled Oct 04 20:18:46.941901 n-d-852085-12 devstack@n-api.service[107385]: detected number of CPU cores: 4 Oct 04 20:18:46.941901 n-d-852085-12 devstack@n-api.service[107385]: current working directory: / Oct 04 20:18:46.941901 n-d-852085-12 devstack@n-api.service[107385]: detected binary path: /usr/bin/uwsgi-core Oct 04 20:18:46.941901 n-d-852085-12 devstack@n-api.service[107385]: your processes number limit is 47680 Oct 04 20:18:46.942607 n-d-852085-12 devstack@n-api.service[107385]: your memory page size is 4096 bytes Oct 04 20:18:46.942607 n-d-852085-12 devstack@n-api.service[107385]: detected max file descriptor number: 2048 Oct 04 20:18:46.942607 n-d-852085-12 devstack@n-api.service[107385]: lock engine: pthread robust mutexes Oct 04 20:18:46.942607 n-d-852085-12 devstack@n-api.service[107385]: thunder lock: enabled Oct 04 20:18:46.942607 n-d-852085-12 devstack@n-api.service[107385]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 20:18:46.942607 n-d-852085-12 devstack@n-api.service[107385]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 20:18:46.982902 n-d-852085-12 devstack@n-api.service[107385]: Python main interpreter initialized at 0x561df04d99c0 Oct 04 20:18:46.982902 n-d-852085-12 devstack@n-api.service[107385]: python threads support enabled Oct 04 20:18:46.982902 n-d-852085-12 devstack@n-api.service[107385]: your server socket listen backlog is limited to 100 connections Oct 04 20:18:46.982902 n-d-852085-12 devstack@n-api.service[107385]: your mercy for graceful operations on workers is 90 seconds Oct 04 20:18:46.983440 n-d-852085-12 devstack@n-api.service[107385]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 20:18:46.983440 n-d-852085-12 devstack@n-api.service[107385]: *** Operational MODE: preforking *** Oct 04 20:18:46.983699 n-d-852085-12 devstack@n-api.service[107385]: *** uWSGI is running in multiple interpreter mode *** Oct 04 20:18:46.983699 n-d-852085-12 devstack@n-api.service[107385]: spawned uWSGI master process (pid: 107385) Oct 04 20:18:46.983901 n-d-852085-12 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 20:18:46.985317 n-d-852085-12 devstack@n-api.service[107385]: spawned uWSGI worker 1 (pid: 107386, cores: 1) Oct 04 20:18:46.985317 n-d-852085-12 devstack@n-api.service[107385]: spawned uWSGI worker 2 (pid: 107387, cores: 1) Oct 04 20:18:46.985317 n-d-852085-12 devstack@n-api.service[107385]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 20:18:47.675476 n-d-852085-12 devstack@n-api.service[107387]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:18:47.814026 n-d-852085-12 devstack@n-api.service[107386]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:18:48.799650 n-d-852085-12 devstack@n-api.service[107387]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:18:48.799650 n-d-852085-12 devstack@n-api.service[107387]: from cryptography.utils import int_from_bytes Oct 04 20:18:48.800337 n-d-852085-12 devstack@n-api.service[107387]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:18:48.800337 n-d-852085-12 devstack@n-api.service[107387]: from cryptography.utils import int_from_bytes Oct 04 20:18:48.901041 n-d-852085-12 devstack@n-api.service[107386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:18:48.901041 n-d-852085-12 devstack@n-api.service[107386]: from cryptography.utils import int_from_bytes Oct 04 20:18:48.901637 n-d-852085-12 devstack@n-api.service[107386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:18:48.901637 n-d-852085-12 devstack@n-api.service[107386]: from cryptography.utils import int_from_bytes Oct 04 20:18:51.343346 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:18:51.343951 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:18:51.344127 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:18:51.344529 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:18:51.344739 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:18:51.345126 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.345449 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.345767 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.346086 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.346447 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.346723 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.347040 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.347412 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.347739 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.348002 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.348314 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.348636 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852085-12 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.348957 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.349262 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.349570 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.349889 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.350190 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.350510 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.350786 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:18:51.351240 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.351325 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:18:51.351411 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.351886 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:18:51.352060 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.352204 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:18:51.352348 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.352466 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:18:51.352579 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.352760 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.352897 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.353098 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.353197 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.353420 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.353524 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.353737 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.353881 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.354040 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.354179 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.354366 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.354455 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.354669 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.354756 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.354994 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.355125 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852085-12 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.355362 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.355530 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.355677 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.355872 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.355993 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.356194 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.356282 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852085-12 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.356558 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.356660 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.356868 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.356953 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.357181 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.357270 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.357510 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.357616 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.357856 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.357949 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.358164 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.358258 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.358491 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.358585 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.358809 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.359027 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.359166 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.359372 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.359482 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.359684 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.359788 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.359997 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.360093 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.360340 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.360440 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.360656 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.360749 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.360957 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.361064 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.361516 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.361677 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.361783 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.361913 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.362063 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.362243 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.362382 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.362556 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.362707 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.362970 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852085-12 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.363065 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.363285 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.363453 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.363633 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.363787 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.363941 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.364083 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.364240 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.364442 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.364592 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.364741 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.364886 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.365040 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.365185 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.365329 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.365478 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.365643 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.365776 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.365923 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.366070 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.366213 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.366407 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.366541 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.366734 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.366883 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.367058 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.367265 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.367409 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.367506 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.368259 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.368437 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.368565 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.368654 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.368881 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.368970 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.369210 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.369536 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.369632 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.369711 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.369848 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.369945 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.370137 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.370229 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.370449 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.370535 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.370767 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.370852 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.371089 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.371229 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.371441 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.371548 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.371699 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.371796 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.371953 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.372041 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.372299 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.372399 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.372605 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.372703 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.372922 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.373009 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.373206 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.373293 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.373510 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.373621 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.373815 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.373904 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.374122 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.374216 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.374424 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.374563 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.374731 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.374846 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.375034 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.375159 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.375365 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.375463 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.375671 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.375762 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.375977 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.376072 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.376283 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.376375 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.376585 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.376675 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.376888 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.377056 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.377194 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.377312 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.377498 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.377627 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.377802 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.377970 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.378106 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.378292 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.378407 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.378607 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.378733 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.378931 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.379052 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.379286 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.379411 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.379600 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.379701 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.379911 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.380019 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.380222 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.380322 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.380548 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.380650 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.380863 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.380958 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.381165 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.381288 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.381485 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.381574 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.381793 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.381883 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.382101 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.382187 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.382419 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.382547 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.382724 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.382865 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.383027 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.383231 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.383433 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.383564 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.383739 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.383872 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.384045 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.384185 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.384366 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.384598 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.384724 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.384912 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.385005 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.385225 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.385312 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.385535 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.385687 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.385837 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.386454 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.386652 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.386738 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.386959 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.387036 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.387292 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.387459 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.387596 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.387728 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.387957 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.388100 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.388238 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.388383 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.388554 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.388713 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.388849 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.388992 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.389161 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.389303 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.389558 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.389692 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.389840 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.389931 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.390077 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.390152 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.390388 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.390478 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.390714 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.390790 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.391025 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.391100 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.391359 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.391456 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.391722 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.391836 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.392018 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.392105 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.392328 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.392418 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.392659 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.392734 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.393042 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.393133 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.393275 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.393395 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.393588 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.393676 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.393882 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.394034 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.394193 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.394284 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.394500 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.394595 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.394808 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.394902 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.395117 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.395256 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.395443 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.395531 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.395759 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.395848 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.396112 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.396224 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.396404 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.396492 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.396728 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.396830 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.397038 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.397125 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.397353 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.397441 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.397666 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.397764 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.398010 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.398104 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.398333 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.398443 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:51.398656 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.398752 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.398996 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.399087 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.399338 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.399436 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.399646 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.399820 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.399994 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.400165 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.400305 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.400504 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.400616 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.400829 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.400925 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.401146 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.401233 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.401482 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.401570 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.401831 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.401919 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.402143 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.402229 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.402454 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.402603 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.402764 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.402853 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.403071 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.403233 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.403431 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.403537 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.403746 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.403833 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.404067 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.404158 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.404380 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.404493 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.404691 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.404784 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.405006 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.405094 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.405313 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.405409 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.405620 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.405708 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.405928 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.406063 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.406230 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.406333 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.406533 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.406670 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.406836 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.407061 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.407189 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.407407 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.407503 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.407737 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.407825 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.408062 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.408163 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.408367 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.408452 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.408679 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.408774 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.408990 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.409085 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.409299 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.409392 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.409606 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.409693 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.409913 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.410087 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.410218 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.410306 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.410527 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.410614 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.410836 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.410932 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.411186 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.411281 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.411482 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.411585 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.411791 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.411888 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.412100 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.412399 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.412485 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.412717 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.413023 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.413332 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.413420 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.413641 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.413731 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.413947 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.414081 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.414257 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.414357 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.414592 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.414682 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.414917 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.415014 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.415253 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.415348 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.415563 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.415664 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.415880 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.415974 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.416200 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.416305 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.416502 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.416588 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.416811 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.416898 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.417121 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.417208 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.417435 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.417530 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.417736 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.417868 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.418043 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.418130 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.418346 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.418452 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.418648 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.418734 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.418953 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.419125 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.419283 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.419441 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.419586 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.419675 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.419887 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.419975 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.420188 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.420310 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.420493 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.420620 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.420791 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.420878 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.421111 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.421208 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.421417 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.421504 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.421719 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.421815 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.422026 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.422156 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.422328 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.422415 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.422667 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.422762 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.422971 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.423059 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.423328 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.423429 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.423651 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.423739 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.423965 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.424052 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.424287 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.424382 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.424599 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.424700 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.424910 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.425006 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.425217 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.425305 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.425528 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.425625 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.425836 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.425922 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.426144 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.426238 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.426461 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.426740 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.426840 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.427064 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.427174 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.427396 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.427481 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.427718 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.427809 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.428026 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.428116 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.428342 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.428436 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.428652 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.428788 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.428955 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.429090 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.429292 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.429545 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.429682 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.429859 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.429965 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.430733 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.430834 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.431093 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.431236 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.431761 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.431921 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.431921 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.434301 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.434409 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.434493 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.434594 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.434730 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.434820 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.434890 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.434971 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.435054 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.435159 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.435257 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.435340 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.435419 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.435512 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.435605 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.435739 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.435739 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.436047 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.436169 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.436312 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.436397 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.436477 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.436600 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.436706 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.436799 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.436881 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.436968 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.437050 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.437130 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.437209 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.437301 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.437301 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.437301 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.437597 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.437712 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.437712 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.437932 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.438115 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.438256 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.438567 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.438881 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.439213 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.439571 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.439830 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.440144 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.440453 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.440732 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.440906 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.441016 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.441100 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.441337 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.441427 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.441657 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.441834 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.441967 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.442065 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.442287 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.442383 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.442612 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.442722 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.442915 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.443002 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.443245 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.443342 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.443568 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.443698 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.443876 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.444020 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.444179 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.444402 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.444584 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.444775 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.444912 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.445113 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.445205 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.445449 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.445558 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.446311 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.446412 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.446641 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.446769 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.446987 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.447090 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.447369 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.447458 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.447693 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.447783 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.448008 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.448096 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.448317 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.448412 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.448635 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.448731 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.448948 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.449044 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.449254 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.449349 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.449565 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.449664 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.449872 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.449985 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.450180 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.450305 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.450488 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.450631 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.450808 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.450949 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.451114 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.451287 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.451443 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.451602 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.451749 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.451941 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.452051 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.452258 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.452345 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.452574 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.452663 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.452903 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.453220 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.453314 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.453539 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.453654 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.453853 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.453948 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.454161 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.454247 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.454473 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.454599 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.454789 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.454892 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.455108 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.455288 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.455444 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.455540 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.455759 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.455848 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.456071 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.456158 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.456385 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.456519 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.456693 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.456787 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.457000 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.457094 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.457305 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.457406 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.457607 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.457700 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.457910 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.458020 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.458215 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.458316 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.458521 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.458608 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.458823 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.458912 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.459125 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.459292 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.459450 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.459537 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.459756 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.459856 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.460065 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.460162 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.460366 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.460453 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.460673 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.460759 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.460975 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.461092 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.461318 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.461413 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.461635 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.461723 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.461939 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.462035 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.462241 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.462329 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.462548 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.462636 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.462886 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.462976 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.463217 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.463343 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.463557 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.463731 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.463886 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.464085 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.464222 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.464456 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.464557 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.464817 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.464924 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.465138 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.465273 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.465441 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.465591 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.465743 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.465909 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.466043 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.466224 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.466350 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.466562 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.466676 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.466943 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.467030 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.467274 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.467415 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.467582 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.467686 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.467890 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.467978 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.468195 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.468283 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.468497 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.468594 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.468801 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.468889 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.469120 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.469379 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.469546 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.469707 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.469809 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.470012 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.470111 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.470308 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.470405 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.470615 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.470711 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.470919 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.471017 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.471244 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.471336 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.471553 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.471676 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.471856 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.471998 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.472170 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.472310 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.472479 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.472627 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.472781 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.472940 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.473082 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.473251 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.473386 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.473569 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.473690 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.473878 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.473989 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.474186 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.474308 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.474494 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.474608 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.474808 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.474913 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.475115 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.475234 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.475444 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.475566 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.475751 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.475839 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.476063 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.476152 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.476370 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.476456 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.476675 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.476762 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.477011 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.477103 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.477314 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.477410 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.477620 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.477716 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.477920 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.478014 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.478222 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.478308 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.478523 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.478618 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.478830 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.478936 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.479153 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.479267 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.479453 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.479580 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.479755 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.479922 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.480060 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.480275 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.480384 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.480611 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.480711 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.480923 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.481043 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.481232 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.481335 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.481530 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.481624 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.481829 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.481917 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.482165 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.482261 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.482471 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.482557 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.482826 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.482913 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.483130 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.483308 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.483464 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.483619 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.483779 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.483976 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.484086 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.484296 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.484385 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.484651 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.484746 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.484971 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.485071 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.485281 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.485368 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.485587 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.485681 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.485892 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.485988 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.486191 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.486531 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.486747 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.486841 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.487058 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.487176 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.487394 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.487493 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.487698 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.487791 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.488005 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.488101 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.488315 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.488407 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.488626 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.488721 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.488925 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.489019 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.489229 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.489316 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.489536 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.489630 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.489838 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.489926 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.490232 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.490343 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.490434 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.490514 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.490740 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.490830 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.491044 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.491172 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.491378 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.491477 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.491689 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.491778 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.491992 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.492078 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.492302 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.492398 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.493152 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.493259 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.493459 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.493546 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.493764 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.493861 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.494086 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.494181 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.494392 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.494485 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.494695 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.494837 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.495009 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.495204 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.495370 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.495517 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.495658 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.495763 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.495918 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.496071 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.496354 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.496439 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.496665 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.496768 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.496971 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.497063 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.497270 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.497362 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.497574 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.497667 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.497879 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.497964 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.498185 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.498269 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.498496 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.498581 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.498800 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.498898 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.499187 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.499277 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.499530 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.499617 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.499837 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.499920 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.500148 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.500247 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.500454 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.500565 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.500762 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.500973 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.501111 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.501328 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.501477 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.501653 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.501800 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.501957 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.502096 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.502243 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.502387 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.502556 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.502721 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.502866 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.503007 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.503181 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.503329 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.503593 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.503739 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.503889 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.504037 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.504177 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.504340 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.504489 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.504634 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.504796 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.504949 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.505126 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.505234 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.505443 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.505530 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.505759 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.505866 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.506083 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.506180 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.506396 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.506490 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.506713 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.506821 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.507026 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.507110 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.507374 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.507450 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.507698 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.507774 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.508005 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.508078 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.508863 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.508967 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.509171 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.509303 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.509495 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.509621 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.509816 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.509994 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.510118 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.510268 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.510442 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.510589 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.510866 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.511031 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.511238 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.511330 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.511508 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.511626 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.511829 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.511929 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.512150 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.512251 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.512458 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.512545 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.512761 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.512858 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.513065 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.513156 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.513365 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.513454 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.513668 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.513779 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.513979 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.514073 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.514278 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.514364 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.514586 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.514701 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.514891 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.515017 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.515220 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.515357 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.515524 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.515669 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.515826 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.515983 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.516146 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.516298 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.516449 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.516618 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.516771 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.516939 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.517083 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.517250 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.517403 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.517670 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.517767 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.517986 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.518074 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.518304 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.518399 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.518609 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.518705 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.518914 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.519003 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.519237 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.519326 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.519558 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.519669 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.519880 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.520031 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.520174 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.520351 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.520487 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.520661 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.520814 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.520970 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.521141 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.521298 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.521451 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.521646 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.521778 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.521974 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.522102 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.522395 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.522500 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.522710 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.522798 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.523020 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.523115 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.523370 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.523588 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.523680 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.523942 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.524035 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.524283 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.524389 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.524575 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.524662 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.524878 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.524965 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.525224 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.525414 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.525507 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.525596 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.525773 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.525861 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.526074 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.526176 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.526375 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.526463 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.526698 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.526784 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.527001 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.527098 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.527350 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.527441 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.527659 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.527746 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.527964 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.528053 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.528266 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.528379 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.528569 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.528658 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.529147 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.529310 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.529399 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.529480 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.529560 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.529738 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.529837 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.530053 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.530154 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.530381 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.530488 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.530709 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.530859 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.531019 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.531167 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.531352 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.531440 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.531667 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.531765 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.531975 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.532063 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.532284 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.532378 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.532586 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.532674 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.532897 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.533047 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.533207 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.533297 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.533517 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.533604 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.533902 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.534079 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.534211 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.534406 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.534504 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.534719 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.534905 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.535030 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.535241 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.535352 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.535569 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.535663 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.535952 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.536058 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.536215 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.536351 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.536539 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.536628 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.536844 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.536937 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.537152 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.537289 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.537465 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.537556 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.537773 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.537861 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.538081 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.538178 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.538389 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.538477 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.538724 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.538823 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.539038 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.539127 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.539388 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.539497 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.539730 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.540087 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.540234 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.540403 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.540584 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.540712 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.540907 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.541012 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.541290 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.541378 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.541631 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.541776 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.541941 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.542089 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.542257 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.542364 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.542568 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.542672 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.542880 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.542984 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.543218 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.543317 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.543528 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.543625 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.543840 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.543946 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.544152 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.544250 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.544475 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.544569 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.544786 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.544895 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.545097 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.545304 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.545414 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.545498 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.545699 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.545850 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.545999 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.546141 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.546319 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.546528 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.546683 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.546846 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.546990 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.547206 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.547299 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.547537 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.547637 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.547854 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.547942 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.548163 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.548256 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.548497 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.548597 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.548807 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.548901 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.549115 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.549292 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.549422 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.549522 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.549732 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.549819 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.550040 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.550127 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.550342 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.550481 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.550661 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.550748 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.550974 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.551097 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.551304 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.551426 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.551620 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.551728 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.551925 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.552084 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.552289 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.552478 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.552630 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.552812 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.552968 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.553126 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.553292 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.553450 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.553773 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.553857 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.554092 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.554210 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.554396 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.554481 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.554718 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.554816 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.555023 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.555791 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.555904 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.555988 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.556177 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.556276 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.556487 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.556575 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.556792 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.556878 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.557137 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.557241 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.557412 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.557595 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.557763 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.557907 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.558063 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.558213 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.558364 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.558543 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.558702 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.558903 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.559047 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.559241 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.559334 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.559549 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.559689 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.559850 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.559939 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.560161 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.560251 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.560497 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.560712 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.560806 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.561053 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.561182 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.561349 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.561461 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.561671 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.561773 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.561969 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.562085 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.562280 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.562376 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.562583 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.562694 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.562891 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.562995 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.563229 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.563349 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.563561 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.563651 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.563863 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.563961 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.564187 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.564284 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.564492 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.564605 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.564792 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.564881 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.565110 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.565200 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.565419 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.565534 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.565740 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.565828 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.566051 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.566150 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.566360 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.566458 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.566707 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.566795 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.567022 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.567289 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.567610 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.567700 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.567944 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.568030 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.568265 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.568353 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.568589 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.568678 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.568918 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.569014 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.569225 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.569312 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.569531 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.569621 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.569836 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.569923 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.570157 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.570245 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.570465 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.570554 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.570832 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.571533 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.571635 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.571791 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.571951 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.572077 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.572263 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.572359 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.572569 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.572664 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.572877 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.572963 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.573186 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.573281 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.573494 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.573724 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.573812 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.574093 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.574186 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.574401 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.574496 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.574707 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.574793 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.575014 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.575228 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.575364 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.575596 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.575694 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.575929 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.576078 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.576260 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.576414 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.576576 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.576668 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.576888 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.576977 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.577213 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.577299 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.577528 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.577627 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.577831 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.577927 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.578137 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.578234 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.578448 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.578612 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.578768 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.578861 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.579077 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.579204 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.579409 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.579497 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.579713 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.580045 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.580133 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.580356 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.580446 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.580666 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.580765 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.580973 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.581086 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.581287 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.581376 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.581593 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.581682 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.581900 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.581998 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.582209 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.582304 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.582515 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.582608 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.582834 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.583016 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.583209 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.583300 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.583551 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.583640 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.583875 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.583972 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.584191 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.584279 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.584497 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.584582 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.584808 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.584917 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.585109 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.585198 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.585418 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.585505 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.585736 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.585825 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.586043 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.586192 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.586370 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.586462 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.586674 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.586772 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.586981 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.587069 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.587311 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.587414 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.587617 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.587705 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.587920 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.588006 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.588222 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.588320 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.588529 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.588829 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.588915 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.589130 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.589246 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.589432 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.589574 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.589735 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.589912 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.590035 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.590283 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.590385 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.590605 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.590705 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.590936 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.591043 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.591238 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.591333 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.591623 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.591711 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.591847 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.591957 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.592561 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.592662 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.592733 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.592801 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.592868 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.593003 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.593098 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.593321 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.593444 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.593639 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.593719 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.593954 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.594041 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.595174 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.595287 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.595361 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.595431 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.595514 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.595594 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.595662 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.595736 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.595803 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.595870 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.595989 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.596079 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.596168 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.596270 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.596428 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.596525 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.596739 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.596823 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.597049 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.597154 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.597357 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.597460 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.597664 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.597767 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.597992 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.598086 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.598306 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.598410 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.598609 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.598693 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.598924 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.599009 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.599262 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.599365 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.599582 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.599667 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.599894 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.599977 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.600203 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.600290 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.600530 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.600624 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.600840 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.601150 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.601287 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.601459 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.601607 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.601770 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.602447 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.602617 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.602786 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.602932 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.603102 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.603270 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.603454 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.603579 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.603783 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.603896 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.604097 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.604210 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.604423 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.604568 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.604736 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.604848 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.605070 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.605167 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.605415 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.605513 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.605749 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.605836 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.606080 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.606178 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.606393 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.606503 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.606744 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.606834 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.607074 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.607183 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.607416 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.607514 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.607727 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.607870 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.608033 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.608121 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.608303 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:18:51.608408 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.608689 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.609001 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.609309 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.609617 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.609926 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.610233 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.610598 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.610910 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.611495 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.611904 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.612159 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.612514 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.612867 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.613216 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.613565 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.613877 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.614185 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.614617 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.614949 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.615320 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.615663 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.615980 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.616306 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.616682 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.616943 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.617254 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.617735 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.618080 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.618403 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.618716 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.619056 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.619396 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.619715 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.620030 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.620344 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.620655 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.620968 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.621370 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.621705 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.622019 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.622349 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.622670 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.622998 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.623339 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.623654 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.623989 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.624305 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.624625 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.624938 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.625251 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.625566 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.625885 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.626202 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.626752 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.626949 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.627254 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.627592 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.627955 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.628292 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.628628 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.629025 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.629381 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.629701 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.630053 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.630389 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.630711 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.631029 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.631381 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:51.631631 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:18:51.761892 n-d-852085-12 devstack@n-api.service[107387]: INFO dbcounter [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Registered counter for database nova_api Oct 04 20:18:51.783607 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_db.sqlalchemy.engines [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:51.790812 n-d-852085-12 devstack@n-api.service[107387]: DEBUG dbcounter [-] [107387] Writer thread running {{(pid=107387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:51.791542 n-d-852085-12 devstack@n-api.service[107386]: INFO dbcounter [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Registered counter for database nova_api Oct 04 20:18:51.814457 n-d-852085-12 devstack@n-api.service[107386]: DEBUG oslo_db.sqlalchemy.engines [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:51.822293 n-d-852085-12 devstack@n-api.service[107386]: DEBUG dbcounter [-] [107386] Writer thread running {{(pid=107386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:51.849733 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.context [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c6f5a8f-3e7f-4559-98c8-58d2585358de(cell1) {{(pid=107387) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:18:51.854108 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:18:51.854583 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:18:51.856183 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:18:51.856942 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:18:51.857365 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:18:51.859383 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:18:51.861627 n-d-852085-12 devstack@n-api.service[107387]: INFO dbcounter [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Registered counter for database nova_cell0 Oct 04 20:18:51.865794 n-d-852085-12 devstack@n-api.service[107387]: INFO dbcounter [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Registered counter for database nova_cell1 Oct 04 20:18:51.874226 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_db.sqlalchemy.engines [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:51.876124 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_db.sqlalchemy.engines [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:51.882722 n-d-852085-12 devstack@n-api.service[107387]: DEBUG dbcounter [-] [107387] Writer thread running {{(pid=107387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:51.883648 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.context [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c6f5a8f-3e7f-4559-98c8-58d2585358de(cell1) {{(pid=107386) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:18:51.884804 n-d-852085-12 devstack@n-api.service[107387]: DEBUG dbcounter [-] [107387] Writer thread running {{(pid=107387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:51.887658 n-d-852085-12 devstack@n-api.service[107386]: DEBUG oslo_concurrency.lockutils [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:18:51.888143 n-d-852085-12 devstack@n-api.service[107386]: DEBUG oslo_concurrency.lockutils [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:18:51.889848 n-d-852085-12 devstack@n-api.service[107386]: DEBUG oslo_concurrency.lockutils [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:18:51.890598 n-d-852085-12 devstack@n-api.service[107386]: DEBUG oslo_concurrency.lockutils [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:18:51.891047 n-d-852085-12 devstack@n-api.service[107386]: DEBUG oslo_concurrency.lockutils [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:18:51.893104 n-d-852085-12 devstack@n-api.service[107386]: DEBUG oslo_concurrency.lockutils [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:18:51.895342 n-d-852085-12 devstack@n-api.service[107386]: INFO dbcounter [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Registered counter for database nova_cell0 Oct 04 20:18:51.899723 n-d-852085-12 devstack@n-api.service[107386]: INFO dbcounter [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Registered counter for database nova_cell1 Oct 04 20:18:51.907167 n-d-852085-12 devstack@n-api.service[107386]: DEBUG oslo_db.sqlalchemy.engines [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:51.909027 n-d-852085-12 devstack@n-api.service[107386]: DEBUG oslo_db.sqlalchemy.engines [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:51.916179 n-d-852085-12 devstack@n-api.service[107386]: DEBUG dbcounter [-] [107386] Writer thread running {{(pid=107386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:51.917932 n-d-852085-12 devstack@n-api.service[107386]: DEBUG dbcounter [-] [107386] Writer thread running {{(pid=107386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:52.042444 n-d-852085-12 devstack@n-api.service[107387]: INFO dbcounter [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Registered counter for database nova_cell0 Oct 04 20:18:52.051689 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_db.sqlalchemy.engines [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:52.056196 n-d-852085-12 devstack@n-api.service[107387]: DEBUG dbcounter [-] [107387] Writer thread running {{(pid=107387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:52.075230 n-d-852085-12 devstack@n-api.service[107386]: INFO dbcounter [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Registered counter for database nova_cell0 Oct 04 20:18:52.084499 n-d-852085-12 devstack@n-api.service[107386]: DEBUG oslo_db.sqlalchemy.engines [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:52.089791 n-d-852085-12 devstack@n-api.service[107386]: DEBUG dbcounter [-] [107386] Writer thread running {{(pid=107386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:52.509418 n-d-852085-12 devstack@n-api.service[107387]: WARNING keystonemiddleware.auth_token [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:18:52.517013 n-d-852085-12 devstack@n-api.service[107387]: WARNING keystonemiddleware.auth_token [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:18:52.532519 n-d-852085-12 devstack@n-api.service[107386]: WARNING keystonemiddleware.auth_token [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:18:52.540004 n-d-852085-12 devstack@n-api.service[107386]: WARNING keystonemiddleware.auth_token [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:18:52.859776 n-d-852085-12 devstack@n-api.service[107387]: WARNING keystonemiddleware.auth_token [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:18:52.866024 n-d-852085-12 devstack@n-api.service[107387]: WARNING keystonemiddleware.auth_token [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:18:52.871836 n-d-852085-12 devstack@n-api.service[107387]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561df04d99c0 pid: 107387 (default app) Oct 04 20:18:52.873900 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:18:52.875069 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001713 Oct 04 20:18:52.875498 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Tue Oct 4 20:18:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:18:52.880843 n-d-852085-12 devstack@n-api.service[107386]: WARNING keystonemiddleware.auth_token [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:18:52.886976 n-d-852085-12 devstack@n-api.service[107386]: WARNING keystonemiddleware.auth_token [None req-416cb729-8467-4d8e-ae82-fdfb549b8a34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:18:52.892328 n-d-852085-12 devstack@n-api.service[107386]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561df04d99c0 pid: 107386 (default app) Oct 04 20:20:37.056016 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:37.058524 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003228 Oct 04 20:20:37.059392 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:20:37 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:20:37.087778 n-d-852085-12 devstack@n-api.service[107386]: DEBUG dbcounter [-] [107386] Writing DB stats nova_api:SELECT=3 {{(pid=107386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:37.089254 n-d-852085-12 devstack@n-api.service[107386]: DEBUG dbcounter [-] [107386] Writing DB stats nova_cell0:SELECT=3 {{(pid=107386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:37.091046 n-d-852085-12 devstack@n-api.service[107386]: DEBUG dbcounter [-] [107386] Writing DB stats nova_cell1:SELECT=3 {{(pid=107386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:37.092221 n-d-852085-12 devstack@n-api.service[107386]: DEBUG dbcounter [-] [107386] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=107386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:38.596494 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-096b333d-bce0-4468-9848-3944ffcc7c28 admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:38.638427 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-096b333d-bce0-4468-9848-3944ffcc7c28 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.567409 Oct 04 20:20:38.639603 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 4 20:20:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:20:42.586885 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:42.589363 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-51b0ad8e-26f0-423c-a808-c79142d1a9fb None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002950 Oct 04 20:20:42.603819 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:20:43.371698 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-6302a017-7658-434a-b3ed-99d1338ff3b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256, "id": "c1"}} {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:43.524292 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-6302a017-7658-434a-b3ed-99d1338ff3b6 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.921522 Oct 04 20:20:43.524292 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 4 20:20:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:20:43.544162 n-d-852085-12 devstack@n-api.service[107387]: DEBUG dbcounter [-] [107387] Writing DB stats nova_api:SELECT=3 {{(pid=107387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:43.545457 n-d-852085-12 devstack@n-api.service[107387]: DEBUG dbcounter [-] [107387] Writing DB stats nova_cell0:SELECT=3 {{(pid=107387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:43.546578 n-d-852085-12 devstack@n-api.service[107387]: DEBUG dbcounter [-] [107387] Writing DB stats nova_cell1:SELECT=3 {{(pid=107387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:43.547670 n-d-852085-12 devstack@n-api.service[107387]: DEBUG dbcounter [-] [107387] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=107387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:43.847997 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-1e286eef-8312-4bc6-b8cf-e354ec69a42d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:44.016092 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-1e286eef-8312-4bc6-b8cf-e354ec69a42d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.480493 Oct 04 20:20:44.016718 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Oct 4 20:20:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:20:48.125518 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-6302a017-7658-434a-b3ed-99d1338ff3b6 admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:48.129827 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-6302a017-7658-434a-b3ed-99d1338ff3b6 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002518 Oct 04 20:20:48.131041 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:20:48 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:20:49.572327 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-fc326fa3-cfe4-458c-8c32-e9a946fabb6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "disk": 5, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M"}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:49.786427 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-fc326fa3-cfe4-458c-8c32-e9a946fabb6a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.644068 Oct 04 20:20:49.804206 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-b3e4b4d4-e4e5-4edd-9381-71dbb62db7b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:49.811843 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 4 20:20:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:20:49.936669 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-b3e4b4d4-e4e5-4edd-9381-71dbb62db7b1 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137317 Oct 04 20:20:49.944197 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Oct 4 20:20:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:20:53.384837 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-fc326fa3-cfe4-458c-8c32-e9a946fabb6a admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:53.387004 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-fc326fa3-cfe4-458c-8c32-e9a946fabb6a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002690 Oct 04 20:20:53.388097 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:20:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:20:54.322425 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-b0994917-e486-434e-8957-082074290dcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "swap": 0}} {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:54.407770 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-b0994917-e486-434e-8957-082074290dcc admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.010673 Oct 04 20:20:54.415207 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 4 20:20:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:20:54.422403 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-004a89bb-f53f-4e98-be29-5f7e844854cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:54.519368 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-004a89bb-f53f-4e98-be29-5f7e844854cd admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100965 Oct 04 20:20:54.520283 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Oct 4 20:20:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:20:58.309710 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-b0994917-e486-434e-8957-082074290dcc admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:58.311459 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-b0994917-e486-434e-8957-082074290dcc admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002106 Oct 04 20:20:58.312227 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:20:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:20:59.059709 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-0734d86f-cd16-4265-b7cb-4ce8260587b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:59.168935 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-0734d86f-cd16-4265-b7cb-4ce8260587b8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.846807 Oct 04 20:20:59.170096 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 4 20:20:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:20:59.187896 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-0b75898c-a183-4f43-84f6-20ebf7f4a0c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:59.285269 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-0b75898c-a183-4f43-84f6-20ebf7f4a0c5 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104515 Oct 04 20:20:59.286240 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Oct 4 20:20:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:21:02.446539 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-0734d86f-cd16-4265-b7cb-4ce8260587b8 admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:02.448341 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-0734d86f-cd16-4265-b7cb-4ce8260587b8 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002305 Oct 04 20:21:02.463263 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:21:02 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:03.125574 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-4c84f100-746f-4f27-9f62-70634f54e52a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4"}} {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:03.208150 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-4c84f100-746f-4f27-9f62-70634f54e52a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.749716 Oct 04 20:21:03.223036 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-17a6cfa9-0915-4daf-90ab-2303a0ee1e9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:03.228694 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 4 20:21:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:21:03.318187 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-17a6cfa9-0915-4daf-90ab-2303a0ee1e9e admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099514 Oct 04 20:21:03.339833 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Oct 4 20:21:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:21:06.748998 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-4c84f100-746f-4f27-9f62-70634f54e52a admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:06.750017 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-4c84f100-746f-4f27-9f62-70634f54e52a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 04 20:21:06.750434 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:21:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:21:07.413633 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-bb30df7f-5194-4678-85ef-cc75aff98fe0 admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:07.459744 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-bb30df7f-5194-4678-85ef-cc75aff98fe0 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.697536 Oct 04 20:21:07.461218 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 4 20:21:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:21:10.746723 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-4c84f100-746f-4f27-9f62-70634f54e52a admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:10.748575 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-4c84f100-746f-4f27-9f62-70634f54e52a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002666 Oct 04 20:21:10.749291 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:21:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:11.488602 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-053beae2-b05d-487f-a5a3-a1de68c606b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "swap": 0, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:11.690164 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-053beae2-b05d-487f-a5a3-a1de68c606b7 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.928621 Oct 04 20:21:11.690992 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 4 20:21:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:21:11.706809 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-614237aa-7d20-4e43-9872-65e7e3c8b56e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:11.713708 n-d-852085-12 devstack@n-api.service[107386]: DEBUG dbcounter [-] [107386] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=107386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:11.828741 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-614237aa-7d20-4e43-9872-65e7e3c8b56e admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127109 Oct 04 20:21:11.830038 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Oct 4 20:21:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:21:15.245141 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-053beae2-b05d-487f-a5a3-a1de68c606b7 admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:15.246201 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-053beae2-b05d-487f-a5a3-a1de68c606b7 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Oct 04 20:21:15.247396 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:21:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:15.984231 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-2792d12e-4519-4d5d-b064-b5023af3e95b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "2"}} {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:16.104395 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-2792d12e-4519-4d5d-b064-b5023af3e95b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.848156 Oct 04 20:21:16.105502 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 4 20:21:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:21:16.122179 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-bf50288a-6c0d-4fc9-b168-021410a50603 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:16.243578 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-bf50288a-6c0d-4fc9-b168-021410a50603 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125146 Oct 04 20:21:16.244539 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Oct 4 20:21:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:21:19.902456 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-2792d12e-4519-4d5d-b064-b5023af3e95b admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:19.904336 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-2792d12e-4519-4d5d-b064-b5023af3e95b admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002224 Oct 04 20:21:19.905187 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:21:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:20.654075 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-16acab81-aec8-497b-8f90-ad2aa566aaa4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "3", "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:20.664711 n-d-852085-12 devstack@n-api.service[107387]: DEBUG dbcounter [-] [107387] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=107387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:20.755997 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-16acab81-aec8-497b-8f90-ad2aa566aaa4 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.841137 Oct 04 20:21:20.757016 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 4 20:21:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:21:20.775825 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-3141afd4-62ea-4a41-a2f9-c5b564b3a9af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:20.990266 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-3141afd4-62ea-4a41-a2f9-c5b564b3a9af admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.218937 Oct 04 20:21:21.003173 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Oct 4 20:21:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:21:25.068957 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-16acab81-aec8-497b-8f90-ad2aa566aaa4 admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:25.070761 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-16acab81-aec8-497b-8f90-ad2aa566aaa4 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002449 Oct 04 20:21:25.075568 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:21:25 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:25.952470 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-42652e1d-3635-4699-a5ca-3e8388a073f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 80, "vcpus": 4, "name": "m1.large", "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:26.054168 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-42652e1d-3635-4699-a5ca-3e8388a073f2 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.971395 Oct 04 20:21:26.055673 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 4 20:21:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:21:26.078338 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-2d3fd05c-f1af-49ea-a81a-f791948ba1fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:26.213635 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-2d3fd05c-f1af-49ea-a81a-f791948ba1fc admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143170 Oct 04 20:21:26.215197 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Oct 4 20:21:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:21:30.102621 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-42652e1d-3635-4699-a5ca-3e8388a073f2 admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:30.105516 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-42652e1d-3635-4699-a5ca-3e8388a073f2 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003520 Oct 04 20:21:30.125257 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:21:30 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:30.976394 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-90cf0426-e5c4-407f-814c-1fd256c0b6dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "swap": 0, "ram": 16384}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:31.069700 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-90cf0426-e5c4-407f-814c-1fd256c0b6dc admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.952037 Oct 04 20:21:31.071244 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Oct 4 20:21:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:21:31.099504 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-5dc347f6-40ba-41ff-afdf-6aaab8dfa0fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:31.225146 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-5dc347f6-40ba-41ff-afdf-6aaab8dfa0fb admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.138834 Oct 04 20:21:31.229592 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Oct 4 20:21:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:21:56.399348 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-90cf0426-e5c4-407f-814c-1fd256c0b6dc admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:56.400362 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-90cf0426-e5c4-407f-814c-1fd256c0b6dc admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 04 20:21:56.400769 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:21:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:21:56.417212 n-d-852085-12 devstack@n-api.service[107386]: DEBUG dbcounter [-] [107386] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=107386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:56.973385 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-7eb49012-40d7-4d2e-b194-0428b484d513 admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:57.005270 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-7eb49012-40d7-4d2e-b194-0428b484d513 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.596447 Oct 04 20:21:57.006217 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 4 20:21:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:21:58.480247 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-90cf0426-e5c4-407f-814c-1fd256c0b6dc admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:58.481788 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-90cf0426-e5c4-407f-814c-1fd256c0b6dc admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002397 Oct 04 20:21:58.482230 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 4 20:21:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:21:59.165753 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-8cc05917-d123-4d8f-a3c0-0439471df911 admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:59.173752 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.wsgi [None req-8cc05917-d123-4d8f-a3c0-0439471df911 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-8cc05917-d123-4d8f-a3c0-0439471df911 admin admin] Request method failure captured: Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: Accept: application/json Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: Accept-Encoding: gzip, deflate Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: Connection: keep-alive Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: Content-Length: 0 Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: Host: 10.222.0.78 Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: Openstack-Api-Version: compute 2.92 Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: Openstack-System-Scope: None Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: User-Agent: python-novaclient Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: X-Auth-Token: gAAAAABjPJXmCDL45MMDBY8wixadIKdC8ti-pJTU9HGdC99KjDeRwsmk7QdoZi_EWcHwGX6YkI52Apx1gycpsELqTk17xaeZKXG68LuEUWtlOGrCISJJDmWcdAcgG1Z3HzCZyOWGsk2NZ-humRM7sGFGfGb8_bip5qoS2ltXQ6xCcP1Sx-vH4BE Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: X-Domain-Id: None Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: X-Domain-Name: None Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: X-Identity-Status: Confirmed Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: X-Is-Admin-Project: True Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: X-Project-Domain-Id: default Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: X-Project-Domain-Name: Default Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: X-Project-Id: 39207e776fb342b89ba6688e4c9f0eb3 Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: X-Project-Name: admin Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: X-Role: admin,reader,member Oct 04 20:21:59.177580 n-d-852085-12 devstack@n-api.service[107386]: X-Roles: admin,reader,member Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_39207e776fb342b89ba6688e4c9f0eb3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39207e776fb342b89ba6688e4c9f0eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39207e776fb342b89ba6688e4c9f0eb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/39207e776fb342b89ba6688e4c9f0eb3"}]}] Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: X-Tenant: admin Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: X-Tenant-Id: 39207e776fb342b89ba6688e4c9f0eb3 Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: X-Tenant-Name: admin Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: X-User: admin Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: X-User-Domain-Id: default Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: X-User-Domain-Name: Default Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: X-User-Id: 555d4df795a04beda46e1d2e3837f96a Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: X-User-Name: admin Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: method: > Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: exception: Flavor 42 could not be found. Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: action_args: {'id': '42'} Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:21:59.180624 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:59.182386 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:21:59.184791 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-8cc05917-d123-4d8f-a3c0-0439471df911 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:21:59.187783 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-8cc05917-d123-4d8f-a3c0-0439471df911 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.538059 Oct 04 20:21:59.187783 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 4 20:21:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 540 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:59.190728 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-af69ff4c-d307-4f44-895a-fef3e1d08ca4 admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:59.195289 n-d-852085-12 devstack@n-api.service[107387]: DEBUG dbcounter [-] [107387] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=107387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:59.217665 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-af69ff4c-d307-4f44-895a-fef3e1d08ca4 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.031225 Oct 04 20:21:59.218435 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Oct 4 20:21:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:21:59.241450 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-e4b2a616-c0ff-4b8b-a872-536e3a5fc2ec admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:59.266355 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-e4b2a616-c0ff-4b8b-a872-536e3a5fc2ec admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030709 Oct 04 20:21:59.266922 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Oct 4 20:21:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:21:59.278869 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-081f0463-3026-4ddc-8504-9120bdcc82df admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:59.284918 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.wsgi [None req-081f0463-3026-4ddc-8504-9120bdcc82df admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-081f0463-3026-4ddc-8504-9120bdcc82df admin admin] Request method failure captured: Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: Accept: application/json Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: Accept-Encoding: gzip, deflate Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: Connection: keep-alive Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: Content-Length: 0 Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: Host: 10.222.0.78 Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: Openstack-Api-Version: compute 2.92 Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: Openstack-System-Scope: None Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: User-Agent: python-novaclient Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: X-Auth-Token: gAAAAABjPJXmCDL45MMDBY8wixadIKdC8ti-pJTU9HGdC99KjDeRwsmk7QdoZi_EWcHwGX6YkI52Apx1gycpsELqTk17xaeZKXG68LuEUWtlOGrCISJJDmWcdAcgG1Z3HzCZyOWGsk2NZ-humRM7sGFGfGb8_bip5qoS2ltXQ6xCcP1Sx-vH4BE Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: X-Domain-Id: None Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: X-Domain-Name: None Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: X-Identity-Status: Confirmed Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: X-Is-Admin-Project: True Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: X-Project-Domain-Id: default Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: X-Project-Domain-Name: Default Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: X-Project-Id: 39207e776fb342b89ba6688e4c9f0eb3 Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: X-Project-Name: admin Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: X-Role: admin,reader,member Oct 04 20:21:59.288536 n-d-852085-12 devstack@n-api.service[107387]: X-Roles: admin,reader,member Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_39207e776fb342b89ba6688e4c9f0eb3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39207e776fb342b89ba6688e4c9f0eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39207e776fb342b89ba6688e4c9f0eb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/39207e776fb342b89ba6688e4c9f0eb3"}]}] Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: X-Tenant: admin Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: X-Tenant-Id: 39207e776fb342b89ba6688e4c9f0eb3 Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: X-Tenant-Name: admin Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: X-User: admin Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: X-User-Domain-Id: default Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: X-User-Domain-Name: Default Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: X-User-Id: 555d4df795a04beda46e1d2e3837f96a Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: X-User-Name: admin Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: method: > Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: exception: Flavor 42 could not be found. Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: action_args: {'id': '42'} Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:21:59.290260 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:59.291207 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:21:59.312734 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-081f0463-3026-4ddc-8504-9120bdcc82df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:21:59.314665 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-081f0463-3026-4ddc-8504-9120bdcc82df admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.016588 Oct 04 20:21:59.314665 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 4 20:21:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:00.766296 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-e4b2a616-c0ff-4b8b-a872-536e3a5fc2ec admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:00.767712 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-e4b2a616-c0ff-4b8b-a872-536e3a5fc2ec admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002875 Oct 04 20:22:00.768251 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 4 20:22:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:22:01.563320 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-67b75e69-e19c-46b7-9c7c-9402d102f5ba admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:01.572813 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.wsgi [None req-67b75e69-e19c-46b7-9c7c-9402d102f5ba admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-67b75e69-e19c-46b7-9c7c-9402d102f5ba admin admin] Request method failure captured: Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: Accept: application/json Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: Accept-Encoding: gzip, deflate Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: Connection: keep-alive Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: Content-Length: 0 Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: Host: 10.222.0.78 Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: Openstack-Api-Version: compute 2.92 Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: Openstack-System-Scope: None Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: User-Agent: python-novaclient Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: X-Auth-Token: gAAAAABjPJXooXm5Sa909JOelT3dy0jLXrE62oaIWUr-RpgiLghWpvYcog7aNLmp4g55CGGIGPb2IIbFRFLECkW89i3z5EUdTssaXZGlMdVifNBXnWtu8nat18Hu7LTn0TB42UfFcFKhoIAjxQEozkilPyUVw-K9jYv4GgdE7KH_me7M0rW7ieA Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: X-Domain-Id: None Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: X-Domain-Name: None Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: X-Identity-Status: Confirmed Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: X-Is-Admin-Project: True Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: X-Project-Domain-Id: default Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: X-Project-Domain-Name: Default Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: X-Project-Id: 39207e776fb342b89ba6688e4c9f0eb3 Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: X-Project-Name: admin Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: X-Role: admin,reader,member Oct 04 20:22:01.575863 n-d-852085-12 devstack@n-api.service[107387]: X-Roles: admin,reader,member Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_39207e776fb342b89ba6688e4c9f0eb3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39207e776fb342b89ba6688e4c9f0eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39207e776fb342b89ba6688e4c9f0eb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/39207e776fb342b89ba6688e4c9f0eb3"}]}] Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: X-Tenant: admin Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: X-Tenant-Id: 39207e776fb342b89ba6688e4c9f0eb3 Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: X-Tenant-Name: admin Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: X-User: admin Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: X-User-Domain-Id: default Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: X-User-Domain-Name: Default Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: X-User-Id: 555d4df795a04beda46e1d2e3837f96a Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: X-User-Name: admin Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: method: > Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: exception: Flavor 84 could not be found. Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: action_args: {'id': '84'} Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:22:01.578775 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:22:01.581302 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:22:01.583812 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-67b75e69-e19c-46b7-9c7c-9402d102f5ba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:22:01.586231 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-67b75e69-e19c-46b7-9c7c-9402d102f5ba admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.667413 Oct 04 20:22:01.586231 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 4 20:22:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 669 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 20:22:01.595629 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-df9457ea-7c93-436d-b823-78ec97854c6a admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:01.627590 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-df9457ea-7c93-436d-b823-78ec97854c6a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.038800 Oct 04 20:22:01.628629 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Oct 4 20:22:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:22:01.638765 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-b103cff3-ba71-484f-bbe9-de95f488f524 admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:01.656487 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-b103cff3-ba71-484f-bbe9-de95f488f524 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021357 Oct 04 20:22:01.657064 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Oct 4 20:22:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:22:01.667531 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-a0460485-7113-40ae-8333-d45c156fd648 admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:01.673606 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.wsgi [None req-a0460485-7113-40ae-8333-d45c156fd648 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-a0460485-7113-40ae-8333-d45c156fd648 admin admin] Request method failure captured: Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: Accept: application/json Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: Accept-Encoding: gzip, deflate Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: Connection: keep-alive Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: Content-Length: 0 Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: Host: 10.222.0.78 Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: Openstack-Api-Version: compute 2.92 Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: Openstack-System-Scope: None Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: User-Agent: python-novaclient Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: X-Auth-Token: gAAAAABjPJXooXm5Sa909JOelT3dy0jLXrE62oaIWUr-RpgiLghWpvYcog7aNLmp4g55CGGIGPb2IIbFRFLECkW89i3z5EUdTssaXZGlMdVifNBXnWtu8nat18Hu7LTn0TB42UfFcFKhoIAjxQEozkilPyUVw-K9jYv4GgdE7KH_me7M0rW7ieA Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: X-Domain-Id: None Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: X-Domain-Name: None Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: X-Identity-Status: Confirmed Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: X-Is-Admin-Project: True Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: X-Project-Domain-Id: default Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: X-Project-Domain-Name: Default Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: X-Project-Id: 39207e776fb342b89ba6688e4c9f0eb3 Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: X-Project-Name: admin Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: X-Role: admin,reader,member Oct 04 20:22:01.675351 n-d-852085-12 devstack@n-api.service[107386]: X-Roles: admin,reader,member Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_39207e776fb342b89ba6688e4c9f0eb3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39207e776fb342b89ba6688e4c9f0eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39207e776fb342b89ba6688e4c9f0eb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/39207e776fb342b89ba6688e4c9f0eb3"}]}] Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: X-Tenant: admin Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: X-Tenant-Id: 39207e776fb342b89ba6688e4c9f0eb3 Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: X-Tenant-Name: admin Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: X-User: admin Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: X-User-Domain-Id: default Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: X-User-Domain-Name: Default Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: X-User-Id: 555d4df795a04beda46e1d2e3837f96a Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: X-User-Name: admin Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: method: > Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: exception: Flavor 84 could not be found. Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: action_args: {'id': '84'} Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:22:01.677767 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:22:01.679416 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:22:01.681676 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-a0460485-7113-40ae-8333-d45c156fd648 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:22:01.684091 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-a0460485-7113-40ae-8333-d45c156fd648 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013647 Oct 04 20:22:01.684091 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 4 20:22:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 20:22:03.054854 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-b103cff3-ba71-484f-bbe9-de95f488f524 admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:03.056007 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-b103cff3-ba71-484f-bbe9-de95f488f524 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Oct 04 20:22:03.056490 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 4 20:22:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:22:03.798025 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-9b33ea60-058b-4eb4-a1b1-5c8783a2b465 admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:03.804519 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.wsgi [None req-9b33ea60-058b-4eb4-a1b1-5c8783a2b465 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-9b33ea60-058b-4eb4-a1b1-5c8783a2b465 admin admin] Request method failure captured: Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: Accept: application/json Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: Accept-Encoding: gzip, deflate Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: Connection: keep-alive Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: Content-Length: 0 Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: Host: 10.222.0.78 Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: Openstack-Api-Version: compute 2.92 Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: Openstack-System-Scope: None Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: User-Agent: python-novaclient Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: X-Auth-Token: gAAAAABjPJXqdmJovHHz1ULF6lJSFwDbs6jq7c6n6AZNjfs6FX6P8NnJCDjh7PwUZQVDreau7C5v_Hp3MphubF_nqhJWxRq-xAYDdlRaIKl4pGYcpPCb3KTbLXvh909VRM7Uhwr78UkZZ-TI62rmicTFfYtymKwvTpeLJ14pE-IOx9zAIeZiNNw Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: X-Domain-Id: None Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: X-Domain-Name: None Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: X-Identity-Status: Confirmed Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: X-Is-Admin-Project: True Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: X-Project-Domain-Id: default Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: X-Project-Domain-Name: Default Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: X-Project-Id: 39207e776fb342b89ba6688e4c9f0eb3 Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: X-Project-Name: admin Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: X-Role: admin,reader,member Oct 04 20:22:03.806072 n-d-852085-12 devstack@n-api.service[107386]: X-Roles: admin,reader,member Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_39207e776fb342b89ba6688e4c9f0eb3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39207e776fb342b89ba6688e4c9f0eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39207e776fb342b89ba6688e4c9f0eb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/39207e776fb342b89ba6688e4c9f0eb3"}]}] Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: X-Tenant: admin Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: X-Tenant-Id: 39207e776fb342b89ba6688e4c9f0eb3 Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: X-Tenant-Name: admin Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: X-User: admin Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: X-User-Domain-Id: default Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: X-User-Domain-Name: Default Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: X-User-Id: 555d4df795a04beda46e1d2e3837f96a Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: X-User-Name: admin Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: method: > Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: exception: Flavor 451 could not be found. Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: action_args: {'id': '451'} Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:22:03.809394 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:22:03.812034 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: ERROR nova.api.openstack.wsgi Oct 04 20:22:03.814459 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-9b33ea60-058b-4eb4-a1b1-5c8783a2b465 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:22:03.817001 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-9b33ea60-058b-4eb4-a1b1-5c8783a2b465 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.610146 Oct 04 20:22:03.817001 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 4 20:22:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 611 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:03.823841 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-62703e79-f707-4ec8-a06a-6b0249c96143 admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:03.840515 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-62703e79-f707-4ec8-a06a-6b0249c96143 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020290 Oct 04 20:22:03.841081 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Oct 4 20:22:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:22:03.852446 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:03.871293 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022608 Oct 04 20:22:03.871843 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Oct 4 20:22:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:22:03.886242 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-990ab21d-b7bf-4e99-b679-285c59050fea admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:03.896154 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.wsgi [None req-990ab21d-b7bf-4e99-b679-285c59050fea admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-990ab21d-b7bf-4e99-b679-285c59050fea admin admin] Request method failure captured: Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: Accept: application/json Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: Accept-Encoding: gzip, deflate Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: Connection: keep-alive Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: Content-Length: 0 Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: Host: 10.222.0.78 Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: Openstack-Api-Version: compute 2.92 Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: Openstack-System-Scope: None Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: User-Agent: python-novaclient Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: X-Auth-Token: gAAAAABjPJXqdmJovHHz1ULF6lJSFwDbs6jq7c6n6AZNjfs6FX6P8NnJCDjh7PwUZQVDreau7C5v_Hp3MphubF_nqhJWxRq-xAYDdlRaIKl4pGYcpPCb3KTbLXvh909VRM7Uhwr78UkZZ-TI62rmicTFfYtymKwvTpeLJ14pE-IOx9zAIeZiNNw Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: X-Domain-Id: None Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: X-Domain-Name: None Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: X-Identity-Status: Confirmed Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: X-Is-Admin-Project: True Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: X-Project-Domain-Id: default Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: X-Project-Domain-Name: Default Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: X-Project-Id: 39207e776fb342b89ba6688e4c9f0eb3 Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: X-Project-Name: admin Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: X-Role: admin,reader,member Oct 04 20:22:03.899306 n-d-852085-12 devstack@n-api.service[107387]: X-Roles: admin,reader,member Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_39207e776fb342b89ba6688e4c9f0eb3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39207e776fb342b89ba6688e4c9f0eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39207e776fb342b89ba6688e4c9f0eb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/39207e776fb342b89ba6688e4c9f0eb3"}]}] Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: X-Tenant: admin Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: X-Tenant-Id: 39207e776fb342b89ba6688e4c9f0eb3 Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: X-Tenant-Name: admin Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: X-User: admin Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: X-User-Domain-Id: default Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: X-User-Domain-Name: Default Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: X-User-Id: 555d4df795a04beda46e1d2e3837f96a Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: X-User-Name: admin Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: method: > Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: exception: Flavor 451 could not be found. Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: action_args: {'id': '451'} Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:22:03.901798 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:22:03.903475 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: ERROR nova.api.openstack.wsgi Oct 04 20:22:03.905968 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-990ab21d-b7bf-4e99-b679-285c59050fea admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:22:03.908191 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-990ab21d-b7bf-4e99-b679-285c59050fea admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.022158 Oct 04 20:22:03.908191 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 4 20:22:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:05.245177 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:05.246369 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 Oct 04 20:22:05.246905 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 4 20:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:22:05.872733 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-1c964c86-fc9e-43d8-9bcc-98821bfea697 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:22:05.980622 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-1c964c86-fc9e-43d8-9bcc-98821bfea697 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.591563 Oct 04 20:22:05.981188 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Oct 4 20:22:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:22:07.502152 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:07.503063 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 04 20:22:07.503524 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 4 20:22:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:22:08.165832 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-1edd6997-fe18-480f-b2b9-0339149293a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:22:08.318646 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-1edd6997-fe18-480f-b2b9-0339149293a8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.666822 Oct 04 20:22:08.319549 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Oct 4 20:22:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:22:09.811889 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:09.812834 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Oct 04 20:22:09.813243 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 4 20:22:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:22:10.451444 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-56cad3cd-c0fc-4074-a605-2420d553c442 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:22:10.684071 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-56cad3cd-c0fc-4074-a605-2420d553c442 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.730924 Oct 04 20:22:10.684793 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Oct 4 20:22:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:22:12.007211 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:12.008387 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001681 Oct 04 20:22:12.008865 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 4 20:22:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:22:12.690935 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-7e30b336-0e96-4793-89a5-9e080f2dd6fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:22:12.787586 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-7e30b336-0e96-4793-89a5-9e080f2dd6fd admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.639688 Oct 04 20:22:12.788146 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Oct 4 20:22:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:22:14.218327 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:14.219384 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Oct 04 20:22:14.219791 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 4 20:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:22:14.851707 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-84aef255-f2fa-499d-b143-e11a02fe2cb9 admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:14.874051 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-84aef255-f2fa-499d-b143-e11a02fe2cb9 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.513073 Oct 04 20:22:14.874606 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Tue Oct 4 20:22:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:23:16.423753 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:23:16.424863 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-946b4839-237d-424b-88fa-c098f0939c1a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Oct 04 20:23:16.425271 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 931 bytes} [Tue Oct 4 20:23:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:23:16.434189 n-d-852085-12 devstack@n-api.service[107387]: DEBUG dbcounter [-] [107387] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=107387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:16.865135 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-8dd34bf7-8447-478c-84b1-d16f25497283 admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:23:16.886873 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-8dd34bf7-8447-478c-84b1-d16f25497283 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.454792 Oct 04 20:23:16.887460 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Oct 4 20:23:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:23:16.908514 n-d-852085-12 devstack@n-api.service[107386]: DEBUG dbcounter [-] [107386] Writing DB stats nova_api:SELECT=14 {{(pid=107386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:16.912600 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-d773559d-d720-4538-bfc9-447f38bd2b5a admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:23:16.920857 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-d773559d-d720-4538-bfc9-447f38bd2b5a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013849 Oct 04 20:23:16.921420 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1283 bytes} [Tue Oct 4 20:23:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:23:16.934690 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-ff4aa5a8-372d-4f06-9a94-21d9ae3dcabc admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:23:16.942551 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-ff4aa5a8-372d-4f06-9a94-21d9ae3dcabc admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012261 Oct 04 20:23:16.943112 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1286 bytes} [Tue Oct 4 20:23:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:23:16.955297 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-93a81564-db1b-4b6a-8223-1165f67fb280 admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:23:16.963416 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-93a81564-db1b-4b6a-8223-1165f67fb280 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011805 Oct 04 20:23:16.963990 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1286 bytes} [Tue Oct 4 20:23:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:23:16.976011 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-e6aac38e-1416-48c2-8204-c55498c45b06 admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:23:16.984550 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-e6aac38e-1416-48c2-8204-c55498c45b06 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012105 Oct 04 20:23:16.985109 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1283 bytes} [Tue Oct 4 20:23:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:29:01.890737 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-93a81564-db1b-4b6a-8223-1165f67fb280 admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:29:01.892262 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-93a81564-db1b-4b6a-8223-1165f67fb280 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 Oct 04 20:29:01.892657 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 4 20:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:29:02.033467 n-d-852085-12 devstack@n-api.service[107387]: DEBUG dbcounter [-] [107387] Writing DB stats nova_api:SELECT=6 {{(pid=107387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:29:02.177002 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-58c5c6f2-3ab9-4ba2-b781-9c192866384f admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:29:02.181552 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-58c5c6f2-3ab9-4ba2-b781-9c192866384f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:29:02.182071 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-58c5c6f2-3ab9-4ba2-b781-9c192866384f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:29:02.182447 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-58c5c6f2-3ab9-4ba2-b781-9c192866384f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:29:02.183207 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-58c5c6f2-3ab9-4ba2-b781-9c192866384f admin admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:29:02.183610 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-58c5c6f2-3ab9-4ba2-b781-9c192866384f admin admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:29:02.184020 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-58c5c6f2-3ab9-4ba2-b781-9c192866384f admin admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:29:02.223579 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-58c5c6f2-3ab9-4ba2-b781-9c192866384f admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.191906 Oct 04 20:29:02.224152 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 4 20:29:02 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:29:03.338612 n-d-852085-12 devstack@n-api.service[107386]: DEBUG nova.api.openstack.wsgi [None req-93a81564-db1b-4b6a-8223-1165f67fb280 admin admin] Calling method '>' {{(pid=107386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:29:03.339652 n-d-852085-12 devstack@n-api.service[107386]: INFO nova.api.openstack.requestlog [None req-93a81564-db1b-4b6a-8223-1165f67fb280 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 04 20:29:03.340043 n-d-852085-12 devstack@n-api.service[107386]: [pid: 107386|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Oct 4 20:29:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:29:03.533673 n-d-852085-12 devstack@n-api.service[107387]: DEBUG nova.api.openstack.wsgi [None req-92912c4f-dd7d-4781-bda1-beb83837ad6a admin admin] Calling method '>' {{(pid=107387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:29:03.537479 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-92912c4f-dd7d-4781-bda1-beb83837ad6a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:29:03.537964 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-92912c4f-dd7d-4781-bda1-beb83837ad6a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:29:03.538397 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-92912c4f-dd7d-4781-bda1-beb83837ad6a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:29:03.539121 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-92912c4f-dd7d-4781-bda1-beb83837ad6a admin admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:29:03.539642 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-92912c4f-dd7d-4781-bda1-beb83837ad6a admin admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:29:03.540060 n-d-852085-12 devstack@n-api.service[107387]: DEBUG oslo_concurrency.lockutils [None req-92912c4f-dd7d-4781-bda1-beb83837ad6a admin admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:29:03.564847 n-d-852085-12 devstack@n-api.service[107387]: INFO nova.api.openstack.requestlog [None req-92912c4f-dd7d-4781-bda1-beb83837ad6a admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.087209 Oct 04 20:29:03.565336 n-d-852085-12 devstack@n-api.service[107387]: [pid: 107387|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 4 20:29:03 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:29:52.975209 n-d-852085-12 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 20:29:52.976077 n-d-852085-12 devstack@n-api.service[107385]: Tue Oct 4 20:29:52 2022 - graceful shutdown triggered... Oct 04 20:29:52.976548 n-d-852085-12 devstack@n-api.service[107386]: Gracefully killing worker 1 (pid: 107386)... Oct 04 20:29:52.976919 n-d-852085-12 devstack@n-api.service[107387]: Gracefully killing worker 2 (pid: 107387)... Oct 04 20:29:53.107540 n-d-852085-12 devstack@n-api.service[107386]: DEBUG dbcounter [-] [107386] Writing DB stats nova_api:SELECT=4 {{(pid=107386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:29:53.976931 n-d-852085-12 devstack@n-api.service[107385]: worker 1 buried after 1 seconds Oct 04 20:29:53.976931 n-d-852085-12 devstack@n-api.service[107385]: worker 2 buried after 1 seconds Oct 04 20:29:53.976931 n-d-852085-12 devstack@n-api.service[107385]: goodbye to uWSGI. Oct 04 20:29:53.978526 n-d-852085-12 systemd[1]: devstack@n-api.service: Succeeded. Oct 04 20:29:53.979098 n-d-852085-12 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 20:29:53.981895 n-d-852085-12 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 20:29:53.996372 n-d-852085-12 devstack@n-api.service[123527]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 20:29:53 2022] *** Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: nodename: n-d-852085-12 Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: machine: x86_64 Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: clock source: unix Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: pcre jit disabled Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: detected number of CPU cores: 4 Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: current working directory: / Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: detected binary path: /usr/bin/uwsgi-core Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: your processes number limit is 47680 Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: your memory page size is 4096 bytes Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: detected max file descriptor number: 2048 Oct 04 20:29:54.012282 n-d-852085-12 devstack@n-api.service[123527]: lock engine: pthread robust mutexes Oct 04 20:29:54.013458 n-d-852085-12 devstack@n-api.service[123527]: thunder lock: enabled Oct 04 20:29:54.013458 n-d-852085-12 devstack@n-api.service[123527]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 20:29:54.013458 n-d-852085-12 devstack@n-api.service[123527]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 20:29:54.055414 n-d-852085-12 devstack@n-api.service[123527]: Python main interpreter initialized at 0x5632f630e9c0 Oct 04 20:29:54.055414 n-d-852085-12 devstack@n-api.service[123527]: python threads support enabled Oct 04 20:29:54.055414 n-d-852085-12 devstack@n-api.service[123527]: your server socket listen backlog is limited to 100 connections Oct 04 20:29:54.055414 n-d-852085-12 devstack@n-api.service[123527]: your mercy for graceful operations on workers is 90 seconds Oct 04 20:29:54.055881 n-d-852085-12 devstack@n-api.service[123527]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 20:29:54.055881 n-d-852085-12 devstack@n-api.service[123527]: *** Operational MODE: preforking *** Oct 04 20:29:54.056220 n-d-852085-12 devstack@n-api.service[123527]: *** uWSGI is running in multiple interpreter mode *** Oct 04 20:29:54.056220 n-d-852085-12 devstack@n-api.service[123527]: spawned uWSGI master process (pid: 123527) Oct 04 20:29:54.056374 n-d-852085-12 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 20:29:54.056940 n-d-852085-12 devstack@n-api.service[123527]: spawned uWSGI worker 1 (pid: 123539, cores: 1) Oct 04 20:29:54.057288 n-d-852085-12 devstack@n-api.service[123527]: spawned uWSGI worker 2 (pid: 123540, cores: 1) Oct 04 20:29:54.059322 n-d-852085-12 devstack@n-api.service[123527]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 20:29:54.735239 n-d-852085-12 devstack@n-api.service[123540]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:29:54.735979 n-d-852085-12 devstack@n-api.service[123539]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:29:55.913131 n-d-852085-12 devstack@n-api.service[123539]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:29:55.913131 n-d-852085-12 devstack@n-api.service[123539]: from cryptography.utils import int_from_bytes Oct 04 20:29:55.913886 n-d-852085-12 devstack@n-api.service[123539]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:29:55.913886 n-d-852085-12 devstack@n-api.service[123539]: from cryptography.utils import int_from_bytes Oct 04 20:29:55.943248 n-d-852085-12 devstack@n-api.service[123540]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:29:55.943248 n-d-852085-12 devstack@n-api.service[123540]: from cryptography.utils import int_from_bytes Oct 04 20:29:55.943889 n-d-852085-12 devstack@n-api.service[123540]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:29:55.943889 n-d-852085-12 devstack@n-api.service[123540]: from cryptography.utils import int_from_bytes Oct 04 20:29:58.400677 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:29:58.401338 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:29:58.401511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:29:58.401876 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:29:58.402139 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:29:58.402580 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.402876 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.403362 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.403725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.404067 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.404397 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.404732 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.405052 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.405389 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.405657 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.405979 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.406314 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852085-12 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.406643 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.406959 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.407353 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.407684 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.407995 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.408327 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.408655 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.409224 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.409822 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.410019 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.410343 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.410689 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.411014 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.411360 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.411689 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.411991 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.412338 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.412704 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.413067 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852085-12 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.413528 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.413680 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.414123 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.414433 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.414750 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.415105 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.415421 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.415747 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.416111 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.416391 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.416714 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.417036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.417401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.417676 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.417990 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.418303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.418628 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.418939 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.419275 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.419530 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.419978 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.420177 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.420506 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.420834 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.421090 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.421343 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.421664 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.421986 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.422298 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.422608 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.422951 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.423292 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.423602 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.423913 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.424223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.424535 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.424859 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.425185 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.425513 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.425826 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.426323 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.426801 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.426801 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.427114 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.427493 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.427858 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.428187 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.428440 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.428813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.429087 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.429400 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.429715 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.430050 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.430380 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.430676 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.430928 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.431264 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.431577 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.431904 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.432217 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.432529 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.432842 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.433148 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.433461 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.433770 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.434089 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.434399 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.434710 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.435030 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.435364 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.439069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.439069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.439069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.439069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.439069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.439069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.439069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.439069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.440292 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.440292 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.440292 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.440771 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.441075 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.441543 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.441917 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.442300 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.442722 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.443294 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.443628 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.444016 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.444405 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.444789 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.445171 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.445631 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.446009 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.446494 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.446758 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.447161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.447581 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.448130 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.448673 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.449198 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.449677 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.450149 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.450616 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.451075 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.451674 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.452170 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.452520 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.452938 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.453356 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.453862 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.454929 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.455364 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.455842 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.456244 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.456647 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.457028 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.457415 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.457801 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.458197 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.458662 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.459126 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.459598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.460022 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.460499 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.460999 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.461483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.462073 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.462482 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.462866 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.463320 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.463740 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.464193 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.464591 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.464997 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.465372 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.465761 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.466329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.466820 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.467249 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.467644 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.468038 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.468463 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.468916 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.469345 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.469794 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.470174 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.470626 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.471067 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.471666 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.472232 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.472413 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:29:58.473126 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:29:58.473285 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.473446 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:29:58.473599 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.473753 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:29:58.473753 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:29:58.474071 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.474217 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.474432 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.474605 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.474763 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.474987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.475231 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.475536 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.475717 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.475875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.476106 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.476236 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.476508 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.476623 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.476851 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.476975 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.477126 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.477390 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.477507 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.477777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852085-12 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.477981 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.478216 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.478382 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.478532 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.478676 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.478898 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.479222 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.479352 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.479559 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.479736 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.479888 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.480216 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.480345 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.480717 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.480818 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.481039 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.481182 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.481353 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.481623 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.481738 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.481999 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.482133 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.482319 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.482665 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.482777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.482995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.483182 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.483337 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.483629 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.483723 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.483975 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.484082 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.484387 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852085-12 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.484559 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.484706 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.484997 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.485105 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.485361 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.485453 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.485809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.485922 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.486103 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.486331 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.486426 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.486735 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.486840 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.487073 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.487499 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.487662 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.487945 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.488047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.488316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.488447 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.488640 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.488838 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.489101 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.489362 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.489515 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.489763 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.489944 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.490082 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.490409 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.490524 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.490721 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.490984 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.491092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.491465 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.491562 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.491897 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.492035 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.492252 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.492415 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.492584 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.492917 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.493040 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.493163 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.493433 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.493571 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.493760 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.494049 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.494178 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.494405 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.494549 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.494701 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.495017 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.495217 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.495363 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.495641 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.495774 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.495979 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.496165 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.496421 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.496737 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.496958 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.763925 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.765427 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.765582 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.765886 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.766101 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.766101 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.766372 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.766481 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.766583 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.766666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.766666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.766796 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.766896 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.766896 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.767053 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.767125 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.767125 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.767389 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.767472 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.808375 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.808543 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.808665 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.808778 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.808892 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.809318 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.809446 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.809570 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.809570 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.809768 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.809868 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.809985 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.810084 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.810182 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.810288 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.810392 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.810506 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.810605 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.810709 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.810829 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.810943 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.811049 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.811180 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.811308 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.811412 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.811513 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.811614 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.811742 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.811847 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.811958 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.812058 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.812161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.812263 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.812380 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.812494 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.812614 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.812716 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.812817 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.812925 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.813117 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.813220 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.813358 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.813985 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.814092 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.814210 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.814354 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.814485 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.814573 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.814692 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.814797 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.814923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.815022 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.815126 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.815256 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.815383 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.815478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.815582 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.815685 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.815794 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.815899 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.816015 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.816129 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.816265 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.816392 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.816493 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.816603 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.816751 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.816867 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.816972 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.817078 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.817193 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.817298 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.817403 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.817520 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.817629 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.817763 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.817906 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.818002 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.818112 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.818223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.818330 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.818465 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.818585 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.818700 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.818801 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.818905 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.819005 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.819478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.819581 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.819732 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.819843 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.819963 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.820085 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.820198 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.820318 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.820418 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.820519 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.820655 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.820803 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.820924 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.821045 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.821141 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.821268 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.821386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.821503 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.821632 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.821740 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.821840 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.821941 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.822042 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.822144 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.822867 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.822989 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.823104 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.823267 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.823390 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.823527 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:58.823631 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.823736 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.823831 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.823950 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.824049 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.824049 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.824281 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.824401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.824537 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.824724 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.824847 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.824971 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.825081 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.825193 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.825193 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.825380 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.825483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.825610 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.825715 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.825817 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.825919 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.826022 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.826133 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.826240 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.826352 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.826461 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.826740 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.826848 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.826969 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.827076 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.827209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.827316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.827428 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.827534 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.827668 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.827668 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.827861 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.827965 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.828082 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.828187 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.828299 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.828404 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.828509 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.828613 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.828716 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.828897 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.829003 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.829108 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.829214 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.829486 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.829683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.829821 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.829929 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.830036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.830036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.830232 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.830338 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.830457 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.830572 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.830679 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.830804 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.830941 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.831066 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.831289 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.831415 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.831545 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.831662 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.831760 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.831879 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.831978 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.832079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.832188 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.832288 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.832389 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.832527 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.832625 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.832729 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.832817 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.832817 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.832928 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.833063 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.833160 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.833262 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.833362 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.833471 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.833570 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.833685 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.833804 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.833902 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.834002 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.834093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.834217 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.834340 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.834450 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.834565 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.834743 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.834902 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.835076 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.835263 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.835361 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.835474 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.835589 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.835724 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.835820 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.835950 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.836070 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.836192 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.836290 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.836359 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.836429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.836494 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.836595 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.836708 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.836824 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.836964 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.837099 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.837225 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.837350 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.837350 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.837577 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.837749 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.837895 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.838028 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.838165 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.838289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.838402 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.838518 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.838646 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.838763 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.838879 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.838994 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.839110 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.839405 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.839708 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.839882 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.840018 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.840150 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.840283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.840425 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.840557 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.840688 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.840821 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.840952 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.841085 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.841231 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.841568 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.841700 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.841835 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.841962 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.842086 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.842230 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.842362 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.842494 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.842622 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.842752 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.842896 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.843027 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.843027 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.843347 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.843480 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.843612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.843760 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.843889 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.844021 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.844153 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.844284 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.844420 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.844564 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.844694 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.844824 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.844956 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.845087 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.845218 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.845360 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.845491 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.845623 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.845754 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.845887 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.845887 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.846135 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.846264 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.846395 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.846529 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.846659 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.846805 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.846936 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.847066 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.847220 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.847349 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.847479 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.847626 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.847757 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.847946 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.848081 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.848211 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.848341 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.848485 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.848485 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.848833 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.849029 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.849200 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.849383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.849383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.849713 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.849901 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.850075 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.850209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.850209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.850209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.850209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.850675 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.850806 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.850806 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.851257 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.851429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.851429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.851748 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.851894 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.851894 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.851894 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.852262 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.852396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.852396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.852396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.852396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.852859 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.852998 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.852998 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.852998 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.852998 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.852998 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.853697 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.853860 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.853860 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.853860 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.853860 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.854388 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.854602 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.854602 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.854602 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.854602 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.855511 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.855734 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.855734 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.856185 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.856411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.856411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.856411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.856411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.857299 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.857520 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.857520 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.858041 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.858321 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.858321 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.858737 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.858956 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.858956 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.859489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.859711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.859711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.860606 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.860888 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.860888 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.861318 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.861534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.861534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.861534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.861534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.861534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.861534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.861534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.863062 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.863276 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.863276 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.863547 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.863730 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.863730 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.864072 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.864208 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.864208 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.864560 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.864697 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.864697 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.864940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.865217 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.865217 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.865455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.865673 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.865816 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.865950 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.865950 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.865950 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.866415 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.866550 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.866775 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.866959 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.866959 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.867332 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.867466 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.867466 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.867713 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.867847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.867982 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.868129 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.868129 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.868129 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.868488 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.868620 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.868620 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.868880 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.869016 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.869016 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.869016 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.869368 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.869501 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.869501 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.869822 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.869956 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.869956 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.870196 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.870343 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.870343 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.870593 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.870727 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.870861 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.870992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.870992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.871264 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.871397 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.871397 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.871643 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.871778 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.872040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.872186 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.872566 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.872768 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.873103 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.873252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.873604 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.873751 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.874085 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.874230 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.874597 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.874757 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.875009 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.875181 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.875353 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.875691 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.875855 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.876672 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.876765 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.877007 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.877205 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.877316 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.877633 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.877808 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.877955 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.878279 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.878359 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.878608 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.878733 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.878931 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.879298 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.879385 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.879731 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.879820 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.880162 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.880259 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.880628 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.880714 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.881111 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.881197 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.881549 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.881649 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.881981 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.882226 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.882422 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.882694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.882953 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.883329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.883835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.884600 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.885030 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.885295 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.885519 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.885681 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.885996 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.886084 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.886324 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.886619 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.886703 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.886967 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.887375 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.887502 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.887943 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.895273 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.895393 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.895463 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.895463 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.895638 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.895702 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.895702 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.895830 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.895890 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.895950 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896010 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896010 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896143 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896211 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896272 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896272 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896379 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896439 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896602 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896662 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896722 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896722 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896900 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.896963 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897039 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897039 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897344 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897423 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897487 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897487 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897608 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897608 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897724 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897783 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897842 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.897900 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898100 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898175 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898236 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898296 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898356 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898414 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898482 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898482 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898590 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898649 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898708 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898767 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898833 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898894 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.898953 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.899389 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.899475 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.899537 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.899611 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.899851 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.900018 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.900172 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.900306 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.900489 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.900630 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.900795 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.900926 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.901104 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.901558 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.901860 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.901945 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.902199 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.902462 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.902547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.902793 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.903114 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.903320 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.903462 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.903584 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.903804 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.903885 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.904145 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.904234 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.904445 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.904528 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.904780 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.904943 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.905117 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.905333 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.905477 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.905705 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.905781 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.906040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.906121 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.906368 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.906539 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.906685 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.906772 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.907050 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.907170 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.907416 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.907516 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.907745 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.908131 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.908131 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.908401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.908532 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.908657 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.908798 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.908929 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.909058 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.909198 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.909330 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.909461 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.909589 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.909673 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.909892 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.910027 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.910211 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.910292 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.910541 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.910779 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.910869 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.911115 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.911349 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.911461 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.911543 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.911780 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.911895 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.912096 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.912224 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.912414 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.912545 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.912732 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.912863 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.913050 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.913181 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.913378 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.913564 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.913675 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.913830 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.914009 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.914181 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.914348 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.914530 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.914673 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.914889 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.915012 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.915390 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.915530 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.915644 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.915882 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.915980 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.916088 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.916362 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.916459 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.916706 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.916811 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.917642 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.918078 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.918202 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.918419 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.918419 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.918602 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.918602 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.918871 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.919237 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.919675 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.924175 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.924175 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.924332 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.924417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.924417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.924690 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.924808 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.925163 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.925163 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.925354 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.925464 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.925587 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.925704 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.925858 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.926356 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.926498 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.926631 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.926771 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.926883 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.926997 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.927105 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.927105 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.927354 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.927482 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.927594 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.927721 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.927853 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.927982 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.927982 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.928285 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.928412 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.928412 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.928632 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.928764 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.928909 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.929037 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.929161 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.929271 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.929385 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.929497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.929740 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.929856 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.930448 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.930677 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.930891 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.931106 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.931400 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.931645 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.932009 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.932239 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.932458 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.932685 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.932819 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.933111 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.933298 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.933545 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.933727 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.933873 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.934077 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.934401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.934635 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.934856 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.935062 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.935336 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.935560 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.935755 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.935892 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.936073 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.936201 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.936789 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.936942 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.937088 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.937234 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.937361 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.937492 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.937622 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.937767 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.937900 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.938027 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.938185 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.939062 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.939275 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.939423 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.939557 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.939747 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.939883 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.940073 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.940288 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.940426 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.940576 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.940706 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.940835 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.941005 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.941125 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.941369 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.941472 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.941983 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.942088 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.942184 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.942262 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.942421 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.942529 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.942610 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.942731 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.942879 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.943195 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.943308 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.943483 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.943598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.944001 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.944176 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.944293 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.944393 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.944474 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.944594 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.944673 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.944817 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.944944 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.945068 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.945246 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.945327 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.946135 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.946296 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.946380 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.946532 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.946630 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.946698 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.946698 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.946831 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.946904 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.946965 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.947206 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.947301 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.947542 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.947630 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.947851 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.947931 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.948186 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.948268 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.948500 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.948582 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.948811 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.948895 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.949134 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.949216 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.949450 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.949530 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.949771 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.949850 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.950088 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.950167 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.950406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.950495 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.950731 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.950820 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.951053 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.951164 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.951402 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.957744 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.957896 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.957975 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.958041 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.958471 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.958623 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.958759 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.958893 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.959024 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.959218 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.959390 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.959526 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.959680 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.959833 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.959973 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.960105 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.960297 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.960461 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.960674 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.960883 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.961018 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.961159 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.961293 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.961448 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.961534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.961534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.961644 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.961721 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.961796 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.961856 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.961915 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.961973 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.962040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.962173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.962273 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.962365 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.962439 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.962510 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.962591 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.962661 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.962734 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.962826 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.962911 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.962984 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.963066 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.963159 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.963258 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.963540 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.963698 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.963855 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.964123 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.964245 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.964345 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.964345 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.964619 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.964619 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.964619 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.965075 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.965243 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.965353 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.965434 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.965519 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.965594 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.965667 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.965667 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.965798 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.965903 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.966016 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.966095 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.966216 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.966294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.966380 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.966505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.966607 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.966684 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.966810 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.966939 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.967025 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.967182 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.967279 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.967850 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.967969 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.968050 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.968143 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.968274 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.968405 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.968590 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.968724 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.968856 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.968989 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.969113 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.969192 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.969265 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.969336 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.969408 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.969999 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.970567 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.970703 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.970815 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.970913 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.971038 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.971171 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.971253 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.971314 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.971314 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.971314 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.971646 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.971755 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.971933 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.972044 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.972226 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.972355 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.972532 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.972686 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.972845 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.973029 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.973154 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.973463 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.973625 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.974440 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.974564 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.974636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.974701 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.974809 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.974909 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.974988 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.975060 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.975292 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.975461 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.975547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.975638 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.975716 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.975789 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.975862 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.976082 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.976168 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.976407 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.976503 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.976757 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.976868 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.977065 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.977191 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.977367 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.977523 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.977815 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.977906 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.977987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.978246 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.978447 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.978637 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.978722 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.978852 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.979041 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.979166 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.979413 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.979498 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.979763 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.979860 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.980093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.980396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.980595 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.980769 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.980905 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.981200 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.981362 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.981529 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.981704 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.982032 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.982153 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.982346 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.982686 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.983005 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.983414 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.983535 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.983734 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.983927 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.984069 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.984540 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.984709 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.986175 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.986481 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.986598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.986677 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.986677 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.986677 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.988928 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.989045 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.989166 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.989267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.989364 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.989511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.989659 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.989779 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.990004 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.990004 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.990434 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.990553 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.990662 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.990762 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.990920 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.991023 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.991122 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.991122 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.991435 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.991627 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.991729 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.991729 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.991910 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.992132 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.992342 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.992571 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.992746 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.992921 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.993098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.993293 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.993293 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.993678 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.993857 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.994034 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.994254 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.994440 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.994621 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.994835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.995004 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.995378 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.995584 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.995776 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.995947 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.996114 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.996114 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.996669 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.996873 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.997047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.997047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.997359 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.997524 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.997689 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.997865 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.997865 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.998442 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.999230 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.999230 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.999699 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:58.999872 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.000030 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.000186 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.000358 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.000519 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.000519 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.000988 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.001212 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.001212 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.001508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.001508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.001825 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.001825 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.002222 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.002509 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.002674 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.002853 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.003079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:29:59.003323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.003323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.003323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.003323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.003323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.004083 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.004083 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.004407 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.004586 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.004866 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.005219 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.005555 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.005885 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.006213 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.006536 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.006927 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.009476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.009476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.009476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.009476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.009476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.009476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.009476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.010983 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.010983 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.010983 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.010983 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.010983 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.019959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.019959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.019959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.019959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.019959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.019959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.019959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.019959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.021228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.021228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.021228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.021228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.021228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.021228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.021228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.021228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.022294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.022294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.022294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.022294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.022294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.022294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.022294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.022294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.023417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.023417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.023417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.023417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.023417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.023417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.023417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.023417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.024672 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.024672 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.024672 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.024672 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.024672 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.024672 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.024672 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.024672 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.025806 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.025806 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.025806 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.026363 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.026363 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.026803 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.026803 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.027451 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.027451 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.028143 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.028143 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.028461 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.028887 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.029932 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.029932 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.029932 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.030562 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.030562 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.030925 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.031184 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.031501 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.031845 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.032701 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.033023 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.033359 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.033683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.034018 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.034350 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.034676 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.035094 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.035666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.036345 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.037054 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.037054 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.037589 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.037589 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.037904 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.038251 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.038543 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.038875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.040068 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.040068 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.040068 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.040808 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.040808 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.040808 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.041287 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.041423 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.041747 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.042068 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.042389 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.042792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.043104 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.043414 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.043747 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.044124 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.044440 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.044811 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.045098 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.045434 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.045749 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.046070 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.046514 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.046842 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.047195 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.047540 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.048492 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.048736 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.052711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.052711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.052711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.052711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.052711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.052711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.052711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.052711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.053852 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.053852 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.053852 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.053852 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.053852 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.053852 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.054571 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.054571 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.054901 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.055191 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.055409 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.055732 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.056048 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.056362 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.056682 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.056997 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.057312 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.057625 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.057940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.058256 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.058568 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.058883 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.059323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.059625 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.059988 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.060497 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.060497 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.061071 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.061071 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.061383 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.061697 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.062010 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.062352 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.062695 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.063018 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.063497 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.063826 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.064194 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.064583 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.064939 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.065273 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.065651 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.066016 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.066695 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.067239 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.067767 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.068129 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.068437 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.068822 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.069105 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.069452 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.069896 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.070263 n-d-852085-12 devstack@n-api.service[123539]: INFO dbcounter [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Registered counter for database nova_api Oct 04 20:29:59.071517 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.071517 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.071517 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.071517 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.072127 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.072127 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.072393 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.072521 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.072824 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.073147 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.073476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.073807 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.074167 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.074451 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.074773 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.075104 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.075455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.075795 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.076133 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.076451 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.076786 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.077123 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.077487 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.077814 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.078191 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.078503 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.078828 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.079216 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.079605 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:59.079918 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:29:59.093782 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_db.sqlalchemy.engines [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:59.101756 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writer thread running {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:59.146743 n-d-852085-12 devstack@n-api.service[123540]: INFO dbcounter [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Registered counter for database nova_api Oct 04 20:29:59.166403 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.context [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c6f5a8f-3e7f-4559-98c8-58d2585358de(cell1) {{(pid=123539) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:29:59.168584 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_db.sqlalchemy.engines [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:59.170588 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:29:59.171070 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:29:59.172764 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:29:59.174024 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:29:59.174509 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:29:59.176573 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:29:59.178644 n-d-852085-12 devstack@n-api.service[123539]: INFO dbcounter [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Registered counter for database nova_cell0 Oct 04 20:29:59.179205 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writer thread running {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:59.182893 n-d-852085-12 devstack@n-api.service[123539]: INFO dbcounter [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Registered counter for database nova_cell1 Oct 04 20:29:59.196648 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_db.sqlalchemy.engines [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:59.198126 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_db.sqlalchemy.engines [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:59.206035 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writer thread running {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:59.208315 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writer thread running {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:59.246251 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.context [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c6f5a8f-3e7f-4559-98c8-58d2585358de(cell1) {{(pid=123540) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:29:59.254748 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:29:59.255663 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:29:59.259031 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:29:59.259821 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:29:59.260300 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:29:59.262397 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:29:59.264570 n-d-852085-12 devstack@n-api.service[123540]: INFO dbcounter [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Registered counter for database nova_cell0 Oct 04 20:29:59.269028 n-d-852085-12 devstack@n-api.service[123540]: INFO dbcounter [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Registered counter for database nova_cell1 Oct 04 20:29:59.277235 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_db.sqlalchemy.engines [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:59.281184 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_db.sqlalchemy.engines [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:59.289001 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writer thread running {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:59.290418 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writer thread running {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:59.367316 n-d-852085-12 devstack@n-api.service[123539]: INFO dbcounter [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Registered counter for database nova_cell0 Oct 04 20:29:59.374160 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_db.sqlalchemy.engines [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:59.378932 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writer thread running {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:59.447729 n-d-852085-12 devstack@n-api.service[123540]: INFO dbcounter [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Registered counter for database nova_cell0 Oct 04 20:29:59.455552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_db.sqlalchemy.engines [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:59.463424 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writer thread running {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:59.734387 n-d-852085-12 devstack@n-api.service[123539]: WARNING keystonemiddleware.auth_token [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:29:59.742382 n-d-852085-12 devstack@n-api.service[123539]: WARNING keystonemiddleware.auth_token [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:29:59.826803 n-d-852085-12 devstack@n-api.service[123540]: WARNING keystonemiddleware.auth_token [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:29:59.834931 n-d-852085-12 devstack@n-api.service[123540]: WARNING keystonemiddleware.auth_token [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:30:00.099829 n-d-852085-12 devstack@n-api.service[123539]: WARNING keystonemiddleware.auth_token [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:30:00.104485 n-d-852085-12 devstack@n-api.service[123539]: WARNING keystonemiddleware.auth_token [None req-4ee290d5-6ef5-451e-a2c0-a5efb1295c36 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:30:00.109886 n-d-852085-12 devstack@n-api.service[123539]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632f630e9c0 pid: 123539 (default app) Oct 04 20:30:00.183445 n-d-852085-12 devstack@n-api.service[123540]: WARNING keystonemiddleware.auth_token [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:30:00.189656 n-d-852085-12 devstack@n-api.service[123540]: WARNING keystonemiddleware.auth_token [None req-988d3465-ab11-4862-9df2-83846f7fca2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:30:00.195163 n-d-852085-12 devstack@n-api.service[123540]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632f630e9c0 pid: 123540 (default app) Oct 04 20:30:54.999569 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:55.004009 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:55.005558 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:55.007757 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:56.256338 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=3 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:56.261746 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=3 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:56.262155 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=3 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:56.267947 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=3 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:57.922738 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3376ee82-cc45-4468-a5e7-d8c426975713 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1987440683", "id": 1601367984, "os-flavor-access:is_public": "False"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:58.064067 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3376ee82-cc45-4468-a5e7-d8c426975713 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 3.083490 Oct 04 20:30:58.065523 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:54 2022] POST /compute/v2.1/flavors => generated 431 bytes in 3088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:30:58.140058 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ed7927a8-67f0-424c-a05e-b3129bd0394a tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-782410931", "id": 1186538619, "os-flavor-access:is_public": "True"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:58.283630 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a5a14995-526d-4919-a154-bebf8f1a2f69 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:58.289872 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5a14995-526d-4919-a154-bebf8f1a2f69 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:58.290726 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5a14995-526d-4919-a154-bebf8f1a2f69 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:58.291760 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5a14995-526d-4919-a154-bebf8f1a2f69 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:58.293721 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ed7927a8-67f0-424c-a05e-b3129bd0394a tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 2.057472 Oct 04 20:30:58.294227 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5a14995-526d-4919-a154-bebf8f1a2f69 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:58.307752 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1/2] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:56 2022] POST /compute/v2.1/flavors => generated 429 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:30:58.309734 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5a14995-526d-4919-a154-bebf8f1a2f69 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:58.309734 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5a14995-526d-4919-a154-bebf8f1a2f69 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:58.395498 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b3ba530a-0be5-4024-bbac-5c681256e96b tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Calling method '.version_select at 0x7f77f4b47d30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:58.409276 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a5a14995-526d-4919-a154-bebf8f1a2f69 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.341452 Oct 04 20:30:58.410662 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 2/3] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 4 20:30:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:58.436923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b3ba530a-0be5-4024-bbac-5c681256e96b tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c6f5a8f-3e7f-4559-98c8-58d2585358de(cell1) {{(pid=123540) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 20:30:58.437812 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3ba530a-0be5-4024-bbac-5c681256e96b tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:58.438478 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3ba530a-0be5-4024-bbac-5c681256e96b tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:58.438919 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3ba530a-0be5-4024-bbac-5c681256e96b tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:58.486598 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3ba530a-0be5-4024-bbac-5c681256e96b tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:58.487779 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3ba530a-0be5-4024-bbac-5c681256e96b tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:58.488499 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3ba530a-0be5-4024-bbac-5c681256e96b tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:58.513259 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1480803253", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:58.517726 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3ba530a-0be5-4024-bbac-5c681256e96b tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:58.518718 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3ba530a-0be5-4024-bbac-5c681256e96b tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:58.519662 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3ba530a-0be5-4024-bbac-5c681256e96b tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:58.533807 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b3ba530a-0be5-4024-bbac-5c681256e96b tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.236971 Oct 04 20:30:58.544557 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 2/4] 10.222.0.78 () {60 vars in 1208 bytes} [Tue Oct 4 20:30:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:30:58.654522 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4b1cb1ef-c387-4bce-b65e-2a5259da8f80 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '.version_select at 0x7f77f4ace430>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:58.659500 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b1cb1ef-c387-4bce-b65e-2a5259da8f80 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:58.660564 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b1cb1ef-c387-4bce-b65e-2a5259da8f80 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:58.661296 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b1cb1ef-c387-4bce-b65e-2a5259da8f80 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:58.712108 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b1cb1ef-c387-4bce-b65e-2a5259da8f80 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:58.713359 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b1cb1ef-c387-4bce-b65e-2a5259da8f80 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:58.714382 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b1cb1ef-c387-4bce-b65e-2a5259da8f80 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:58.753851 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b1cb1ef-c387-4bce-b65e-2a5259da8f80 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:58.754930 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b1cb1ef-c387-4bce-b65e-2a5259da8f80 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:58.755867 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b1cb1ef-c387-4bce-b65e-2a5259da8f80 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:58.769212 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4b1cb1ef-c387-4bce-b65e-2a5259da8f80 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.231656 Oct 04 20:30:58.788239 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 3/5] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 4 20:30:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:58.983694 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1e0604c5-d786-471d-a7c7-49057ca9e18b tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:58.987917 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e0604c5-d786-471d-a7c7-49057ca9e18b tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:58.991354 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e0604c5-d786-471d-a7c7-49057ca9e18b tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:58.994913 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e0604c5-d786-471d-a7c7-49057ca9e18b tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:58.997732 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e0604c5-d786-471d-a7c7-49057ca9e18b tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:58.999630 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e0604c5-d786-471d-a7c7-49057ca9e18b tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:59.002261 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e0604c5-d786-471d-a7c7-49057ca9e18b tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:59.110131 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1e0604c5-d786-471d-a7c7-49057ca9e18b tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.319494 Oct 04 20:30:59.127343 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 4/6] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Oct 4 20:30:58 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:30:59.129721 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:30:59.139903 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3afaa9a9-ceb3-464d-9782-b2fcdaccd166 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0c5ff597f7974cb7b0ca20b154fdba8c"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:59.492668 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3afaa9a9-ceb3-464d-9782-b2fcdaccd166 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1601367984/action" status: 200 len: 97 microversion: 2.1 time: 0.346414 Oct 04 20:30:59.492668 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 5/7] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Oct 4 20:30:59 2022] POST /compute/v2.1/flavors/1601367984/action => generated 97 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:30:59.492668 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-723bc789-5a1e-448d-b2b7-521211aa6c4e tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:59.643612 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-723bc789-5a1e-448d-b2b7-521211aa6c4e tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1186538619" status: 202 len: 0 microversion: 2.1 time: 0.164703 Oct 04 20:30:59.644547 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 6/8] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 4 20:30:59 2022] DELETE /compute/v2.1/flavors/1186538619 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:30:59.651748 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4da3f278-2872-4687-b2e3-8b798a3136a7 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1845217770"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:59.656597 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.aggregate [None req-4da3f278-2872-4687-b2e3-8b798a3136a7 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Generated uuid 1678855a-2757-4283-b8c9-73e3b7257920 for aggregate {{(pid=123540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:30:59.840294 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:30:59.841275 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:30:59.842215 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:30:59.842963 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:30:59.843755 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:30:59.865059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:59.865553 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:59.871225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:59.871225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:59.871225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:59.871225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:59.918792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Getting quotas for project 13bcdec8c8d64e97b49281a0e16b0d79. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:30:59.932128 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Getting quotas for user c0986e6de5204c4d86e24184039366e0 and project 13bcdec8c8d64e97b49281a0e16b0d79. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:30:59.962765 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:30:59.970502 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:30:59.977889 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4da3f278-2872-4687-b2e3-8b798a3136a7 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.331398 Oct 04 20:30:59.990004 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 7/9] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:30:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:59.998585 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ce6a0da3-6bec-4e8a-bbbb-a435106e3893 tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:00.002573 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ce6a0da3-6bec-4e8a-bbbb-a435106e3893 tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:00.003470 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ce6a0da3-6bec-4e8a-bbbb-a435106e3893 tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:00.004249 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ce6a0da3-6bec-4e8a-bbbb-a435106e3893 tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:00.005619 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ce6a0da3-6bec-4e8a-bbbb-a435106e3893 tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:00.006476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ce6a0da3-6bec-4e8a-bbbb-a435106e3893 tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:00.007319 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ce6a0da3-6bec-4e8a-bbbb-a435106e3893 tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:00.053164 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ce6a0da3-6bec-4e8a-bbbb-a435106e3893 tempest-AZAdminV2TestJSON-544355353 tempest-AZAdminV2TestJSON-544355353-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.061125 Oct 04 20:31:00.054279 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 8/10] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 4 20:30:59 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:00.349830 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d0538adb-960e-49dd-9737-ad8544d72c4d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.937172 Oct 04 20:31:00.351859 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 3/11] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:31:00.360163 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-407df14c-6fdb-46d3-ad7d-5d8bd3ce2f76 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:00.416276 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-407df14c-6fdb-46d3-ad7d-5d8bd3ce2f76 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062038 Oct 04 20:31:00.417565 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 4/12] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:00.443791 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ab8fc3ee-1867-42b6-8ec2-ee81ce2dc01b tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852085-12"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:00.467863 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f0056a9f-1b26-4d8e-99a1-bb477b91140a tempest-FlavorsAccessTestJSON-450798049 tempest-FlavorsAccessTestJSON-450798049-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:00.507068 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ab8fc3ee-1867-42b6-8ec2-ee81ce2dc01b tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:00.507734 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ab8fc3ee-1867-42b6-8ec2-ee81ce2dc01b tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:00.508178 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ab8fc3ee-1867-42b6-8ec2-ee81ce2dc01b tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:00.532114 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f0056a9f-1b26-4d8e-99a1-bb477b91140a tempest-FlavorsAccessTestJSON-450798049 tempest-FlavorsAccessTestJSON-450798049-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.475657 Oct 04 20:31:00.534743 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 9/13] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:00 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:00.544599 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f78fd83a-f363-4086-97be-2cc654a3b449 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:00.546762 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f78fd83a-f363-4086-97be-2cc654a3b449 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:02.068550 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ab8fc3ee-1867-42b6-8ec2-ee81ce2dc01b tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 243 microversion: 2.1 time: 1.649137 Oct 04 20:31:02.069985 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 5/14] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 4 20:31:00 2022] POST /compute/v2.1/os-aggregates/1/action => generated 243 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:02.078148 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b521c441-dd7b-40f5-845a-93aec16a8ca0 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-58154248", "id": 25246155, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:02.123809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f78fd83a-f363-4086-97be-2cc654a3b449 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:02.154814 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f78fd83a-f363-4086-97be-2cc654a3b449 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1220 microversion: 2.1 time: 1.617600 Oct 04 20:31:02.156071 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 10/15] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:00 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1220 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:02.166170 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-552c960e-4af6-4a7b-8b48-c338e35dcfd3 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0c5ff597f7974cb7b0ca20b154fdba8c"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:02.361385 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b521c441-dd7b-40f5-845a-93aec16a8ca0 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.281395 Oct 04 20:31:02.375449 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 6/16] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:02.387615 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-043d620f-adee-46f3-a606-b4e3e5a32347 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852085-12"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:02.418646 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-043d620f-adee-46f3-a606-b4e3e5a32347 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:02.420496 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-043d620f-adee-46f3-a606-b4e3e5a32347 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:02.421697 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-043d620f-adee-46f3-a606-b4e3e5a32347 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:02.515222 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-043d620f-adee-46f3-a606-b4e3e5a32347 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-852085-12. Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-043d620f-adee-46f3-a606-b4e3e5a32347 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Request method failure captured: Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 40 Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgAmJyE4m9DQPG2iunY9YVIyue6gS1OKIJPuEzNOxiMCiMOXtcPHuHmWtLQDZb_vWBsM58RalEsHfWIT8GowCD44ZmeluHPpB82ixi-hd_KWr0GIe0l_oKWRpd4Cx7vaAzwuhasrR86gnQTY2q5NH1FAgPFEBhgdu5oFZaeMxD1G2w Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:02.549330 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cb8231cbd10e4f4ea7eb62bf99dd0791", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}] Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: fa6f52cb0cd643e98535ba532fe2c384 Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: {"add_host": {"host": "n-h1-852085-12"}} Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:02.552205 n-d-852085-12 devstack@n-api.service[123539]: exception: Aggregate 1 already has host n-h1-852085-12. Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-852085-12'}}} Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:31:02.553495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-852085-12-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:31:02.556427 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:31:02.561639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:31:02.565701 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-852085-12-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 20, 31, 2, 454463), 'updated_at': None, 'host': 'n-h1-852085-12', 'aggregate_id': 1}] Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:02.569687 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-852085-12. Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:02.573329 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-852085-12. Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:02.578032 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:02.585184 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-852085-12. Oct 04 20:31:02.585184 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:02.585184 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-043d620f-adee-46f3-a606-b4e3e5a32347 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-852085-12. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:02.585880 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-552c960e-4af6-4a7b-8b48-c338e35dcfd3 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1601367984/action" status: 200 len: 21 microversion: 2.1 time: 0.393906 Oct 04 20:31:02.586113 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-043d620f-adee-46f3-a606-b4e3e5a32347 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.186555 Oct 04 20:31:02.586113 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 7/17] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 4 20:31:02 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 04 20:31:02.587589 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 11/18] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Oct 4 20:31:02 2022] POST /compute/v2.1/flavors/1601367984/action => generated 21 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:02.591582 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0b6fcd6b-8670-413d-845f-643646af0b7c tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852085-12"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:02.593810 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-73be1872-ea56-4d0d-b1f6-9c18b2e36b94 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:02.627777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0b6fcd6b-8670-413d-845f-643646af0b7c tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:02.629389 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0b6fcd6b-8670-413d-845f-643646af0b7c tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:02.630207 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0b6fcd6b-8670-413d-845f-643646af0b7c tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:02.639861 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-73be1872-ea56-4d0d-b1f6-9c18b2e36b94 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5390 microversion: 2.1 time: 0.082593 Oct 04 20:31:02.641519 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 8/19] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:02 2022] GET /compute/v2.1/flavors/detail => generated 5390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:02.651014 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-79f7a791-45ce-466c-b144-a0f8234168d3 tempest-FlavorsAccessTestJSON-450798049 tempest-FlavorsAccessTestJSON-450798049-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:02.735369 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-79f7a791-45ce-466c-b144-a0f8234168d3 tempest-FlavorsAccessTestJSON-450798049 tempest-FlavorsAccessTestJSON-450798049-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5390 microversion: 2.1 time: 0.090962 Oct 04 20:31:02.737665 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 9/20] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:02 2022] GET /compute/v2.1/flavors/detail => generated 5390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:02.755777 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-72154bda-8c94-457a-9127-43394fc21ca3 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:02.895974 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-72154bda-8c94-457a-9127-43394fc21ca3 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/25246155" status: 202 len: 0 microversion: 2.1 time: 0.156419 Oct 04 20:31:02.896938 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 10/21] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:02 2022] DELETE /compute/v2.1/flavors/25246155 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:02.913450 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a7fc0090-5ad0-47ac-9b8a-79eaed7ff13b tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:03.074683 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a7fc0090-5ad0-47ac-9b8a-79eaed7ff13b tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1601367984" status: 202 len: 0 microversion: 2.1 time: 0.176072 Oct 04 20:31:03.083679 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 11/22] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 4 20:31:02 2022] DELETE /compute/v2.1/flavors/1601367984 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:03.092850 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f060109d-2971-4d47-9384-ba7a8f76a2ab tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:03.128766 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f060109d-2971-4d47-9384-ba7a8f76a2ab tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049293 Oct 04 20:31:03.129904 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 12/23] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:03.138269 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-069c3634-a0af-4ae0-927f-266aaadfcf15 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:03.173547 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-069c3634-a0af-4ae0-927f-266aaadfcf15 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041387 Oct 04 20:31:03.175469 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 13/24] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:03.182091 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5e345570-92e9-49e8-b8d1-4c483c44d690 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-735513035", "id": 546459356, "os-flavor-access:is_public": "True"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:03.355298 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5e345570-92e9-49e8-b8d1-4c483c44d690 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.177712 Oct 04 20:31:03.356087 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 14/25] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:03 2022] POST /compute/v2.1/flavors => generated 425 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:03.374426 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7a4f9cf0-5db3-4e02-aeb4-7a7a7f2060da tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:03.375911 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7a4f9cf0-5db3-4e02-aeb4-7a7a7f2060da tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:03.489263 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0b6fcd6b-8670-413d-845f-643646af0b7c tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.918946 Oct 04 20:31:03.491253 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 12/26] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 4 20:31:02 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:03.505035 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4d6761c8-9c06-4fd4-9be0-edc135e18a9e tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-858266198", "id": 1970185346, "os-flavor-access:is_public": "False"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:03.575426 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7a4f9cf0-5db3-4e02-aeb4-7a7a7f2060da tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:03.612902 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7a4f9cf0-5db3-4e02-aeb4-7a7a7f2060da tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1220 microversion: 2.1 time: 0.254803 Oct 04 20:31:03.630552 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 15/27] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:03 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1220 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:03.656946 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-374b2376-d093-4d8f-b552-768fefbbb046 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:03.702589 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4d6761c8-9c06-4fd4-9be0-edc135e18a9e tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.208858 Oct 04 20:31:03.705357 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 13/28] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:03 2022] POST /compute/v2.1/flavors => generated 430 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:03.733883 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-57d23c58-68f4-488a-bd6a-5a09908b5cfb tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:03.821231 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-374b2376-d093-4d8f-b552-768fefbbb046 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/546459356" status: 202 len: 0 microversion: 2.1 time: 0.188184 Oct 04 20:31:03.822331 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 16/29] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:03 2022] DELETE /compute/v2.1/flavors/546459356 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:03.828793 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-acf06dd8-aa61-4351-9353-165fa816c0aa tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:03.877821 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-57d23c58-68f4-488a-bd6a-5a09908b5cfb tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.168606 Oct 04 20:31:03.879826 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 14/30] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:03 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:03.896237 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d8adb447-c467-4817-8e85-7a2b232d2d91 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:03.902445 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-acf06dd8-aa61-4351-9353-165fa816c0aa tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/1970185346/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.075990 Oct 04 20:31:03.907333 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 17/31] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 4 20:31:03 2022] GET /compute/v2.1/flavors/1970185346/os-flavor-access => generated 21 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:03.930553 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e4dc67c1-00de-4b43-b9cf-a0731704ee17 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-611787771"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:03.949256 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.aggregate [None req-e4dc67c1-00de-4b43-b9cf-a0731704ee17 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Generated uuid 7362d31d-159d-4091-b689-9a4ea26b5a26 for aggregate {{(pid=123539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:03.991566 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d8adb447-c467-4817-8e85-7a2b232d2d91 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.108865 Oct 04 20:31:03.992555 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 15/32] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:04.025895 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1629876f-4fd7-4fd6-b3d6-773d8310ed87 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:04.112136 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e4dc67c1-00de-4b43-b9cf-a0731704ee17 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.202172 Oct 04 20:31:04.116156 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 18/33] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:03 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:04.125914 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-be414355-1c2e-40a9-ba42-efaac6f7f715 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1249046981"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:04.132094 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.aggregate [None req-be414355-1c2e-40a9-ba42-efaac6f7f715 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Generated uuid 80e9322a-4b62-42d2-b5dc-b0911b7005f7 for aggregate {{(pid=123539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:04.169102 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1629876f-4fd7-4fd6-b3d6-773d8310ed87 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1970185346" status: 202 len: 0 microversion: 2.1 time: 0.168209 Oct 04 20:31:04.173874 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 16/34] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 4 20:31:03 2022] DELETE /compute/v2.1/flavors/1970185346 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:04.180504 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a7b16db2-9d41-43d0-863c-9fd27b0cc61c tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-87423176", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:04.305971 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-be414355-1c2e-40a9-ba42-efaac6f7f715 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.187318 Oct 04 20:31:04.306914 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 19/35] 10.222.0.78 () {62 vars in 1205 bytes} [Tue Oct 4 20:31:04 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:04.337868 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a7b16db2-9d41-43d0-863c-9fd27b0cc61c tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.161797 Oct 04 20:31:04.339437 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 17/36] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:04 2022] POST /compute/v2.1/flavors => generated 505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:04.350380 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-788225e0-d8cb-481f-afaa-65ad6c07c0ca tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:04.393299 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-788225e0-d8cb-481f-afaa-65ad6c07c0ca tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5486 microversion: 2.1 time: 0.052066 Oct 04 20:31:04.394249 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 18/37] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:04 2022] GET /compute/v2.1/flavors/detail => generated 5486 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:04.402441 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-098499e5-17db-4473-8c72-ae46fb9add08 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1366966141"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:04.630811 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-098499e5-17db-4473-8c72-ae46fb9add08 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.234660 Oct 04 20:31:04.646073 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 19/38] 10.222.0.78 () {62 vars in 1210 bytes} [Tue Oct 4 20:31:04 2022] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:04.646662 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ae71bb3a-76e9-41ac-ac7d-19bcd29952b5 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:04.889729 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ae71bb3a-76e9-41ac-ac7d-19bcd29952b5 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/3e6a9d37-72af-4158-af9a-4ec6e0210306" status: 202 len: 0 microversion: 2.1 time: 0.251600 Oct 04 20:31:04.890740 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 20/39] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:31:04 2022] DELETE /compute/v2.1/flavors/3e6a9d37-72af-4158-af9a-4ec6e0210306 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:04.897766 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bd603704-4ea5-47ac-9ed8-70d3e2ab4054 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:04.921737 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ff8ce565-b4c9-4f57-b325-299ef9315e63 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852085-12"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:04.922907 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bd603704-4ea5-47ac-9ed8-70d3e2ab4054 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.030195 Oct 04 20:31:04.923757 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 4 20:31:04 2022] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:04.929153 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5b1dcce6-a671-4c5a-90f3-363d83f43fc9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:04.934093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-5b1dcce6-a671-4c5a-90f3-363d83f43fc9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:04.940638 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:DELETE=13,nova_api:UPDATE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:04.951702 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ff8ce565-b4c9-4f57-b325-299ef9315e63 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '2a7aaeb417c04b7085a6e752268963c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a6c60df0b14717bf52f10dbe8d68c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ff8ce565-b4c9-4f57-b325-299ef9315e63 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Request method failure captured: Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 40 Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJf649nv-tbYxgR4zV87jnq_6GGcpVUbENA3U1lTf0_n2fUBGe1E4NwZidPBeEXTx4VpwMyS-aS97oWKEalLYNHG98wtcTt2o2J5gfM25h30aqnOrqW0RFtJ5nwfdpaB4qaxRu6_6rPqRLI3WED4xk4tT-GZVw6EdsNEyCCPw-E-u9A Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 43a6c60df0b14717bf52f10dbe8d68c2 Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:31:04.952680 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_43a6c60df0b14717bf52f10dbe8d68c2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43a6c60df0b14717bf52f10dbe8d68c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43a6c60df0b14717bf52f10dbe8d68c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/43a6c60df0b14717bf52f10dbe8d68c2"}]}] Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 43a6c60df0b14717bf52f10dbe8d68c2 Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-AggregatesAdminNegativeTestJSON-119113897-project Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 2a7aaeb417c04b7085a6e752268963c8 Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119113897-project Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: {"add_host": {"host": "n-h1-852085-12"}} Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:04.954849 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-852085-12'}}} Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:04.956282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 20:31:04.958341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:04.961081 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5b1dcce6-a671-4c5a-90f3-363d83f43fc9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:04.961081 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5b1dcce6-a671-4c5a-90f3-363d83f43fc9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:04.961081 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5b1dcce6-a671-4c5a-90f3-363d83f43fc9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:04.963371 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5b1dcce6-a671-4c5a-90f3-363d83f43fc9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:04.964103 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5b1dcce6-a671-4c5a-90f3-363d83f43fc9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:04.964619 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5b1dcce6-a671-4c5a-90f3-363d83f43fc9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:04.964923 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ff8ce565-b4c9-4f57-b325-299ef9315e63 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:04.966881 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ff8ce565-b4c9-4f57-b325-299ef9315e63 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.658209 Oct 04 20:31:04.968715 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 4 20:31:04 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 661 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:04.981132 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-02eb7f61-6fae-4ca0-8756-c09355de4615 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:05.037617 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-02eb7f61-6fae-4ca0-8756-c09355de4615 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066195 Oct 04 20:31:05.040001 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 21/42] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:05.078619 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-14f1c8b2-5c5d-410d-b501-d27c6ed445d2 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852085-12"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:05.113480 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14f1c8b2-5c5d-410d-b501-d27c6ed445d2 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:05.115585 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14f1c8b2-5c5d-410d-b501-d27c6ed445d2 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:05.130339 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14f1c8b2-5c5d-410d-b501-d27c6ed445d2 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:05.164239 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10,nova_api:DELETE=9 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:05.444411 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-5b1dcce6-a671-4c5a-90f3-363d83f43fc9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:05.506610 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5b1dcce6-a671-4c5a-90f3-363d83f43fc9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1224 microversion: 2.1 time: 0.581472 Oct 04 20:31:05.507904 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 22/43] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:04 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1224 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:05.514232 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-443e3ef1-46d9-48a8-bbd7-82176df8d2cb tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:05.718642 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-443e3ef1-46d9-48a8-bbd7-82176df8d2cb tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.209044 Oct 04 20:31:05.740991 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-14f1c8b2-5c5d-410d-b501-d27c6ed445d2 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.41 time: 0.698318 Oct 04 20:31:05.753839 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 22/44] 10.222.0.78 () {62 vars in 1232 bytes} [Tue Oct 4 20:31:05 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:05.754705 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 23/45] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:05 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:05.794042 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-937948bc-ab4d-4cdf-b53c-8fc19035da43 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1797840258"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:05.803813 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-95690172-5e2b-48b5-8005-fae7564b7dce tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-460776256", "id": "d7a8b5bd-e3e6-416a-8401-fe6157282794", "os-flavor-access:is_public": "True"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:05.815270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.aggregate [None req-937948bc-ab4d-4cdf-b53c-8fc19035da43 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Generated uuid edc22c3b-3527-4185-abb7-ff54703fb5fd for aggregate {{(pid=123539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:05.997427 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-95690172-5e2b-48b5-8005-fae7564b7dce tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.231408 Oct 04 20:31:06.009414 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:05 2022] POST /compute/v2.1/flavors => generated 506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:06.020013 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bc14d1f8-2c07-4843-bd0c-57b18fb11d16 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852085-12"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:06.049729 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-937948bc-ab4d-4cdf-b53c-8fc19035da43 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.288109 Oct 04 20:31:06.050553 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:06.057905 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc14d1f8-2c07-4843-bd0c-57b18fb11d16 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:06.061837 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc14d1f8-2c07-4843-bd0c-57b18fb11d16 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:06.064196 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc14d1f8-2c07-4843-bd0c-57b18fb11d16 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:06.094140 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-25266f37-cefa-4676-88c8-4a13cff59f9b tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:06.274348 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-25266f37-cefa-4676-88c8-4a13cff59f9b tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/d7a8b5bd-e3e6-416a-8401-fe6157282794" status: 202 len: 0 microversion: 2.1 time: 0.210370 Oct 04 20:31:06.274348 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 24/48] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:31:06 2022] DELETE /compute/v2.1/flavors/d7a8b5bd-e3e6-416a-8401-fe6157282794 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:06.278387 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2bce7bc9-d34e-4b48-952b-fbcd32759ca2 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-151420334"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:06.341752 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2bce7bc9-d34e-4b48-952b-fbcd32759ca2 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c6f5a8f-3e7f-4559-98c8-58d2585358de(cell1) {{(pid=123539) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 20:31:06.342808 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2bce7bc9-d34e-4b48-952b-fbcd32759ca2 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:06.346331 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2bce7bc9-d34e-4b48-952b-fbcd32759ca2 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:06.348651 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2bce7bc9-d34e-4b48-952b-fbcd32759ca2 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:06.374822 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2bce7bc9-d34e-4b48-952b-fbcd32759ca2 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:06.375375 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2bce7bc9-d34e-4b48-952b-fbcd32759ca2 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:06.375821 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2bce7bc9-d34e-4b48-952b-fbcd32759ca2 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:06.402332 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-2bce7bc9-d34e-4b48-952b-fbcd32759ca2 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-151420334 could not be found. Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2bce7bc9-d34e-4b48-952b-fbcd32759ca2 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Request method failure captured: Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 57 Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgAmJyE4m9DQPG2iunY9YVIyue6gS1OKIJPuEzNOxiMCiMOXtcPHuHmWtLQDZb_vWBsM58RalEsHfWIT8GowCD44ZmeluHPpB82ixi-hd_KWr0GIe0l_oKWRpd4Cx7vaAzwuhasrR86gnQTY2q5NH1FAgPFEBhgdu5oFZaeMxD1G2w Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:06.406381 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cb8231cbd10e4f4ea7eb62bf99dd0791", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}] Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: fa6f52cb0cd643e98535ba532fe2c384 Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: {"add_host": {"host": "tempest-nonexist_host-151420334"}} Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:06.408007 n-d-852085-12 devstack@n-api.service[123539]: exception: Compute host tempest-nonexist_host-151420334 could not be found. Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-151420334'}}} Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-151420334' is not mapped to any cell Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:06.408833 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 04 20:31:06.410028 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-151420334 could not be found. Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-151420334 could not be found. Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:06.411296 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:06.412924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:06.412924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:06.412924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:06.412924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:06.412924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:06.412924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-151420334 could not be found. Oct 04 20:31:06.412924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:06.414722 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2bce7bc9-d34e-4b48-952b-fbcd32759ca2 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-151420334 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:06.416153 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2bce7bc9-d34e-4b48-952b-fbcd32759ca2 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.144732 Oct 04 20:31:06.421661 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 25/49] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 4 20:31:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:06.430022 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ee60a9eb-a0cc-471b-9253-1f7d035a2434 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:06.496770 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ee60a9eb-a0cc-471b-9253-1f7d035a2434 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070879 Oct 04 20:31:06.497735 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 26/50] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:06.536141 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-222e94a9-741f-4c26-8e09-4152590d224c tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:06.715087 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-222e94a9-741f-4c26-8e09-4152590d224c tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.205942 Oct 04 20:31:06.722490 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bc14d1f8-2c07-4843-bd0c-57b18fb11d16 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.709559 Oct 04 20:31:06.725559 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 27/51] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:06 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:06.731703 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 25/52] 10.222.0.78 () {62 vars in 1232 bytes} [Tue Oct 4 20:31:06 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:06.759114 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9a6c5882-ed08-444e-888c-8a51ab53c153 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-931898272", "id": 297150800, "os-flavor-access:is_public": "True"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:06.777942 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3bb454f4-df08-4a79-8644-84f51195137d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:06.800948 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3bb454f4-df08-4a79-8644-84f51195137d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:06.836188 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3bb454f4-df08-4a79-8644-84f51195137d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:06.837622 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3bb454f4-df08-4a79-8644-84f51195137d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:06.838674 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3bb454f4-df08-4a79-8644-84f51195137d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:06.840592 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3bb454f4-df08-4a79-8644-84f51195137d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:06.841844 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3bb454f4-df08-4a79-8644-84f51195137d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:06.842897 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3bb454f4-df08-4a79-8644-84f51195137d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:06.989762 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9a6c5882-ed08-444e-888c-8a51ab53c153 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.238443 Oct 04 20:31:06.992419 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 28/53] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:06 2022] POST /compute/v2.1/flavors => generated 410 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:07.014382 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-36c9f101-cc98-4698-b444-0f1dd5f2e3a2 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:07.076529 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3bb454f4-df08-4a79-8644-84f51195137d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:07.139705 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-36c9f101-cc98-4698-b444-0f1dd5f2e3a2 tempest-AggregatesAdminTestV241-1982721723 tempest-AggregatesAdminTestV241-1982721723-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.144809 Oct 04 20:31:07.140369 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 29/54] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 4 20:31:06 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:07.147934 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3bb454f4-df08-4a79-8644-84f51195137d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1272 microversion: 2.1 time: 0.401195 Oct 04 20:31:07.160156 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 26/55] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:06 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1272 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:07.166794 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-060c81c2-19e9-4edf-98f4-69cb91e5a694 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:07.178101 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6a37ad59-0375-4d9a-a625-7f6027817569 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-060c81c2-19e9-4edf-98f4-69cb91e5a694 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Request method failure captured: Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 283 Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgAmJyE4m9DQPG2iunY9YVIyue6gS1OKIJPuEzNOxiMCiMOXtcPHuHmWtLQDZb_vWBsM58RalEsHfWIT8GowCD44ZmeluHPpB82ixi-hd_KWr0GIe0l_oKWRpd4Cx7vaAzwuhasrR86gnQTY2q5NH1FAgPFEBhgdu5oFZaeMxD1G2w Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:07.184265 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:07.188620 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cb8231cbd10e4f4ea7eb62bf99dd0791", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}] Oct 04 20:31:07.188620 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:07.188620 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:07.188620 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:07.188620 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:07.188620 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:07.188620 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:07.188620 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: fa6f52cb0cd643e98535ba532fe2c384 Oct 04 20:31:07.188620 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:07.188620 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:07.190218 n-d-852085-12 devstack@n-api.service[123539]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 20:31:07.190218 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:07.190218 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:31:07.190218 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 20:31:07.190218 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:07.190218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:07.190218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:31:07.190218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:31:07.190218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:31:07.190218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:07.191685 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:07.195894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:07.200799 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:31:07.200799 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:31:07.200799 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:31:07.200799 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.200799 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-060c81c2-19e9-4edf-98f4-69cb91e5a694 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:07.208206 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-060c81c2-19e9-4edf-98f4-69cb91e5a694 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.047602 Oct 04 20:31:07.208206 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 30/56] 10.222.0.78 () {60 vars in 1165 bytes} [Tue Oct 4 20:31:07 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:31:07.208206 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-49513350-508a-473a-9ccb-912d4c8e2633 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-253036341", "name": "tempest-test_aggregate-768818692"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:07.224754 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6a37ad59-0375-4d9a-a625-7f6027817569 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/297150800" status: 200 len: 410 microversion: 2.1 time: 0.068642 Oct 04 20:31:07.228771 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 27/57] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:07 2022] GET /compute/v2.1/flavors/297150800 => generated 410 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:07.239482 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.aggregate [None req-49513350-508a-473a-9ccb-912d4c8e2633 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Generated uuid c45d80c0-112c-4f22-9321-f2549fd925dc for aggregate {{(pid=123539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:07.245192 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0885d94b-09b4-4d76-85d6-d4e680797fad tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0885d94b-09b4-4d76-85d6-d4e680797fad tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Request method failure captured: Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 27 Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgAmJyE4m9DQPG2iunY9YVIyue6gS1OKIJPuEzNOxiMCiMOXtcPHuHmWtLQDZb_vWBsM58RalEsHfWIT8GowCD44ZmeluHPpB82ixi-hd_KWr0GIe0l_oKWRpd4Cx7vaAzwuhasrR86gnQTY2q5NH1FAgPFEBhgdu5oFZaeMxD1G2w Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:31:07.273555 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cb8231cbd10e4f4ea7eb62bf99dd0791", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}] Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: fa6f52cb0cd643e98535ba532fe2c384 Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: {"aggregate": {"name": ""}} Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:07.276137 n-d-852085-12 devstack@n-api.service[123540]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi '' Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:07.277448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:31:07.284537 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.290164 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0885d94b-09b4-4d76-85d6-d4e680797fad tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:07.290164 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0885d94b-09b4-4d76-85d6-d4e680797fad tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.038063 Oct 04 20:31:07.292071 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 28/58] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:07 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:31:07.354928 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-49513350-508a-473a-9ccb-912d4c8e2633 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.159027 Oct 04 20:31:07.359743 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 31/59] 10.222.0.78 () {60 vars in 1165 bytes} [Tue Oct 4 20:31:07 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:07.452491 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e080489f-2c9a-4f35-90ac-e7efe1dfc1d0 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1582554869"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:07.461954 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e080489f-2c9a-4f35-90ac-e7efe1dfc1d0 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '2a7aaeb417c04b7085a6e752268963c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a6c60df0b14717bf52f10dbe8d68c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e080489f-2c9a-4f35-90ac-e7efe1dfc1d0 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Request method failure captured: Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 60 Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJf649nv-tbYxgR4zV87jnq_6GGcpVUbENA3U1lTf0_n2fUBGe1E4NwZidPBeEXTx4VpwMyS-aS97oWKEalLYNHG98wtcTt2o2J5gfM25h30aqnOrqW0RFtJ5nwfdpaB4qaxRu6_6rPqRLI3WED4xk4tT-GZVw6EdsNEyCCPw-E-u9A Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 43a6c60df0b14717bf52f10dbe8d68c2 Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:31:07.471038 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_43a6c60df0b14717bf52f10dbe8d68c2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43a6c60df0b14717bf52f10dbe8d68c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43a6c60df0b14717bf52f10dbe8d68c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/43a6c60df0b14717bf52f10dbe8d68c2"}]}] Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 43a6c60df0b14717bf52f10dbe8d68c2 Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-AggregatesAdminNegativeTestJSON-119113897-project Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 2a7aaeb417c04b7085a6e752268963c8 Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119113897-project Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: {"aggregate": {"name": "tempest-test_aggregate-1582554869"}} Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:07.473594 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1582554869'}}} Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:07.475272 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:07.477409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 20:31:07.480819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:07.485007 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e080489f-2c9a-4f35-90ac-e7efe1dfc1d0 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:07.487048 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e080489f-2c9a-4f35-90ac-e7efe1dfc1d0 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.122543 Oct 04 20:31:07.489215 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 32/60] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:07 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 128 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:07.505080 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2ddb7cb3-eebe-44ad-a062-5958637befc4 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:07.551795 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2ddb7cb3-eebe-44ad-a062-5958637befc4 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.059027 Oct 04 20:31:07.555326 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 33/61] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 4 20:31:07 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:07.582412 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2788b7ec-17f9-4137-b2e2-0cb115d9bae3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-655882599"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:07.598383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.aggregate [None req-2788b7ec-17f9-4137-b2e2-0cb115d9bae3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Generated uuid 9b01699d-2449-4e1b-8bf2-5050cf5769d7 for aggregate {{(pid=123539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:07.778095 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2788b7ec-17f9-4137-b2e2-0cb115d9bae3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.218239 Oct 04 20:31:07.781785 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 34/62] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:07 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:07.791282 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-faa7fd41-076f-4658-8710-75d1f7999ce5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852085-12"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:07.848949 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-faa7fd41-076f-4658-8710-75d1f7999ce5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:07.856281 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-faa7fd41-076f-4658-8710-75d1f7999ce5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:07.857181 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-faa7fd41-076f-4658-8710-75d1f7999ce5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:08.571378 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-faa7fd41-076f-4658-8710-75d1f7999ce5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 313 microversion: 2.1 time: 0.785882 Oct 04 20:31:08.573272 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 35/63] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 4 20:31:07 2022] POST /compute/v2.1/os-aggregates/5/action => generated 313 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:08.596106 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8289ae6a-fe17-47f0-a57c-4a5f02f00139 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-655882599"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:08.626161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.aggregate [None req-8289ae6a-fe17-47f0-a57c-4a5f02f00139 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Generated uuid 4ce2769c-1859-47ab-af98-e34d93acb4b7 for aggregate {{(pid=123539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:08.661726 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-8289ae6a-fe17-47f0-a57c-4a5f02f00139 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-655882599 already exists. Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8289ae6a-fe17-47f0-a57c-4a5f02f00139 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Request method failure captured: Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 59 Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgAmJyE4m9DQPG2iunY9YVIyue6gS1OKIJPuEzNOxiMCiMOXtcPHuHmWtLQDZb_vWBsM58RalEsHfWIT8GowCD44ZmeluHPpB82ixi-hd_KWr0GIe0l_oKWRpd4Cx7vaAzwuhasrR86gnQTY2q5NH1FAgPFEBhgdu5oFZaeMxD1G2w Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:08.669099 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cb8231cbd10e4f4ea7eb62bf99dd0791", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}] Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: fa6f52cb0cd643e98535ba532fe2c384 Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: {"aggregate": {"name": "tempest-test_aggregate-655882599"}} Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:08.671216 n-d-852085-12 devstack@n-api.service[123539]: exception: Aggregate tempest-test_aggregate-655882599 already exists. Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-655882599'}}} Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 04 20:31:08.672480 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-655882599 already exists. Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:08.677070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 04 20:31:08.680619 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 20:31:08.680619 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-655882599 already exists. Oct 04 20:31:08.680619 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:08.680619 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:08.680619 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:08.680619 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:08.680619 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:08.680619 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:08.680619 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:08.680619 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:08.680619 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-655882599 already exists. Oct 04 20:31:08.680619 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:08.691276 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8289ae6a-fe17-47f0-a57c-4a5f02f00139 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-655882599 already exists. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:08.693418 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8289ae6a-fe17-47f0-a57c-4a5f02f00139 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.118191 Oct 04 20:31:08.700570 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 36/64] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:08 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:31:08.730117 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f7e6d148-e2b7-4778-944c-9c8fa7fde7d5 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:08.734566 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f7e6d148-e2b7-4778-944c-9c8fa7fde7d5 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:08.766054 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f7e6d148-e2b7-4778-944c-9c8fa7fde7d5 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:08.774076 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f7e6d148-e2b7-4778-944c-9c8fa7fde7d5 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:08.775497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f7e6d148-e2b7-4778-944c-9c8fa7fde7d5 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:08.777443 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f7e6d148-e2b7-4778-944c-9c8fa7fde7d5 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:08.779160 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f7e6d148-e2b7-4778-944c-9c8fa7fde7d5 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:08.780197 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f7e6d148-e2b7-4778-944c-9c8fa7fde7d5 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:08.873658 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-09537744-9f3d-44a8-bce1-0cd6e879d988 tempest-FlavorsAdminTestJSON-1639034714 tempest-FlavorsAdminTestJSON-1639034714-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:08.984159 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-09537744-9f3d-44a8-bce1-0cd6e879d988 tempest-FlavorsAdminTestJSON-1639034714 tempest-FlavorsAdminTestJSON-1639034714-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 1.687614 Oct 04 20:31:09.004476 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 29/65] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:07 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:09.017798 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-af97f645-65c8-4fd4-ba8e-61727235741c tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:09.243325 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-af97f645-65c8-4fd4-ba8e-61727235741c tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.237194 Oct 04 20:31:09.244330 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 30/66] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:09 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:09.268038 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-78dcfbc2-b80c-4280-bc2b-9671b689ae0f tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:09.409483 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-78dcfbc2-b80c-4280-bc2b-9671b689ae0f tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/297150800" status: 202 len: 0 microversion: 2.1 time: 0.162651 Oct 04 20:31:09.410586 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 31/67] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:09 2022] DELETE /compute/v2.1/flavors/297150800 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:09.416747 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-11adbf58-af04-47cb-b43a-2e2f6ebb79fb tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1760768310"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:09.421483 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.aggregate [None req-11adbf58-af04-47cb-b43a-2e2f6ebb79fb tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Generated uuid b1d52a45-0dc9-45ef-8bb8-716df049b016 for aggregate {{(pid=123540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:09.524068 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f7e6d148-e2b7-4778-944c-9c8fa7fde7d5 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:09.546735 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-11adbf58-af04-47cb-b43a-2e2f6ebb79fb tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.134241 Oct 04 20:31:09.549524 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 32/68] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:09.572980 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a2b6377b-6e40-424f-b987-8b0f8841d310 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:09.622778 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f7e6d148-e2b7-4778-944c-9c8fa7fde7d5 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1299 microversion: 2.1 time: 0.915292 Oct 04 20:31:09.626278 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 37/69] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:08 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1299 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:09.643619 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a2b6377b-6e40-424f-b987-8b0f8841d310 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085721 Oct 04 20:31:09.645247 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 33/70] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:09.656114 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c89a6af3-6e11-49a1-9214-a0e69f533033 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:09.659642 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c89a6af3-6e11-49a1-9214-a0e69f533033 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '2a7aaeb417c04b7085a6e752268963c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a6c60df0b14717bf52f10dbe8d68c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c89a6af3-6e11-49a1-9214-a0e69f533033 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Request method failure captured: Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJf649nv-tbYxgR4zV87jnq_6GGcpVUbENA3U1lTf0_n2fUBGe1E4NwZidPBeEXTx4VpwMyS-aS97oWKEalLYNHG98wtcTt2o2J5gfM25h30aqnOrqW0RFtJ5nwfdpaB4qaxRu6_6rPqRLI3WED4xk4tT-GZVw6EdsNEyCCPw-E-u9A Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 43a6c60df0b14717bf52f10dbe8d68c2 Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:09.666539 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:09.669054 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_43a6c60df0b14717bf52f10dbe8d68c2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43a6c60df0b14717bf52f10dbe8d68c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43a6c60df0b14717bf52f10dbe8d68c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/43a6c60df0b14717bf52f10dbe8d68c2"}]}] Oct 04 20:31:09.669054 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:09.669054 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 43a6c60df0b14717bf52f10dbe8d68c2 Oct 04 20:31:09.669054 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:09.669054 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminNegativeTestJSON-119113897-project Oct 04 20:31:09.669054 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:09.669054 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:09.669054 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 2a7aaeb417c04b7085a6e752268963c8 Oct 04 20:31:09.669054 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119113897-project Oct 04 20:31:09.669054 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:09.669054 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 20:31:09.669054 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '7'} Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:09.671049 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 20:31:09.673261 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:09.677144 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c89a6af3-6e11-49a1-9214-a0e69f533033 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:09.679049 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c89a6af3-6e11-49a1-9214-a0e69f533033 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.031695 Oct 04 20:31:09.680350 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 34/71] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:09 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:09.701268 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-eadfe2a7-b96a-4a19-bf59-73751643f895 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2028772216", "id": 995825720, "os-flavor-access:is_public": "False"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:09.828287 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-eadfe2a7-b96a-4a19-bf59-73751643f895 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.134992 Oct 04 20:31:09.830854 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 35/72] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:09 2022] POST /compute/v2.1/flavors => generated 427 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:09.840291 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-146f13a1-3dfa-4e39-aae4-f793fe85beb5 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:10.015618 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-146f13a1-3dfa-4e39-aae4-f793fe85beb5 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.182361 Oct 04 20:31:10.018926 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 36/73] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:09 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:10.043003 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a77f1dd7-8217-4ed3-b8d8-336878840634 tempest-FlavorsAdminTestJSON-1639034714 tempest-FlavorsAdminTestJSON-1639034714-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "995825720"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:10.099222 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:10.205087 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-a77f1dd7-8217-4ed3-b8d8-336878840634 tempest-FlavorsAdminTestJSON-1639034714 tempest-FlavorsAdminTestJSON-1639034714-project] HTTP exception thrown: Flavor 995825720 could not be found. Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a77f1dd7-8217-4ed3-b8d8-336878840634 tempest-FlavorsAdminTestJSON-1639034714 tempest-FlavorsAdminTestJSON-1639034714-project] Request method failure captured: Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 106 Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJf6YXAenrgMjj89V2nbWRIei09QxxrgJOSmc5nT4VNCmZrSXjJLa5il0kj7SngxP8ANv76LMPbAhqxB1KkUnl1s1gK3boAYEuH2lEc6Y0vv4oqRY1dBhbmmerBAE13BmNmPwvktUQbZvVx5-u7SVdnRv01v8n5qBRrRlpQuEWdh6hg Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: d0222cc92ab44873bb0fa83d41176327 Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FlavorsAdminTestJSON-1639034714 Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:10.214500 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d0222cc92ab44873bb0fa83d41176327", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d0222cc92ab44873bb0fa83d41176327"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d0222cc92ab44873bb0fa83d41176327"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d0222cc92ab44873bb0fa83d41176327"}]}] Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FlavorsAdminTestJSON-1639034714 Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: d0222cc92ab44873bb0fa83d41176327 Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1639034714 Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FlavorsAdminTestJSON-1639034714-project Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 010c61cd184d44738f9782856a99731b Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FlavorsAdminTestJSON-1639034714-project Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "test", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "995825720"}} Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:10.216256 n-d-852085-12 devstack@n-api.service[123540]: exception: Flavor 995825720 could not be found. Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '995825720'}}} Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 995825720 could not be found. Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:10.217176 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 995825720 could not be found. Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:10.218711 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:10.220251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:10.220251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:10.220251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:10.220251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 995825720 could not be found. Oct 04 20:31:10.220251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:10.220251 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a77f1dd7-8217-4ed3-b8d8-336878840634 tempest-FlavorsAdminTestJSON-1639034714 tempest-FlavorsAdminTestJSON-1639034714-project] Returning 400 to user: Flavor 995825720 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:10.220251 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a77f1dd7-8217-4ed3-b8d8-336878840634 tempest-FlavorsAdminTestJSON-1639034714 tempest-FlavorsAdminTestJSON-1639034714-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.192417 Oct 04 20:31:10.232857 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 37/74] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:10 2022] POST /compute/v2.1/servers => generated 80 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:10.248499 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f63bd3c0-156d-4135-9997-5e443bb76e77 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:10.302850 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-f63bd3c0-156d-4135-9997-5e443bb76e77 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f63bd3c0-156d-4135-9997-5e443bb76e77 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Request method failure captured: Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgAmJyE4m9DQPG2iunY9YVIyue6gS1OKIJPuEzNOxiMCiMOXtcPHuHmWtLQDZb_vWBsM58RalEsHfWIT8GowCD44ZmeluHPpB82ixi-hd_KWr0GIe0l_oKWRpd4Cx7vaAzwuhasrR86gnQTY2q5NH1FAgPFEBhgdu5oFZaeMxD1G2w Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:31:10.332393 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:31:10.334766 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cb8231cbd10e4f4ea7eb62bf99dd0791", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}] Oct 04 20:31:10.334766 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:10.334766 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:10.334766 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:10.334766 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:10.334766 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:10.334766 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:10.334766 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: fa6f52cb0cd643e98535ba532fe2c384 Oct 04 20:31:10.334766 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:10.334766 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:10.334766 n-d-852085-12 devstack@n-api.service[123540]: exception: Aggregate -1 could not be found. Oct 04 20:31:10.334766 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '-1'} Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:31:10.336201 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:10.338658 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:10.342641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:10.342641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:10.342641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:10.342641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:10.342641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 20:31:10.342641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:10.344464 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f63bd3c0-156d-4135-9997-5e443bb76e77 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:10.346609 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f63bd3c0-156d-4135-9997-5e443bb76e77 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.111701 Oct 04 20:31:10.348479 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 38/75] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:10 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:31:10.384154 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-74baef3d-d8fa-4858-8558-34aff516ca66 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:10.490248 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-74baef3d-d8fa-4858-8558-34aff516ca66 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/995825720" status: 202 len: 0 microversion: 2.1 time: 0.120959 Oct 04 20:31:10.494344 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 39/76] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:10 2022] DELETE /compute/v2.1/flavors/995825720 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:10.520397 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3ebd2264-f7fe-4d4d-a7ce-b07c8e040cce tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-189584035"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:10.537066 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.aggregate [None req-3ebd2264-f7fe-4d4d-a7ce-b07c8e040cce tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Generated uuid 0ca39547-75f8-4fe7-b105-0b7082a3ef1e for aggregate {{(pid=123540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:10.703285 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3ebd2264-f7fe-4d4d-a7ce-b07c8e040cce tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.203436 Oct 04 20:31:10.709874 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 40/77] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:10 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:10.746708 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-39220a54-ef9c-43eb-be7b-45e5a3c36b2b tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:10.826410 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-39220a54-ef9c-43eb-be7b-45e5a3c36b2b tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.112907 Oct 04 20:31:10.844916 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 41/78] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:10.846451 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-159c2c80-26dd-4755-91ac-712fc1f8a28f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:10.849081 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-159c2c80-26dd-4755-91ac-712fc1f8a28f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:10.865940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-159c2c80-26dd-4755-91ac-712fc1f8a28f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:10.872025 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-159c2c80-26dd-4755-91ac-712fc1f8a28f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:10.873357 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-159c2c80-26dd-4755-91ac-712fc1f8a28f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:10.874404 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-159c2c80-26dd-4755-91ac-712fc1f8a28f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:10.877884 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-159c2c80-26dd-4755-91ac-712fc1f8a28f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:10.878447 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-159c2c80-26dd-4755-91ac-712fc1f8a28f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:11.113289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1113675130", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "availability_zone": "tempest-test_az-253036341"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:11.163865 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:11.165242 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:11.166453 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:11.168458 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:11.169600 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:11.170572 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:11.348053 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:31:11.614261 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-159c2c80-26dd-4755-91ac-712fc1f8a28f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:11.665835 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-159c2c80-26dd-4755-91ac-712fc1f8a28f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1299 microversion: 2.1 time: 0.822519 Oct 04 20:31:11.673978 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 42/79] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:10 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1299 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:11.726575 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2dad8ce7-9961-46d8-8afc-2e95894b8119 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:11.748410 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-2dad8ce7-9961-46d8-8afc-2e95894b8119 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '2a7aaeb417c04b7085a6e752268963c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a6c60df0b14717bf52f10dbe8d68c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2dad8ce7-9961-46d8-8afc-2e95894b8119 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Request method failure captured: Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJf649nv-tbYxgR4zV87jnq_6GGcpVUbENA3U1lTf0_n2fUBGe1E4NwZidPBeEXTx4VpwMyS-aS97oWKEalLYNHG98wtcTt2o2J5gfM25h30aqnOrqW0RFtJ5nwfdpaB4qaxRu6_6rPqRLI3WED4xk4tT-GZVw6EdsNEyCCPw-E-u9A Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 43a6c60df0b14717bf52f10dbe8d68c2 Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:11.764565 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:11.765865 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_43a6c60df0b14717bf52f10dbe8d68c2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43a6c60df0b14717bf52f10dbe8d68c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43a6c60df0b14717bf52f10dbe8d68c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/43a6c60df0b14717bf52f10dbe8d68c2"}]}] Oct 04 20:31:11.765865 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:11.765865 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 43a6c60df0b14717bf52f10dbe8d68c2 Oct 04 20:31:11.765865 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:11.765865 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminNegativeTestJSON-119113897-project Oct 04 20:31:11.765865 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:11.765865 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:11.765865 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 2a7aaeb417c04b7085a6e752268963c8 Oct 04 20:31:11.765865 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119113897-project Oct 04 20:31:11.765865 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:11.765865 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 20:31:11.765865 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '8'} Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:11.766628 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 20:31:11.770065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:11.777865 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2dad8ce7-9961-46d8-8afc-2e95894b8119 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:11.782169 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2dad8ce7-9961-46d8-8afc-2e95894b8119 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] 10.222.0.78 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.095630 Oct 04 20:31:11.784702 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 43/80] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 4 20:31:11 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 109 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:11.797295 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8ce6f5ac-3b79-4375-b5f4-fdad9dc2e2a3 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-480083581", "id": 577029557, "os-flavor-access:is_public": "False"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:11.922073 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8ce6f5ac-3b79-4375-b5f4-fdad9dc2e2a3 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.135955 Oct 04 20:31:11.926178 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 44/81] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:11 2022] POST /compute/v2.1/flavors => generated 411 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:11.944912 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ff32f25c-ae5b-49b6-98d8-0965eeb61639 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:12.147088 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:12.175216 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ff32f25c-ae5b-49b6-98d8-0965eeb61639 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.247353 Oct 04 20:31:12.177912 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 45/82] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:11 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:12.198092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-37ba0092-626a-49aa-89c4-0776c914fdab tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-418658649", "id": 594479732, "os-flavor-access:is_public": "True"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:12.535295 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-37ba0092-626a-49aa-89c4-0776c914fdab tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.349756 Oct 04 20:31:12.540048 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 46/83] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:12 2022] POST /compute/v2.1/flavors => generated 410 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:12.553864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-eb72deb1-b71e-49b6-97da-219568f9737e tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:12.604678 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-eb72deb1-b71e-49b6-97da-219568f9737e tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-eb72deb1-b71e-49b6-97da-219568f9737e tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Request method failure captured: Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgAmJyE4m9DQPG2iunY9YVIyue6gS1OKIJPuEzNOxiMCiMOXtcPHuHmWtLQDZb_vWBsM58RalEsHfWIT8GowCD44ZmeluHPpB82ixi-hd_KWr0GIe0l_oKWRpd4Cx7vaAzwuhasrR86gnQTY2q5NH1FAgPFEBhgdu5oFZaeMxD1G2w Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:31:12.606403 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:31:12.609821 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cb8231cbd10e4f4ea7eb62bf99dd0791", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}] Oct 04 20:31:12.609821 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:12.609821 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:31:12.609821 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:31:12.609821 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:12.609821 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:12.609821 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:12.609821 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: fa6f52cb0cd643e98535ba532fe2c384 Oct 04 20:31:12.609821 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:31:12.609821 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:12.609821 n-d-852085-12 devstack@n-api.service[123540]: exception: Aggregate -1 could not be found. Oct 04 20:31:12.609821 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '-1'} Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:12.617143 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 20:31:12.624309 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:12.627557 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-eb72deb1-b71e-49b6-97da-219568f9737e tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:12.627557 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-eb72deb1-b71e-49b6-97da-219568f9737e tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.071551 Oct 04 20:31:12.627557 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 47/84] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:12 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:31:12.641622 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-90183c23-298c-4ffc-89f4-9b9ae4692ff1 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:12.745375 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-90183c23-298c-4ffc-89f4-9b9ae4692ff1 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.120309 Oct 04 20:31:12.764479 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 48/85] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Oct 4 20:31:12 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:12.782010 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-75e4c5a2-d2f5-4a98-b14d-aed9642917fe tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:12.790832 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-75e4c5a2-d2f5-4a98-b14d-aed9642917fe tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '2a7aaeb417c04b7085a6e752268963c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a6c60df0b14717bf52f10dbe8d68c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-75e4c5a2-d2f5-4a98-b14d-aed9642917fe tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Request method failure captured: Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJf649nv-tbYxgR4zV87jnq_6GGcpVUbENA3U1lTf0_n2fUBGe1E4NwZidPBeEXTx4VpwMyS-aS97oWKEalLYNHG98wtcTt2o2J5gfM25h30aqnOrqW0RFtJ5nwfdpaB4qaxRu6_6rPqRLI3WED4xk4tT-GZVw6EdsNEyCCPw-E-u9A Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 43a6c60df0b14717bf52f10dbe8d68c2 Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:12.807227 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:12.809140 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_43a6c60df0b14717bf52f10dbe8d68c2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43a6c60df0b14717bf52f10dbe8d68c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43a6c60df0b14717bf52f10dbe8d68c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/43a6c60df0b14717bf52f10dbe8d68c2"}]}] Oct 04 20:31:12.809140 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:12.809140 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 43a6c60df0b14717bf52f10dbe8d68c2 Oct 04 20:31:12.809140 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:31:12.809140 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminNegativeTestJSON-119113897-project Oct 04 20:31:12.809140 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:12.809140 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:12.809140 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 2a7aaeb417c04b7085a6e752268963c8 Oct 04 20:31:12.809140 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119113897-project Oct 04 20:31:12.809140 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:12.809140 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 20:31:12.809140 n-d-852085-12 devstack@n-api.service[123540]: action_args: {} Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:12.810002 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 20:31:12.811493 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:12.820677 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-75e4c5a2-d2f5-4a98-b14d-aed9642917fe tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:12.830583 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-75e4c5a2-d2f5-4a98-b14d-aed9642917fe tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.055732 Oct 04 20:31:12.830583 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 49/86] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 4 20:31:12 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:12.843591 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cafce7e3-193a-4ba3-8d59-7c4110455283 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:12.852866 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-cafce7e3-193a-4ba3-8d59-7c4110455283 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:12.882898 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cafce7e3-193a-4ba3-8d59-7c4110455283 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:12.883515 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cafce7e3-193a-4ba3-8d59-7c4110455283 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:12.884162 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cafce7e3-193a-4ba3-8d59-7c4110455283 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:12.906584 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cafce7e3-193a-4ba3-8d59-7c4110455283 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:12.907397 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cafce7e3-193a-4ba3-8d59-7c4110455283 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:12.908074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cafce7e3-193a-4ba3-8d59-7c4110455283 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:13.351228 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:31:13.352009 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:31:13.352477 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:31:13.353312 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:31:13.353948 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:31:13.406077 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:13.407422 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:13.408375 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:13.409475 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:13.410239 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:13.410924 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:13.482959 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Getting quotas for project d0ded24c70b54fc5bb73d54fd1537abb. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:31:13.498255 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Getting quotas for user 72398073905c49ee952b40ce1a53fd28 and project d0ded24c70b54fc5bb73d54fd1537abb. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:31:13.550464 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:31:13.555881 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:31:13.844118 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9fba539d-62ba-47f9-b21d-09971f6b5d84 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.214686 Oct 04 20:31:13.858624 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-cafce7e3-193a-4ba3-8d59-7c4110455283 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:13.868569 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 38/87] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 4241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:31:13.898630 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7fe9f47e-9558-457a-93bc-b66fddd3a6dc tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:13.910923 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cafce7e3-193a-4ba3-8d59-7c4110455283 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 1.084568 Oct 04 20:31:13.911771 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 50/88] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:12 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:14.027424 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7fe9f47e-9558-457a-93bc-b66fddd3a6dc tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.156896 Oct 04 20:31:14.028024 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 39/89] 10.222.0.78 () {58 vars in 1177 bytes} [Tue Oct 4 20:31:13 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:14.051833 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6777cdbf-7741-40ec-be33-4307be9fbf8f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:14.053113 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6777cdbf-7741-40ec-be33-4307be9fbf8f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:14.340682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6777cdbf-7741-40ec-be33-4307be9fbf8f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:14.358558 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6777cdbf-7741-40ec-be33-4307be9fbf8f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1242 microversion: 2.1 time: 0.326759 Oct 04 20:31:14.361541 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 40/90] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:14 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1242 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:14.372691 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-95c717fc-843b-45db-948d-b0ea1ac39a26 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:14.442552 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-95c717fc-843b-45db-948d-b0ea1ac39a26 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.074891 Oct 04 20:31:14.443656 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 41/91] 10.222.0.78 () {58 vars in 1171 bytes} [Tue Oct 4 20:31:14 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:14.480842 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0d51ef77-80bb-413e-919c-6363bd595d6b tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:14.523968 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0d51ef77-80bb-413e-919c-6363bd595d6b tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.056150 Oct 04 20:31:14.535658 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 42/92] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Oct 4 20:31:14 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:14.542394 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6e797c06-876f-4654-827e-1c815e4b1f89 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:14.552143 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10,nova_api:DELETE=7 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:14.574496 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6e797c06-876f-4654-827e-1c815e4b1f89 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.037388 Oct 04 20:31:14.594260 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 43/93] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Oct 4 20:31:14 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:14.618483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a56cd1ed-0646-4ee9-9da1-20c4f1f515c6 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:14.724117 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a56cd1ed-0646-4ee9-9da1-20c4f1f515c6 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.115568 Oct 04 20:31:14.757346 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 44/94] 10.222.0.78 () {58 vars in 1175 bytes} [Tue Oct 4 20:31:14 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:14.772379 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-81730c20-415a-4d14-886f-482d44a46e30 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:14.858140 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-81730c20-415a-4d14-886f-482d44a46e30 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.098993 Oct 04 20:31:14.876776 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 45/95] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 4 20:31:14 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:14.904288 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-27b2f86c-1e7a-4e39-b7fc-eea8f1370f9f tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:15.020035 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-27b2f86c-1e7a-4e39-b7fc-eea8f1370f9f tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.133492 Oct 04 20:31:15.030263 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 46/96] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Oct 4 20:31:14 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:15.067124 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-68f3adca-cf73-4429-906a-92d14dc7909b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:15.070191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-68f3adca-cf73-4429-906a-92d14dc7909b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:15.085426 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-68f3adca-cf73-4429-906a-92d14dc7909b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:15.087835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-68f3adca-cf73-4429-906a-92d14dc7909b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:15.087835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-68f3adca-cf73-4429-906a-92d14dc7909b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:15.087835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-68f3adca-cf73-4429-906a-92d14dc7909b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:15.092368 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-68f3adca-cf73-4429-906a-92d14dc7909b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:15.093317 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-68f3adca-cf73-4429-906a-92d14dc7909b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:15.157138 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f730bf0f-cc86-48d7-913f-e72470a2ec0b tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Calling method '.version_select at 0x7f77eff42820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:15.204599 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f730bf0f-cc86-48d7-913f-e72470a2ec0b tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:15.206213 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f730bf0f-cc86-48d7-913f-e72470a2ec0b tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:15.212545 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f730bf0f-cc86-48d7-913f-e72470a2ec0b tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:15.215497 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f730bf0f-cc86-48d7-913f-e72470a2ec0b tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:15.220436 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f730bf0f-cc86-48d7-913f-e72470a2ec0b tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:15.221533 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f730bf0f-cc86-48d7-913f-e72470a2ec0b tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:15.297738 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f730bf0f-cc86-48d7-913f-e72470a2ec0b tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 1.384332 Oct 04 20:31:15.305182 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 51/97] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 4 20:31:13 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:15.319722 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b8968ae2-eeda-4086-9898-4d3e1c9c68ba tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:15.414820 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=16,nova_api:INSERT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:15.513192 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b8968ae2-eeda-4086-9898-4d3e1c9c68ba tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/594479732" status: 202 len: 0 microversion: 2.1 time: 0.203311 Oct 04 20:31:15.520746 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 52/98] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:15 2022] DELETE /compute/v2.1/flavors/594479732 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:15.589586 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-68f3adca-cf73-4429-906a-92d14dc7909b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:15.605604 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-68f3adca-cf73-4429-906a-92d14dc7909b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.563936 Oct 04 20:31:15.607387 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 47/99] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:15 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:15.621603 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-970b8300-ab49-48ff-9b1a-2738b5b7971c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:15.625808 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-970b8300-ab49-48ff-9b1a-2738b5b7971c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:15.770360 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-970b8300-ab49-48ff-9b1a-2738b5b7971c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:15.787783 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-970b8300-ab49-48ff-9b1a-2738b5b7971c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1242 microversion: 2.1 time: 0.178494 Oct 04 20:31:15.803930 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 48/100] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:15 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1242 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:15.834999 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9a7fc57e-5569-4375-9c4c-a73f63c0da2c tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:15.884073 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9a7fc57e-5569-4375-9c4c-a73f63c0da2c tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077420 Oct 04 20:31:15.884962 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 49/101] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:15.931221 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bd2cea12-e93b-4215-b81d-abcda86fcf4c tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.061172 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bd2cea12-e93b-4215-b81d-abcda86fcf4c tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/577029557" status: 202 len: 0 microversion: 2.1 time: 0.138920 Oct 04 20:31:16.066835 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 50/102] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:15 2022] DELETE /compute/v2.1/flavors/577029557 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:31:16.082547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7b68ef96-8271-49d6-803d-430719a4c61c tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.150437 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7185a336-73cb-42ee-8354-78c27ec88598 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Calling method '.version_select at 0x7f77eff42b80>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.158525 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7185a336-73cb-42ee-8354-78c27ec88598 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'd43c12d5f59b43ebb3580c53d4301267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca5ac4fa025454cab4aa8e3f9fa9644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:16.161633 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7b68ef96-8271-49d6-803d-430719a4c61c tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092899 Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7185a336-73cb-42ee-8354-78c27ec88598 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Request method failure captured: Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgOYcGsY-YaLgj1PoNZrJil-ndUjFcYOvtEKp3DINESsCu1CV9onXWNex2DlXHTmXgP_NyDA3GSBjMywXp1mrNGspeuGCpSaim1ZNJQ9Jf-rxZkFwrE0GMzfpvlq5eHm_y_x7IpnyTMGnGGFawrGowDw6i-_GBpWzncH4w-tLwlKrU Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: cca5ac4fa025454cab4aa8e3f9fa9644 Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:16.162946 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cca5ac4fa025454cab4aa8e3f9fa9644", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cca5ac4fa025454cab4aa8e3f9fa9644"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cca5ac4fa025454cab4aa8e3f9fa9644"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cca5ac4fa025454cab4aa8e3f9fa9644"}]}] Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: cca5ac4fa025454cab4aa8e3f9fa9644 Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-HostsAdminNegativeTestJSON-152860443-project Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: d43c12d5f59b43ebb3580c53d4301267 Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-152860443-project Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: action_args: {} Oct 04 20:31:16.164656 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:16.165724 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 20:31:16.167281 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.168426 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 51/103] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:16.177171 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7185a336-73cb-42ee-8354-78c27ec88598 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:16.178981 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7185a336-73cb-42ee-8354-78c27ec88598 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.656041 Oct 04 20:31:16.180345 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 53/104] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 4 20:31:15 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 658 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:16.201703 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5ed23c25-364d-4b1c-879a-2f889ed74523 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-516603018", "id": 407140268, "os-flavor-access:is_public": "False"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:16.216965 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dc234521-1fa0-4d20-9c46-e0324a9a9e28 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Calling method '.version_select at 0x7f77efcb6310>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.233072 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-dc234521-1fa0-4d20-9c46-e0324a9a9e28 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'd43c12d5f59b43ebb3580c53d4301267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca5ac4fa025454cab4aa8e3f9fa9644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dc234521-1fa0-4d20-9c46-e0324a9a9e28 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Request method failure captured: Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-hosts/n-d-852085-12/reboot HTTP/1.1 Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgOYcGsY-YaLgj1PoNZrJil-ndUjFcYOvtEKp3DINESsCu1CV9onXWNex2DlXHTmXgP_NyDA3GSBjMywXp1mrNGspeuGCpSaim1ZNJQ9Jf-rxZkFwrE0GMzfpvlq5eHm_y_x7IpnyTMGnGGFawrGowDw6i-_GBpWzncH4w-tLwlKrU Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: cca5ac4fa025454cab4aa8e3f9fa9644 Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:31:16.240610 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cca5ac4fa025454cab4aa8e3f9fa9644", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cca5ac4fa025454cab4aa8e3f9fa9644"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cca5ac4fa025454cab4aa8e3f9fa9644"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cca5ac4fa025454cab4aa8e3f9fa9644"}]}] Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: cca5ac4fa025454cab4aa8e3f9fa9644 Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HostsAdminNegativeTestJSON-152860443-project Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: d43c12d5f59b43ebb3580c53d4301267 Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-152860443-project Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'n-d-852085-12'} Oct 04 20:31:16.242772 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:16.246671 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 20:31:16.249051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.254167 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dc234521-1fa0-4d20-9c46-e0324a9a9e28 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:16.256077 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-dc234521-1fa0-4d20-9c46-e0324a9a9e28 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-852085-12/reboot" status: 403 len: 111 microversion: 2.1 time: 0.063475 Oct 04 20:31:16.258355 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 52/105] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/os-hosts/n-d-852085-12/reboot => generated 111 bytes in 67 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:16.279417 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ae2d8dee-fee1-4926-9972-79f854f08af4 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Calling method '.version_select at 0x7f77efd7c940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.305311 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-ae2d8dee-fee1-4926-9972-79f854f08af4 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ae2d8dee-fee1-4926-9972-79f854f08af4 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Request method failure captured: Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgRy8WROpKPBWUFpZxhl1qujM-pkWRU8hyBJR-CNOlhih5VHwmsC6ZgS4jWPMPYX4Ge0neyQGfaVmuMYujKe-ULO5RYzXK0eVq4ijdK-G1gFjIVjaXBhSkBhVhNJgmb4jXrz8ximYc9qSFdjfzWEYEIQaW9s9ajjehNueBCVSRxN3Y Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:16.311412 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c082618393b04fb998b0bfa587f3619d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c082618393b04fb998b0bfa587f3619d"}]}] Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: ad95d1c62e7e4130b1c8092d5f00c630 Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'nonexistent_hostname'} Oct 04 20:31:16.312881 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:16.313638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 20:31:16.314735 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:16.315991 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.315991 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.315991 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:16.315991 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.315991 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.315991 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.315991 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.315991 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:16.315991 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:16.315991 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.315991 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.321407 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ae2d8dee-fee1-4926-9972-79f854f08af4 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:16.324412 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ae2d8dee-fee1-4926-9972-79f854f08af4 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.059755 Oct 04 20:31:16.325735 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5ed23c25-364d-4b1c-879a-2f889ed74523 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.128767 Oct 04 20:31:16.329370 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 53/106] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:31:16.342295 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 54/107] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:16 2022] POST /compute/v2.1/flavors => generated 411 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:16.358232 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1702149b-648b-4b25-a34c-418f9c82424b tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.404909 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b5d305cb-2531-471a-8df7-7cdedb586a34 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Calling method '.version_select at 0x7f77efd8caf0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.427682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b5d305cb-2531-471a-8df7-7cdedb586a34 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'd43c12d5f59b43ebb3580c53d4301267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca5ac4fa025454cab4aa8e3f9fa9644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:16.434334 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1702149b-648b-4b25-a34c-418f9c82424b tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069803 Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b5d305cb-2531-471a-8df7-7cdedb586a34 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Request method failure captured: Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-hosts/n-d-852085-12 HTTP/1.1 Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgOYcGsY-YaLgj1PoNZrJil-ndUjFcYOvtEKp3DINESsCu1CV9onXWNex2DlXHTmXgP_NyDA3GSBjMywXp1mrNGspeuGCpSaim1ZNJQ9Jf-rxZkFwrE0GMzfpvlq5eHm_y_x7IpnyTMGnGGFawrGowDw6i-_GBpWzncH4w-tLwlKrU Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: cca5ac4fa025454cab4aa8e3f9fa9644 Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:31:16.438959 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cca5ac4fa025454cab4aa8e3f9fa9644", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cca5ac4fa025454cab4aa8e3f9fa9644"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cca5ac4fa025454cab4aa8e3f9fa9644"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cca5ac4fa025454cab4aa8e3f9fa9644"}]}] Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: cca5ac4fa025454cab4aa8e3f9fa9644 Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HostsAdminNegativeTestJSON-152860443-project Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: d43c12d5f59b43ebb3580c53d4301267 Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-152860443-project Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'n-d-852085-12'} Oct 04 20:31:16.441401 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:16.442476 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 20:31:16.445819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.454974 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b5d305cb-2531-471a-8df7-7cdedb586a34 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:16.461678 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 55/108] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:16.468494 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dd15adf8-112f-4de8-a007-31eba4a12a8f tempest-FlavorsAdminTestJSON-1639034714 tempest-FlavorsAdminTestJSON-1639034714-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.474811 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b5d305cb-2531-471a-8df7-7cdedb586a34 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-852085-12" status: 403 len: 109 microversion: 2.1 time: 0.139691 Oct 04 20:31:16.478279 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 54/109] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/os-hosts/n-d-852085-12 => generated 109 bytes in 142 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:16.488250 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-eaf5729a-98fd-4346-ab94-e2ba05bb839f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Calling method '.version_select at 0x7f77efc75700>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.503817 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-eaf5729a-98fd-4346-ab94-e2ba05bb839f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-eaf5729a-98fd-4346-ab94-e2ba05bb839f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Request method failure captured: Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgRy8WROpKPBWUFpZxhl1qujM-pkWRU8hyBJR-CNOlhih5VHwmsC6ZgS4jWPMPYX4Ge0neyQGfaVmuMYujKe-ULO5RYzXK0eVq4ijdK-G1gFjIVjaXBhSkBhVhNJgmb4jXrz8ximYc9qSFdjfzWEYEIQaW9s9ajjehNueBCVSRxN3Y Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:16.524383 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c082618393b04fb998b0bfa587f3619d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c082618393b04fb998b0bfa587f3619d"}]}] Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: ad95d1c62e7e4130b1c8092d5f00c630 Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'nonexistent_hostname'} Oct 04 20:31:16.526592 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.530025 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.532407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.535647 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-eaf5729a-98fd-4346-ab94-e2ba05bb839f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:16.535647 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-eaf5729a-98fd-4346-ab94-e2ba05bb839f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.049673 Oct 04 20:31:16.538491 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 55/110] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:31:16.552101 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-dd15adf8-112f-4de8-a007-31eba4a12a8f tempest-FlavorsAdminTestJSON-1639034714 tempest-FlavorsAdminTestJSON-1639034714-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088552 Oct 04 20:31:16.563293 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 56/111] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:16.588070 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c784b782-aa65-4848-88b6-3c237cb4d2ba tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Calling method '.version_select at 0x7f77efc4e1f0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.602067 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cbe1d35b-5c52-4189-ab60-4f20c8fc17a6 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c784b782-aa65-4848-88b6-3c237cb4d2ba tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'd43c12d5f59b43ebb3580c53d4301267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca5ac4fa025454cab4aa8e3f9fa9644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c784b782-aa65-4848-88b6-3c237cb4d2ba tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Request method failure captured: Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-hosts/n-d-852085-12/shutdown HTTP/1.1 Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgOYcGsY-YaLgj1PoNZrJil-ndUjFcYOvtEKp3DINESsCu1CV9onXWNex2DlXHTmXgP_NyDA3GSBjMywXp1mrNGspeuGCpSaim1ZNJQ9Jf-rxZkFwrE0GMzfpvlq5eHm_y_x7IpnyTMGnGGFawrGowDw6i-_GBpWzncH4w-tLwlKrU Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: cca5ac4fa025454cab4aa8e3f9fa9644 Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:31:16.666632 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cca5ac4fa025454cab4aa8e3f9fa9644", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cca5ac4fa025454cab4aa8e3f9fa9644"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cca5ac4fa025454cab4aa8e3f9fa9644"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cca5ac4fa025454cab4aa8e3f9fa9644"}]}] Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: cca5ac4fa025454cab4aa8e3f9fa9644 Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HostsAdminNegativeTestJSON-152860443-project Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: d43c12d5f59b43ebb3580c53d4301267 Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-152860443-project Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'n-d-852085-12'} Oct 04 20:31:16.668429 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:16.669875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 20:31:16.671117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.677148 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c784b782-aa65-4848-88b6-3c237cb4d2ba tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:16.679914 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c784b782-aa65-4848-88b6-3c237cb4d2ba tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-852085-12/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.132649 Oct 04 20:31:16.694465 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 56/112] 10.222.0.78 () {58 vars in 1197 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/os-hosts/n-d-852085-12/shutdown => generated 113 bytes in 148 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:16.719648 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-867f7119-b83d-4bf4-8f48-0010cb91adea tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.720322 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-867f7119-b83d-4bf4-8f48-0010cb91adea tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:16.740062 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cbe1d35b-5c52-4189-ab60-4f20c8fc17a6 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/407140268" status: 202 len: 0 microversion: 2.1 time: 0.151021 Oct 04 20:31:16.748287 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-867f7119-b83d-4bf4-8f48-0010cb91adea tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:16.749451 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-867f7119-b83d-4bf4-8f48-0010cb91adea tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:16.751284 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-867f7119-b83d-4bf4-8f48-0010cb91adea tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:16.754085 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-867f7119-b83d-4bf4-8f48-0010cb91adea tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:16.755506 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-867f7119-b83d-4bf4-8f48-0010cb91adea tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:16.756270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-867f7119-b83d-4bf4-8f48-0010cb91adea tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:16.756655 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 57/113] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:16 2022] DELETE /compute/v2.1/flavors/407140268 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:16.783849 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5894550b-9653-47e3-9b43-f24bae6b6a40 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Calling method '.version_select at 0x7f77eff423a0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.857789 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-5894550b-9653-47e3-9b43-f24bae6b6a40 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5894550b-9653-47e3-9b43-f24bae6b6a40 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Request method failure captured: Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgRy8WROpKPBWUFpZxhl1qujM-pkWRU8hyBJR-CNOlhih5VHwmsC6ZgS4jWPMPYX4Ge0neyQGfaVmuMYujKe-ULO5RYzXK0eVq4ijdK-G1gFjIVjaXBhSkBhVhNJgmb4jXrz8ximYc9qSFdjfzWEYEIQaW9s9ajjehNueBCVSRxN3Y Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:31:16.862126 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c082618393b04fb998b0bfa587f3619d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c082618393b04fb998b0bfa587f3619d"}]}] Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: ad95d1c62e7e4130b1c8092d5f00c630 Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'nonexistent_hostname'} Oct 04 20:31:16.863884 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:16.864970 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 20:31:16.866529 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:16.868222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.868222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.868222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:16.868222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.868222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:16.868222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:16.868222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:16.868222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:16.868222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:16.868222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:16.868222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:16.882536 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5894550b-9653-47e3-9b43-f24bae6b6a40 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:16.882536 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5894550b-9653-47e3-9b43-f24bae6b6a40 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.122633 Oct 04 20:31:16.889656 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 58/114] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:31:16.897506 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bb8d8162-ca90-4b56-a063-2af3ddb47c99 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.953930 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bb8d8162-ca90-4b56-a063-2af3ddb47c99 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062159 Oct 04 20:31:16.964206 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 59/115] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:16.980638 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-88d3bc5b-622d-4008-a908-786c44689fff tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.993098 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-88d3bc5b-622d-4008-a908-786c44689fff tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:17.231425 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-88d3bc5b-622d-4008-a908-786c44689fff tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:17.236835 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-88d3bc5b-622d-4008-a908-786c44689fff tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1242 microversion: 2.1 time: 0.271117 Oct 04 20:31:17.237756 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 60/116] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1242 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:17.255955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-99f25e6f-a85a-4757-b7d6-262bbc852e5b tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Calling method '.version_select at 0x7f77efe1a3a0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:17.259073 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-99f25e6f-a85a-4757-b7d6-262bbc852e5b tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'd43c12d5f59b43ebb3580c53d4301267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca5ac4fa025454cab4aa8e3f9fa9644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-99f25e6f-a85a-4757-b7d6-262bbc852e5b tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Request method failure captured: Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-hosts/n-d-852085-12/startup HTTP/1.1 Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgOYcGsY-YaLgj1PoNZrJil-ndUjFcYOvtEKp3DINESsCu1CV9onXWNex2DlXHTmXgP_NyDA3GSBjMywXp1mrNGspeuGCpSaim1ZNJQ9Jf-rxZkFwrE0GMzfpvlq5eHm_y_x7IpnyTMGnGGFawrGowDw6i-_GBpWzncH4w-tLwlKrU Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: cca5ac4fa025454cab4aa8e3f9fa9644 Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:17.261388 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cca5ac4fa025454cab4aa8e3f9fa9644", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cca5ac4fa025454cab4aa8e3f9fa9644"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cca5ac4fa025454cab4aa8e3f9fa9644"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cca5ac4fa025454cab4aa8e3f9fa9644"}]}] Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: cca5ac4fa025454cab4aa8e3f9fa9644 Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-HostsAdminNegativeTestJSON-152860443-project Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: d43c12d5f59b43ebb3580c53d4301267 Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-152860443-project Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'n-d-852085-12'} Oct 04 20:31:17.262935 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:17.264464 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 20:31:17.266031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.277041 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-99f25e6f-a85a-4757-b7d6-262bbc852e5b tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:17.280109 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-99f25e6f-a85a-4757-b7d6-262bbc852e5b tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-852085-12/startup" status: 403 len: 110 microversion: 2.1 time: 0.032849 Oct 04 20:31:17.289369 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 61/117] 10.222.0.78 () {58 vars in 1194 bytes} [Tue Oct 4 20:31:17 2022] GET /compute/v2.1/os-hosts/n-d-852085-12/startup => generated 110 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:17.321941 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-af082868-359a-4e96-a4e2-3f089755ac0f tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1303019341", "id": 1846026147, "os-flavor-access:is_public": "True"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:17.394489 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-867f7119-b83d-4bf4-8f48-0010cb91adea tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:17.474534 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-867f7119-b83d-4bf4-8f48-0010cb91adea tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.776580 Oct 04 20:31:17.488313 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 57/118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:17.511879 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-af082868-359a-4e96-a4e2-3f089755ac0f tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.216183 Oct 04 20:31:17.526193 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 62/119] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:17 2022] POST /compute/v2.1/flavors => generated 414 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:17.532138 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8719f6f7-069a-4e2a-910e-19bcf2c6323e tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Calling method '.version_select at 0x7f77efe3d0d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:17.542574 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b0d9327f-2a36-4b7f-abba-cff0b7d9911a tempest-FlavorsAdminTestJSON-1639034714 tempest-FlavorsAdminTestJSON-1639034714-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:17.583276 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-8719f6f7-069a-4e2a-910e-19bcf2c6323e tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8719f6f7-069a-4e2a-910e-19bcf2c6323e tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Request method failure captured: Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgRy8WROpKPBWUFpZxhl1qujM-pkWRU8hyBJR-CNOlhih5VHwmsC6ZgS4jWPMPYX4Ge0neyQGfaVmuMYujKe-ULO5RYzXK0eVq4ijdK-G1gFjIVjaXBhSkBhVhNJgmb4jXrz8ximYc9qSFdjfzWEYEIQaW9s9ajjehNueBCVSRxN3Y Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:17.586818 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c082618393b04fb998b0bfa587f3619d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c082618393b04fb998b0bfa587f3619d"}]}] Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: ad95d1c62e7e4130b1c8092d5f00c630 Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'nonexistent_hostname'} Oct 04 20:31:17.588334 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:17.589342 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 20:31:17.590534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8719f6f7-069a-4e2a-910e-19bcf2c6323e tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8719f6f7-069a-4e2a-910e-19bcf2c6323e tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.105486 Oct 04 20:31:17.599538 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 58/120] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Oct 4 20:31:17 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:31:17.626803 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5e729b71-2182-4e1a-b521-e68fec57731f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Action: 'update', calling method: .version_select at 0x7f77efcb6820>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5e729b71-2182-4e1a-b521-e68fec57731f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Request method failure captured: Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: request: PUT /compute/v2.1/os-hosts/n-d-852085-12 HTTP/1.1 Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 51 Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgRy8WROpKPBWUFpZxhl1qujM-pkWRU8hyBJR-CNOlhih5VHwmsC6ZgS4jWPMPYX4Ge0neyQGfaVmuMYujKe-ULO5RYzXK0eVq4ijdK-G1gFjIVjaXBhSkBhVhNJgmb4jXrz8ximYc9qSFdjfzWEYEIQaW9s9ajjehNueBCVSRxN3Y Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:17.629149 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c082618393b04fb998b0bfa587f3619d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c082618393b04fb998b0bfa587f3619d"}]}] Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: ad95d1c62e7e4130b1c8092d5f00c630 Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: {"status": "enable", "maintenance_mode": "invalid"} Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:17.630579 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'n-d-852085-12', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi On instance: Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.631431 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.633344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.634379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.634379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:31:17.634379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:31:17.634379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:31:17.634379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.640526 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5e729b71-2182-4e1a-b521-e68fec57731f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:17.641693 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5e729b71-2182-4e1a-b521-e68fec57731f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-852085-12" status: 400 len: 199 microversion: 2.1 time: 0.033138 Oct 04 20:31:17.648973 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 59/121] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 4 20:31:17 2022] PUT /compute/v2.1/os-hosts/n-d-852085-12 => generated 199 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:31:17.662453 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b0d9327f-2a36-4b7f-abba-cff0b7d9911a tempest-FlavorsAdminTestJSON-1639034714 tempest-FlavorsAdminTestJSON-1639034714-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.134489 Oct 04 20:31:17.668215 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 63/122] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:17 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:17.669622 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d786135d-8d68-40c6-ad93-6b71fdf6148f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Action: 'update', calling method: .version_select at 0x7f77efcb65e0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d786135d-8d68-40c6-ad93-6b71fdf6148f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Request method failure captured: Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: request: PUT /compute/v2.1/os-hosts/n-d-852085-12 HTTP/1.1 Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 51 Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgRy8WROpKPBWUFpZxhl1qujM-pkWRU8hyBJR-CNOlhih5VHwmsC6ZgS4jWPMPYX4Ge0neyQGfaVmuMYujKe-ULO5RYzXK0eVq4ijdK-G1gFjIVjaXBhSkBhVhNJgmb4jXrz8ximYc9qSFdjfzWEYEIQaW9s9ajjehNueBCVSRxN3Y Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:17.680973 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c082618393b04fb998b0bfa587f3619d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c082618393b04fb998b0bfa587f3619d"}]}] Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: ad95d1c62e7e4130b1c8092d5f00c630 Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: {"status": "invalid", "maintenance_mode": "enable"} Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:17.682638 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'n-d-852085-12', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi On instance: Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.683827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.686224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.687587 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.687587 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:31:17.687587 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:31:17.687587 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:31:17.687587 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.691017 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9820980e-b697-4efc-964f-6f3c4b4a5449 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:17.692461 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d786135d-8d68-40c6-ad93-6b71fdf6148f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:17.695263 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d786135d-8d68-40c6-ad93-6b71fdf6148f tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-852085-12" status: 400 len: 189 microversion: 2.1 time: 0.044772 Oct 04 20:31:17.703528 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 60/123] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 4 20:31:17 2022] PUT /compute/v2.1/os-hosts/n-d-852085-12 => generated 189 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:31:17.722243 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9fc7fc46-1e72-4675-b689-ffa2f87c6e32 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Action: 'update', calling method: .version_select at 0x7f77efd7cf70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:17.741683 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9fc7fc46-1e72-4675-b689-ffa2f87c6e32 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'd43c12d5f59b43ebb3580c53d4301267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca5ac4fa025454cab4aa8e3f9fa9644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9fc7fc46-1e72-4675-b689-ffa2f87c6e32 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Request method failure captured: Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: request: PUT /compute/v2.1/os-hosts/n-d-852085-12 HTTP/1.1 Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 50 Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgOYcGsY-YaLgj1PoNZrJil-ndUjFcYOvtEKp3DINESsCu1CV9onXWNex2DlXHTmXgP_NyDA3GSBjMywXp1mrNGspeuGCpSaim1ZNJQ9Jf-rxZkFwrE0GMzfpvlq5eHm_y_x7IpnyTMGnGGFawrGowDw6i-_GBpWzncH4w-tLwlKrU Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: cca5ac4fa025454cab4aa8e3f9fa9644 Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:31:17.742410 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cca5ac4fa025454cab4aa8e3f9fa9644", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cca5ac4fa025454cab4aa8e3f9fa9644"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cca5ac4fa025454cab4aa8e3f9fa9644"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cca5ac4fa025454cab4aa8e3f9fa9644"}]}] Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: cca5ac4fa025454cab4aa8e3f9fa9644 Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-152860443 Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HostsAdminNegativeTestJSON-152860443-project Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: d43c12d5f59b43ebb3580c53d4301267 Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-152860443-project Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 20:31:17.744104 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'n-d-852085-12', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:17.744971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 20:31:17.746195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.750115 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9fc7fc46-1e72-4675-b689-ffa2f87c6e32 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:17.751616 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9fc7fc46-1e72-4675-b689-ffa2f87c6e32 tempest-HostsAdminNegativeTestJSON-152860443 tempest-HostsAdminNegativeTestJSON-152860443-project] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-852085-12" status: 403 len: 111 microversion: 2.1 time: 0.036721 Oct 04 20:31:17.753180 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 61/124] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 4 20:31:17 2022] PUT /compute/v2.1/os-hosts/n-d-852085-12 => generated 111 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:17.769412 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-175b6c10-b20f-46c2-ac14-37ac6148f350 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Action: 'update', calling method: .version_select at 0x7f77efbc10d0>, body: {"status": null, "maintenance_mode": null} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-175b6c10-b20f-46c2-ac14-37ac6148f350 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Request method failure captured: Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: request: PUT /compute/v2.1/os-hosts/n-d-852085-12 HTTP/1.1 Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 42 Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgRy8WROpKPBWUFpZxhl1qujM-pkWRU8hyBJR-CNOlhih5VHwmsC6ZgS4jWPMPYX4Ge0neyQGfaVmuMYujKe-ULO5RYzXK0eVq4ijdK-G1gFjIVjaXBhSkBhVhNJgmb4jXrz8ximYc9qSFdjfzWEYEIQaW9s9ajjehNueBCVSRxN3Y Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:17.810132 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c082618393b04fb998b0bfa587f3619d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c082618393b04fb998b0bfa587f3619d"}]}] Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: ad95d1c62e7e4130b1c8092d5f00c630 Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: {"status": null, "maintenance_mode": null} Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 20:31:17.811877 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'n-d-852085-12', 'body': {'status': None, 'maintenance_mode': None}} Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi On instance: Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi None Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.813191 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.816175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.817708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:31:17.817708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:31:17.817708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 20:31:17.817708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.817708 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-175b6c10-b20f-46c2-ac14-37ac6148f350 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:17.817708 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-175b6c10-b20f-46c2-ac14-37ac6148f350 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-852085-12" status: 400 len: 127 microversion: 2.1 time: 0.049513 Oct 04 20:31:17.830977 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 62/125] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Oct 4 20:31:17 2022] PUT /compute/v2.1/os-hosts/n-d-852085-12 => generated 127 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:31:17.847490 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e9dc0ee1-93f5-4650-85a8-b1bab415bf37 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Action: 'update', calling method: .version_select at 0x7f77efcb6820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:17.861410 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9820980e-b697-4efc-964f-6f3c4b4a5449 tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1846026147" status: 202 len: 0 microversion: 2.1 time: 0.174613 Oct 04 20:31:17.868158 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 64/126] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 4 20:31:17 2022] DELETE /compute/v2.1/flavors/1846026147 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:17.872073 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.hosts [None req-e9dc0ee1-93f5-4650-85a8-b1bab415bf37 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Enabling host nonexistent_hostname. Oct 04 20:31:17.895282 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-e9dc0ee1-93f5-4650-85a8-b1bab415bf37 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:17.898058 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6ca83d9f-1edc-420a-a353-3e8ec965bcbb tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e9dc0ee1-93f5-4650-85a8-b1bab415bf37 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Request method failure captured: Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 50 Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgRy8WROpKPBWUFpZxhl1qujM-pkWRU8hyBJR-CNOlhih5VHwmsC6ZgS4jWPMPYX4Ge0neyQGfaVmuMYujKe-ULO5RYzXK0eVq4ijdK-G1gFjIVjaXBhSkBhVhNJgmb4jXrz8ximYc9qSFdjfzWEYEIQaW9s9ajjehNueBCVSRxN3Y Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:17.909002 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c082618393b04fb998b0bfa587f3619d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c082618393b04fb998b0bfa587f3619d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c082618393b04fb998b0bfa587f3619d"}]}] Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: c082618393b04fb998b0bfa587f3619d Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-705826871 Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: ad95d1c62e7e4130b1c8092d5f00c630 Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-705826871-project-admin Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:17.911049 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:31:17.912080 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:17.913477 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:17.914515 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e9dc0ee1-93f5-4650-85a8-b1bab415bf37 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:17.915450 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e9dc0ee1-93f5-4650-85a8-b1bab415bf37 tempest-HostsAdminNegativeTestJSON-705826871 tempest-HostsAdminNegativeTestJSON-705826871-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.064560 Oct 04 20:31:17.915450 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 63/127] 10.222.0.78 () {60 vars in 1211 bytes} [Tue Oct 4 20:31:17 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:31:18.009304 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6ca83d9f-1edc-420a-a353-3e8ec965bcbb tempest-FlavorsAdminTestJSON-2006659148 tempest-FlavorsAdminTestJSON-2006659148-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.139174 Oct 04 20:31:18.011694 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 65/128] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:18.281588 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-19425c21-ce33-4a40-a4f2-913cf61e5494 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:18.288758 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-19425c21-ce33-4a40-a4f2-913cf61e5494 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:18.352969 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-19425c21-ce33-4a40-a4f2-913cf61e5494 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:18.358966 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-19425c21-ce33-4a40-a4f2-913cf61e5494 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:18.360916 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-19425c21-ce33-4a40-a4f2-913cf61e5494 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:18.367807 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-19425c21-ce33-4a40-a4f2-913cf61e5494 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:18.369168 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-19425c21-ce33-4a40-a4f2-913cf61e5494 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:18.371015 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-19425c21-ce33-4a40-a4f2-913cf61e5494 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:18.510988 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-619ed18a-1546-4cff-9273-0663ca167cf7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:18.512209 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-619ed18a-1546-4cff-9273-0663ca167cf7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:18.554159 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-19425c21-ce33-4a40-a4f2-913cf61e5494 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:18.554627 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-619ed18a-1546-4cff-9273-0663ca167cf7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:18.564916 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-619ed18a-1546-4cff-9273-0663ca167cf7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:18.565956 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-619ed18a-1546-4cff-9273-0663ca167cf7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:18.567769 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-619ed18a-1546-4cff-9273-0663ca167cf7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:18.571604 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-19425c21-ce33-4a40-a4f2-913cf61e5494 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1234 microversion: 2.1 time: 0.298727 Oct 04 20:31:18.572300 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-619ed18a-1546-4cff-9273-0663ca167cf7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:18.572958 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-619ed18a-1546-4cff-9273-0663ca167cf7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:18.594755 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 64/129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:18 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1234 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:19.023078 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-619ed18a-1546-4cff-9273-0663ca167cf7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:19.052845 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-619ed18a-1546-4cff-9273-0663ca167cf7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.549341 Oct 04 20:31:19.054699 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 66/130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:18 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:19.613954 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4a5a0569-c0db-48a5-8857-45ff695549f8 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:19.615023 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4a5a0569-c0db-48a5-8857-45ff695549f8 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:19.645369 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4a5a0569-c0db-48a5-8857-45ff695549f8 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:19.645369 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4a5a0569-c0db-48a5-8857-45ff695549f8 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:19.645369 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4a5a0569-c0db-48a5-8857-45ff695549f8 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:19.645369 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4a5a0569-c0db-48a5-8857-45ff695549f8 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:19.646012 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4a5a0569-c0db-48a5-8857-45ff695549f8 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:19.646012 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4a5a0569-c0db-48a5-8857-45ff695549f8 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:19.930393 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4a5a0569-c0db-48a5-8857-45ff695549f8 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:19.950407 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4a5a0569-c0db-48a5-8857-45ff695549f8 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1290 microversion: 2.1 time: 0.351429 Oct 04 20:31:19.953682 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 65/131] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:19 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1290 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:20.109479 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1a4e357c-ffb1-40b1-852b-51571aa5e866 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:20.110635 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1a4e357c-ffb1-40b1-852b-51571aa5e866 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:20.145494 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a4e357c-ffb1-40b1-852b-51571aa5e866 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:20.146370 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a4e357c-ffb1-40b1-852b-51571aa5e866 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:20.147202 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a4e357c-ffb1-40b1-852b-51571aa5e866 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:20.160843 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a4e357c-ffb1-40b1-852b-51571aa5e866 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:20.161899 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a4e357c-ffb1-40b1-852b-51571aa5e866 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:20.162458 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a4e357c-ffb1-40b1-852b-51571aa5e866 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:20.809231 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1a4e357c-ffb1-40b1-852b-51571aa5e866 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:20.828865 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1a4e357c-ffb1-40b1-852b-51571aa5e866 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.729635 Oct 04 20:31:20.854583 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 67/132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:20 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:20.995540 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1e531f25-09ef-4b8a-a03d-2710d89ffe3f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:21.003870 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-1e531f25-09ef-4b8a-a03d-2710d89ffe3f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:21.045543 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1e531f25-09ef-4b8a-a03d-2710d89ffe3f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:21.060994 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1e531f25-09ef-4b8a-a03d-2710d89ffe3f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:21.063789 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1e531f25-09ef-4b8a-a03d-2710d89ffe3f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:21.066065 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1e531f25-09ef-4b8a-a03d-2710d89ffe3f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:21.067225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1e531f25-09ef-4b8a-a03d-2710d89ffe3f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:21.071116 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1e531f25-09ef-4b8a-a03d-2710d89ffe3f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:21.385202 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-64652ea8-056f-4b6e-99b7-4e787becb4e4 req-43090cad-56af-4069-85c1-db91f0e6713d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "660c3eff-854d-4e7c-8247-4a992eda69ce", "tag": "c2470e19-f860-43fa-ba0b-4b54f80cea9b"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:21.452058 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-64652ea8-056f-4b6e-99b7-4e787becb4e4 req-43090cad-56af-4069-85c1-db91f0e6713d service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:21.454397 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-64652ea8-056f-4b6e-99b7-4e787becb4e4 req-43090cad-56af-4069-85c1-db91f0e6713d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:21.454397 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-64652ea8-056f-4b6e-99b7-4e787becb4e4 req-43090cad-56af-4069-85c1-db91f0e6713d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:21.507644 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-64652ea8-056f-4b6e-99b7-4e787becb4e4 req-43090cad-56af-4069-85c1-db91f0e6713d service nova] Creating event network-changed:c2470e19-f860-43fa-ba0b-4b54f80cea9b for instance 660c3eff-854d-4e7c-8247-4a992eda69ce on n-h1-852085-12 Oct 04 20:31:21.509109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-64652ea8-056f-4b6e-99b7-4e787becb4e4 req-43090cad-56af-4069-85c1-db91f0e6713d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=123540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:31:21.510786 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-64652ea8-056f-4b6e-99b7-4e787becb4e4 req-43090cad-56af-4069-85c1-db91f0e6713d service nova] Acquired lock "compute-rpcapi-router" {{(pid=123540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:31:21.525141 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25d604d3-59ab-4570-b33a-f0b0b3e0cbb8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:21.526494 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25d604d3-59ab-4570-b33a-f0b0b3e0cbb8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:21.530061 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25d604d3-59ab-4570-b33a-f0b0b3e0cbb8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:21.532380 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25d604d3-59ab-4570-b33a-f0b0b3e0cbb8 None None] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:21.533579 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25d604d3-59ab-4570-b33a-f0b0b3e0cbb8 None None] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:21.535888 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25d604d3-59ab-4570-b33a-f0b0b3e0cbb8 None None] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:21.562350 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.compute.rpcapi [None req-25d604d3-59ab-4570-b33a-f0b0b3e0cbb8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 20:31:21.568074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25d604d3-59ab-4570-b33a-f0b0b3e0cbb8 None None] Releasing lock "compute-rpcapi-router" {{(pid=123540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:31:21.681036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-1e531f25-09ef-4b8a-a03d-2710d89ffe3f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:21.683519 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-25d604d3-59ab-4570-b33a-f0b0b3e0cbb8 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.655567 Oct 04 20:31:21.689971 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 68/133] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:21.725607 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1e531f25-09ef-4b8a-a03d-2710d89ffe3f tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1308 microversion: 2.1 time: 0.745684 Oct 04 20:31:21.726608 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 66/134] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:20 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1308 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:21.878564 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-84842fdf-a7ce-415d-8ed5-2667f8775651 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:21.882048 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-84842fdf-a7ce-415d-8ed5-2667f8775651 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:21.917806 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84842fdf-a7ce-415d-8ed5-2667f8775651 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:21.921820 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84842fdf-a7ce-415d-8ed5-2667f8775651 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:21.923242 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84842fdf-a7ce-415d-8ed5-2667f8775651 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:21.926867 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84842fdf-a7ce-415d-8ed5-2667f8775651 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:21.930270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84842fdf-a7ce-415d-8ed5-2667f8775651 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:21.932848 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84842fdf-a7ce-415d-8ed5-2667f8775651 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:22.775690 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-794754aa-0673-4597-8bd7-d1e1781022cf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:22.780401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-794754aa-0673-4597-8bd7-d1e1781022cf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:22.841757 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-794754aa-0673-4597-8bd7-d1e1781022cf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:22.846572 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-794754aa-0673-4597-8bd7-d1e1781022cf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:22.848998 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-794754aa-0673-4597-8bd7-d1e1781022cf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:22.854323 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-794754aa-0673-4597-8bd7-d1e1781022cf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:22.856657 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-794754aa-0673-4597-8bd7-d1e1781022cf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:22.862854 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-794754aa-0673-4597-8bd7-d1e1781022cf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:23.241352 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-794754aa-0673-4597-8bd7-d1e1781022cf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:23.267759 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-794754aa-0673-4597-8bd7-d1e1781022cf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1296 microversion: 2.1 time: 0.500751 Oct 04 20:31:23.271796 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 67/135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:22 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1296 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:23.443050 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=10 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:23.650929 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-84842fdf-a7ce-415d-8ed5-2667f8775651 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:23.686545 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-84842fdf-a7ce-415d-8ed5-2667f8775651 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 1.813317 Oct 04 20:31:23.694154 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 69/136] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:21 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:24.110334 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ecf75634-7fd6-4dcb-a059-b366c2b58fcd tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:24.148653 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ecf75634-7fd6-4dcb-a059-b366c2b58fcd tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.728595 Oct 04 20:31:24.148653 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 68/137] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:31:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:24.321788 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3e5e78f3-82be-414a-81ed-b6d001e4eb53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:24.329901 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3e5e78f3-82be-414a-81ed-b6d001e4eb53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:24.411829 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3e5e78f3-82be-414a-81ed-b6d001e4eb53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:24.413708 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3e5e78f3-82be-414a-81ed-b6d001e4eb53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:24.416260 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3e5e78f3-82be-414a-81ed-b6d001e4eb53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:24.444096 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3e5e78f3-82be-414a-81ed-b6d001e4eb53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:24.444096 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3e5e78f3-82be-414a-81ed-b6d001e4eb53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:24.444096 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3e5e78f3-82be-414a-81ed-b6d001e4eb53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:24.925317 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3e5e78f3-82be-414a-81ed-b6d001e4eb53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:24.944924 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cee8922f-0d0e-4d49-96d4-67b020a59287 tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-354664351", "id": 2125771493, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:24.960325 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3e5e78f3-82be-414a-81ed-b6d001e4eb53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1296 microversion: 2.1 time: 0.648576 Oct 04 20:31:24.976122 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 69/138] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:24 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1296 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:25.014771 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-be02454e-e8dc-4c80-adf6-0194857d62cb tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:25.018907 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-be02454e-e8dc-4c80-adf6-0194857d62cb tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:25.045434 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-be02454e-e8dc-4c80-adf6-0194857d62cb tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:25.045988 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-be02454e-e8dc-4c80-adf6-0194857d62cb tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:25.046437 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-be02454e-e8dc-4c80-adf6-0194857d62cb tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:25.047230 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-be02454e-e8dc-4c80-adf6-0194857d62cb tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:25.047836 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-be02454e-e8dc-4c80-adf6-0194857d62cb tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:25.048276 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-be02454e-e8dc-4c80-adf6-0194857d62cb tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:25.152592 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cee8922f-0d0e-4d49-96d4-67b020a59287 tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.981508 Oct 04 20:31:25.157548 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 70/139] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:24 2022] POST /compute/v2.1/flavors => generated 424 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:25.180190 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d226c58f-9409-43bf-8187-0c5f958924db tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:25.218498 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d226c58f-9409-43bf-8187-0c5f958924db tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.039819 Oct 04 20:31:25.221862 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 71/140] 10.222.0.78 () {58 vars in 1182 bytes} [Tue Oct 4 20:31:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:31:25.252169 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bc7f29e8-0a46-4877-8260-72340cbefec6 tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-727021855", "id": 1931910749, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:25.439215 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bc7f29e8-0a46-4877-8260-72340cbefec6 tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.208833 Oct 04 20:31:25.445724 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 72/141] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:25 2022] POST /compute/v2.1/flavors => generated 424 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:25.469994 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-df1b7436-74ee-4c98-a4e7-4fc78e811095 tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:25.501657 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-df1b7436-74ee-4c98-a4e7-4fc78e811095 tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040611 Oct 04 20:31:25.508185 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 73/142] 10.222.0.78 () {58 vars in 1182 bytes} [Tue Oct 4 20:31:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:31:25.648516 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-be02454e-e8dc-4c80-adf6-0194857d62cb tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:25.659566 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=77 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:25.674574 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-be02454e-e8dc-4c80-adf6-0194857d62cb tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.695070 Oct 04 20:31:25.677933 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 70/143] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:24 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:25.695338 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6fcab200-1afa-4999-a87c-e4ca06df4c32 tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] Action: 'create', calling method: .version_select at 0x7f77efc759d0>, body: {"keypair": {"name": "tempest-keypair-1076763719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7KYIyOGvI/FEq496U1AADoFHezgjg+xCt1S4XM+ICip4NHbdIadituvHa0552145y3or8RLSi0F9pj/Sm+UmNj10lzI8HezZv8GyK4sHQBRlidbYoVM3db2z1TVSnxXQ=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:25.751045 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=19 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:25.756623 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-6fcab200-1afa-4999-a87c-e4ca06df4c32 tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] Getting quotas for project d593ded97dc34546bfe79cdbdac0d4c2. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:31:25.772235 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-6fcab200-1afa-4999-a87c-e4ca06df4c32 tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] Getting quotas for user 9baf3883d6ac4328bf3aa9ffaaa48b4f and project d593ded97dc34546bfe79cdbdac0d4c2. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:31:25.918086 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6fcab200-1afa-4999-a87c-e4ca06df4c32 tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.240338 Oct 04 20:31:25.919657 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 71/144] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:31:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:26.008740 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d2a7412f-64d0-4b9a-8f4f-75de4b939072 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:26.011425 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d2a7412f-64d0-4b9a-8f4f-75de4b939072 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:26.039037 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d2a7412f-64d0-4b9a-8f4f-75de4b939072 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:26.043969 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d2a7412f-64d0-4b9a-8f4f-75de4b939072 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:26.052941 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d2a7412f-64d0-4b9a-8f4f-75de4b939072 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:26.052941 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d2a7412f-64d0-4b9a-8f4f-75de4b939072 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:26.052941 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d2a7412f-64d0-4b9a-8f4f-75de4b939072 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:26.052941 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d2a7412f-64d0-4b9a-8f4f-75de4b939072 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:26.801979 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-acf752c9-fa96-49d0-b99a-595925f743b9 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-309710834", "id": 758201649, "os-flavor-access:is_public": "False"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:26.963908 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-acf752c9-fa96-49d0-b99a-595925f743b9 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 1.452911 Oct 04 20:31:26.968016 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 74/145] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:25 2022] POST /compute/v2.1/flavors => generated 435 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:26.976024 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9323cdfe-e16c-44f3-a51e-d0f54e24a363 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:26.977085 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9323cdfe-e16c-44f3-a51e-d0f54e24a363 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:27.001344 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9323cdfe-e16c-44f3-a51e-d0f54e24a363 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:27.006664 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9323cdfe-e16c-44f3-a51e-d0f54e24a363 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:27.010513 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9323cdfe-e16c-44f3-a51e-d0f54e24a363 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:27.012170 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9323cdfe-e16c-44f3-a51e-d0f54e24a363 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:27.013259 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9323cdfe-e16c-44f3-a51e-d0f54e24a363 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:27.014000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9323cdfe-e16c-44f3-a51e-d0f54e24a363 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:27.050879 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d2a7412f-64d0-4b9a-8f4f-75de4b939072 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:27.081678 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d2a7412f-64d0-4b9a-8f4f-75de4b939072 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1338 microversion: 2.1 time: 1.080595 Oct 04 20:31:27.095982 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 72/146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:25 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1338 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:27.106449 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=73 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:27.125929 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-797be428-b74a-474a-ad94-7e46ad88176c tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "98c71e3ed7854c4c82df7a4a34375b74"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:27.232409 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:27.786296 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9323cdfe-e16c-44f3-a51e-d0f54e24a363 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:27.801996 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9323cdfe-e16c-44f3-a51e-d0f54e24a363 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.830886 Oct 04 20:31:27.805485 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 75/147] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:26 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:28.163493 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-94372bad-a9d4-4460-8beb-d59fb93ffe26 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:28.169408 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-94372bad-a9d4-4460-8beb-d59fb93ffe26 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:28.197471 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-94372bad-a9d4-4460-8beb-d59fb93ffe26 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:28.199176 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-94372bad-a9d4-4460-8beb-d59fb93ffe26 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:28.201154 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-94372bad-a9d4-4460-8beb-d59fb93ffe26 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:28.203632 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-94372bad-a9d4-4460-8beb-d59fb93ffe26 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:28.204576 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-94372bad-a9d4-4460-8beb-d59fb93ffe26 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:28.207577 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-94372bad-a9d4-4460-8beb-d59fb93ffe26 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:28.632855 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-797be428-b74a-474a-ad94-7e46ad88176c tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/758201649/action" status: 200 len: 96 microversion: 2.1 time: 1.514864 Oct 04 20:31:28.638324 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 73/148] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Oct 4 20:31:27 2022] POST /compute/v2.1/flavors/758201649/action => generated 96 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:28.665271 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-25342c63-c3dd-4c29-9e11-f090254dc988 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "98c71e3ed7854c4c82df7a4a34375b74"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:29.483548 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-94372bad-a9d4-4460-8beb-d59fb93ffe26 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:29.791637 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-94372bad-a9d4-4460-8beb-d59fb93ffe26 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1338 microversion: 2.1 time: 1.376810 Oct 04 20:31:29.791637 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 76/149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:28 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1338 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:29.791637 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-77f6dfef-1071-45a1-898a-928fb5abb808 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:29.791637 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-77f6dfef-1071-45a1-898a-928fb5abb808 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:29.791637 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-77f6dfef-1071-45a1-898a-928fb5abb808 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:29.792705 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-77f6dfef-1071-45a1-898a-928fb5abb808 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:29.792705 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-77f6dfef-1071-45a1-898a-928fb5abb808 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:29.792705 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-77f6dfef-1071-45a1-898a-928fb5abb808 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:29.792705 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-77f6dfef-1071-45a1-898a-928fb5abb808 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:29.793602 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-77f6dfef-1071-45a1-898a-928fb5abb808 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:29.937020 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-77f6dfef-1071-45a1-898a-928fb5abb808 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:29.951953 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-77f6dfef-1071-45a1-898a-928fb5abb808 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.441069 Oct 04 20:31:29.963935 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 77/150] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:29 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:29.977219 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-25342c63-c3dd-4c29-9e11-f090254dc988 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] HTTP exception thrown: Flavor access already exists for flavor 30 and project 98c71e3ed7854c4c82df7a4a34375b74 combination. Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-25342c63-c3dd-4c29-9e11-f090254dc988 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Request method failure captured: Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/flavors/758201649/action HTTP/1.1 Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 67 Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgawYQdyomfJmV30Xu4QeYVl2CULBt582t4Fc8d2i4rLPvD1h-xCbpRRfgFwDhcoUutimtEEOtQ3Q6f9y8Re9QlEKvxiLu1FtKOG4inxCT8DqgSlZ1PQkrV7ynhxn4KrbfzGpdhtKhRUNAb_fiKbZ2utO91SkscLOpsEPSjz_sTclg Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 7ed4ed8d04654505aab32609420b930e Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1287260464 Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:29.982402 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:29.984201 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7ed4ed8d04654505aab32609420b930e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ed4ed8d04654505aab32609420b930e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ed4ed8d04654505aab32609420b930e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7ed4ed8d04654505aab32609420b930e"}]}] Oct 04 20:31:29.984201 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1287260464 Oct 04 20:31:29.984201 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 7ed4ed8d04654505aab32609420b930e Oct 04 20:31:29.984201 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1287260464 Oct 04 20:31:29.984201 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin Oct 04 20:31:29.984201 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:29.984201 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:29.984201 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 282befeaa1a94c40a9bba4f8d5441677 Oct 04 20:31:29.984201 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin Oct 04 20:31:29.984201 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:29.984201 n-d-852085-12 devstack@n-api.service[123539]: {"addTenantAccess": {"tenant": "98c71e3ed7854c4c82df7a4a34375b74"}} Oct 04 20:31:29.984201 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: exception: Flavor access already exists for flavor 30 and project 98c71e3ed7854c4c82df7a4a34375b74 combination. Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '758201649', 'body': {'addTenantAccess': {'tenant': '98c71e3ed7854c4c82df7a4a34375b74'}}} Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:31:29.984973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '30-98c71e3ed7854c4c82df7a4a34375b74' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:31:29.986218 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:31:29.987875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:31:29.988899 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '30-98c71e3ed7854c4c82df7a4a34375b74' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 20, 31, 29, 480607), 'updated_at': None, 'flavor_id': 30, 'project_id': '98c71e3ed7854c4c82df7a4a34375b74'}] Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:29.989896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 30 and project 98c71e3ed7854c4c82df7a4a34375b74 combination. Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:29.990769 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 30 and project 98c71e3ed7854c4c82df7a4a34375b74 combination. Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:29.991935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:29.993069 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 30 and project 98c71e3ed7854c4c82df7a4a34375b74 combination. Oct 04 20:31:29.993069 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:29.994418 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-25342c63-c3dd-4c29-9e11-f090254dc988 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Returning 409 to user: Flavor access already exists for flavor 30 and project 98c71e3ed7854c4c82df7a4a34375b74 combination. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:30.050472 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-25342c63-c3dd-4c29-9e11-f090254dc988 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/758201649/action" status: 409 len: 152 microversion: 2.1 time: 1.349219 Oct 04 20:31:30.050472 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 74/151] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Oct 4 20:31:28 2022] POST /compute/v2.1/flavors/758201649/action => generated 152 bytes in 1351 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:31:30.156543 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f996095a-fb49-4812-9dec-5bd7b2f9274e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "98c71e3ed7854c4c82df7a4a34375b74"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:30.215013 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-261b7da2-18cc-4593-bf2c-879bf61b7f68 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1198241159", "ram": 512, "vcpus": 1, "disk": 10, "id": 696158163, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:31.059940 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-261b7da2-18cc-4593-bf2c-879bf61b7f68 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.077736 Oct 04 20:31:31.060645 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 78/152] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:29 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:31.067781 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-543a036e-5d05-4b04-abb0-4b7eaf220b53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:31.068735 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-543a036e-5d05-4b04-abb0-4b7eaf220b53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:31.089015 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-543a036e-5d05-4b04-abb0-4b7eaf220b53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:31.090735 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-543a036e-5d05-4b04-abb0-4b7eaf220b53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:31.091859 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-543a036e-5d05-4b04-abb0-4b7eaf220b53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:31.094514 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-543a036e-5d05-4b04-abb0-4b7eaf220b53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:31.096845 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-543a036e-5d05-4b04-abb0-4b7eaf220b53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:31.098592 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-543a036e-5d05-4b04-abb0-4b7eaf220b53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:31.116137 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f996095a-fb49-4812-9dec-5bd7b2f9274e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/758201649/action" status: 200 len: 21 microversion: 2.1 time: 0.982344 Oct 04 20:31:31.124165 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 75/153] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Oct 4 20:31:30 2022] POST /compute/v2.1/flavors/758201649/action => generated 21 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:31:31.129268 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f93f3b24-b4ac-4fb5-8af6-2770c2334e53 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:31.129847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f93f3b24-b4ac-4fb5-8af6-2770c2334e53 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:31.151481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f93f3b24-b4ac-4fb5-8af6-2770c2334e53 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:31.156293 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f93f3b24-b4ac-4fb5-8af6-2770c2334e53 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:31.157994 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f93f3b24-b4ac-4fb5-8af6-2770c2334e53 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:31.159203 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f93f3b24-b4ac-4fb5-8af6-2770c2334e53 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:31.160233 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f93f3b24-b4ac-4fb5-8af6-2770c2334e53 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:31.163478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f93f3b24-b4ac-4fb5-8af6-2770c2334e53 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:31.412344 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-543a036e-5d05-4b04-abb0-4b7eaf220b53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:31.428546 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-543a036e-5d05-4b04-abb0-4b7eaf220b53 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1338 microversion: 2.1 time: 0.365143 Oct 04 20:31:31.437891 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 79/154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:31 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1338 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:31.454422 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f93f3b24-b4ac-4fb5-8af6-2770c2334e53 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:31.499643 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f93f3b24-b4ac-4fb5-8af6-2770c2334e53 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.372887 Oct 04 20:31:31.527265 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 76/155] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:31 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:31.537141 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7656adfd-829c-4e23-91d7-a0a588bf2693 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:31.555455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:31.673429 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7656adfd-829c-4e23-91d7-a0a588bf2693 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/758201649" status: 202 len: 0 microversion: 2.1 time: 0.142713 Oct 04 20:31:31.689355 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 77/156] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:31 2022] DELETE /compute/v2.1/flavors/758201649 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:31.697233 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d7bdb001-1e53-48fc-a010-eb4641a0f89a tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:31.770130 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a2ac1933-83d7-411d-a09b-0e96e0f330b6 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:31.782703 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d7bdb001-1e53-48fc-a010-eb4641a0f89a tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6222 microversion: 2.1 time: 0.090757 Oct 04 20:31:31.789307 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-a2ac1933-83d7-411d-a09b-0e96e0f330b6 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] HTTP exception thrown: Flavor 696158163 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:31:31.790815 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 78/157] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:31 2022] GET /compute/v2.1/flavors/detail => generated 6222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a2ac1933-83d7-411d-a09b-0e96e0f330b6 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Request method failure captured: Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/flavors/696158163/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgcxhwG_bSEY0eYLtPalX_V-tV4FjBl5-zHWXMEiDsmB_BWaYJHzScqlzn5nKR240--zPa-QykdarGXaaCwkF27MRCMmdKQamzZ6AED75Kp9scIjBjOZ6c5WYRylaXYLY1XsE9ODkPIBm0kUe4i566K9FH_DE80ZRtOxvsWIlmM1k8 Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: d5e1a6ff56a04eb894224826f792e6bf Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:31.792617 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:31.803526 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d5e1a6ff56a04eb894224826f792e6bf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d5e1a6ff56a04eb894224826f792e6bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d5e1a6ff56a04eb894224826f792e6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d5e1a6ff56a04eb894224826f792e6bf"}]}] Oct 04 20:31:31.803526 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 Oct 04 20:31:31.803526 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: d5e1a6ff56a04eb894224826f792e6bf Oct 04 20:31:31.803526 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 Oct 04 20:31:31.803526 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project Oct 04 20:31:31.803526 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:31.803526 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:31.803526 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 3b681070354e428580e1ff15c29995ac Oct 04 20:31:31.803526 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project Oct 04 20:31:31.803526 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:31.803526 n-d-852085-12 devstack@n-api.service[123540]: exception: Flavor 696158163 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'flavor_id': '696158163', 'id': 'hw:cpu_thread_policy'} Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 696158163 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:31.804494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:31.808084 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:31.808084 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:31.808084 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:31.808084 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:31.808084 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:31.808084 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 696158163 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:31:31.808084 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:31.808084 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a2ac1933-83d7-411d-a09b-0e96e0f330b6 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Returning 404 to user: Flavor 696158163 has no extra specs with key hw:cpu_thread_policy. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:31.808084 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a2ac1933-83d7-411d-a09b-0e96e0f330b6 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] 10.222.0.78 "GET /compute/v2.1/flavors/696158163/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.350489 Oct 04 20:31:31.808084 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 80/158] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:31:31 2022] GET /compute/v2.1/flavors/696158163/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:31.825798 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e97a96a7-c1cc-4e1e-8573-76a68f9c7081 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:31.831477 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c4ca3e44-e552-4e39-81cd-3781f14a591b tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1930616328", "id": 278262188, "os-flavor-access:is_public": "True"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:31.841695 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e97a96a7-c1cc-4e1e-8573-76a68f9c7081 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '3b681070354e428580e1ff15c29995ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e1a6ff56a04eb894224826f792e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e97a96a7-c1cc-4e1e-8573-76a68f9c7081 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Request method failure captured: Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/flavors/696158163/os-extra_specs HTTP/1.1 Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 66 Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgcxhwG_bSEY0eYLtPalX_V-tV4FjBl5-zHWXMEiDsmB_BWaYJHzScqlzn5nKR240--zPa-QykdarGXaaCwkF27MRCMmdKQamzZ6AED75Kp9scIjBjOZ6c5WYRylaXYLY1XsE9ODkPIBm0kUe4i566K9FH_DE80ZRtOxvsWIlmM1k8 Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: d5e1a6ff56a04eb894224826f792e6bf Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:31.859416 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:31.861061 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d5e1a6ff56a04eb894224826f792e6bf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d5e1a6ff56a04eb894224826f792e6bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d5e1a6ff56a04eb894224826f792e6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d5e1a6ff56a04eb894224826f792e6bf"}]}] Oct 04 20:31:31.861061 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 Oct 04 20:31:31.861061 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: d5e1a6ff56a04eb894224826f792e6bf Oct 04 20:31:31.861061 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 Oct 04 20:31:31.861061 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project Oct 04 20:31:31.861061 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:31.861061 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:31.861061 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 3b681070354e428580e1ff15c29995ac Oct 04 20:31:31.861061 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project Oct 04 20:31:31.861061 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:31:31.861061 n-d-852085-12 devstack@n-api.service[123540]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 04 20:31:31.861061 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'flavor_id': '696158163', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:31.861823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 20:31:31.863164 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:31.864758 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e97a96a7-c1cc-4e1e-8573-76a68f9c7081 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:31.864758 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e97a96a7-c1cc-4e1e-8573-76a68f9c7081 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] 10.222.0.78 "POST /compute/v2.1/flavors/696158163/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.037857 Oct 04 20:31:31.864758 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 81/159] 10.222.0.78 () {60 vars in 1221 bytes} [Tue Oct 4 20:31:31 2022] POST /compute/v2.1/flavors/696158163/os-extra_specs => generated 124 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:32.008343 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-ade75bc8-e55a-4bc3-8757-71847fecd07c req-2f6efc38-c6ee-40ce-b3bd-056c21281e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0867584d-2285-41b4-b1b9-0af13aa79dc1", "tag": "33c37c69-333d-405a-a27c-efb298d34226"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:32.029011 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-ade75bc8-e55a-4bc3-8757-71847fecd07c req-2f6efc38-c6ee-40ce-b3bd-056c21281e70 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:32.029860 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-ade75bc8-e55a-4bc3-8757-71847fecd07c req-2f6efc38-c6ee-40ce-b3bd-056c21281e70 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:32.031379 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-ade75bc8-e55a-4bc3-8757-71847fecd07c req-2f6efc38-c6ee-40ce-b3bd-056c21281e70 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:32.041298 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=7,nova_api:INSERT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:32.049000 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c4ca3e44-e552-4e39-81cd-3781f14a591b tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.229944 Oct 04 20:31:32.092177 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 79/160] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:31 2022] POST /compute/v2.1/flavors => generated 435 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:32.092177 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b058c72a-2d56-4157-bbba-90000461758c tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:32.092606 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-ade75bc8-e55a-4bc3-8757-71847fecd07c req-2f6efc38-c6ee-40ce-b3bd-056c21281e70 service nova] Creating event network-changed:33c37c69-333d-405a-a27c-efb298d34226 for instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 on n-h1-852085-12 Oct 04 20:31:32.092606 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-ade75bc8-e55a-4bc3-8757-71847fecd07c req-2f6efc38-c6ee-40ce-b3bd-056c21281e70 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213188 Oct 04 20:31:32.092606 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 82/161] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:32.116405 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-135817bd-ff97-4a46-90d8-4bdfe16d356b tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:32.132623 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-135817bd-ff97-4a46-90d8-4bdfe16d356b tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-135817bd-ff97-4a46-90d8-4bdfe16d356b tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Request method failure captured: Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/flavors/278262188/os-flavor-access HTTP/1.1 Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgawYQdyomfJmV30Xu4QeYVl2CULBt582t4Fc8d2i4rLPvD1h-xCbpRRfgFwDhcoUutimtEEOtQ3Q6f9y8Re9QlEKvxiLu1FtKOG4inxCT8DqgSlZ1PQkrV7ynhxn4KrbfzGpdhtKhRUNAb_fiKbZ2utO91SkscLOpsEPSjz_sTclg Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 7ed4ed8d04654505aab32609420b930e Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1287260464 Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:31:32.141090 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:31:32.143623 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7ed4ed8d04654505aab32609420b930e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ed4ed8d04654505aab32609420b930e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ed4ed8d04654505aab32609420b930e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7ed4ed8d04654505aab32609420b930e"}]}] Oct 04 20:31:32.143623 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1287260464 Oct 04 20:31:32.143623 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 7ed4ed8d04654505aab32609420b930e Oct 04 20:31:32.143623 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1287260464 Oct 04 20:31:32.143623 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin Oct 04 20:31:32.143623 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:32.143623 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:32.143623 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 282befeaa1a94c40a9bba4f8d5441677 Oct 04 20:31:32.143623 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin Oct 04 20:31:32.143623 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:32.143623 n-d-852085-12 devstack@n-api.service[123540]: exception: Access list not available for public flavors. Oct 04 20:31:32.143623 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'flavor_id': '278262188'} Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 04 20:31:32.145066 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.178623 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-135817bd-ff97-4a46-90d8-4bdfe16d356b tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:32.178623 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-135817bd-ff97-4a46-90d8-4bdfe16d356b tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/278262188/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.043083 Oct 04 20:31:32.178623 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 83/162] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 4 20:31:32 2022] GET /compute/v2.1/flavors/278262188/os-flavor-access => generated 91 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:31:32.193435 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6ebf933a-7e11-47d1-a543-6be02634ccec tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:32.218509 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:32.286803 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b058c72a-2d56-4157-bbba-90000461758c tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/696158163/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.234005 Oct 04 20:31:32.286803 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 80/163] 10.222.0.78 () {60 vars in 1221 bytes} [Tue Oct 4 20:31:32 2022] POST /compute/v2.1/flavors/696158163/os-extra_specs => generated 66 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:32.300292 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-677f2fce-33b2-4be9-9cab-69b9d124116b tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:32.303558 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-677f2fce-33b2-4be9-9cab-69b9d124116b tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '3b681070354e428580e1ff15c29995ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e1a6ff56a04eb894224826f792e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-677f2fce-33b2-4be9-9cab-69b9d124116b tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Request method failure captured: Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/flavors/696158163/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgcxhwG_bSEY0eYLtPalX_V-tV4FjBl5-zHWXMEiDsmB_BWaYJHzScqlzn5nKR240--zPa-QykdarGXaaCwkF27MRCMmdKQamzZ6AED75Kp9scIjBjOZ6c5WYRylaXYLY1XsE9ODkPIBm0kUe4i566K9FH_DE80ZRtOxvsWIlmM1k8 Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: d5e1a6ff56a04eb894224826f792e6bf Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:31:32.307001 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:31:32.310219 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d5e1a6ff56a04eb894224826f792e6bf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d5e1a6ff56a04eb894224826f792e6bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d5e1a6ff56a04eb894224826f792e6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d5e1a6ff56a04eb894224826f792e6bf"}]}] Oct 04 20:31:32.310219 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 Oct 04 20:31:32.310219 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: d5e1a6ff56a04eb894224826f792e6bf Oct 04 20:31:32.310219 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 Oct 04 20:31:32.310219 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project Oct 04 20:31:32.310219 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:32.310219 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:32.310219 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 3b681070354e428580e1ff15c29995ac Oct 04 20:31:32.310219 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project Oct 04 20:31:32.310219 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:32.310219 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'flavor_id': '696158163', 'id': 'hw:numa_nodes'} Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:32.318150 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.320677 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-677f2fce-33b2-4be9-9cab-69b9d124116b tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:32.322567 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-677f2fce-33b2-4be9-9cab-69b9d124116b tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] 10.222.0.78 "DELETE /compute/v2.1/flavors/696158163/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015059 Oct 04 20:31:32.322567 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 81/164] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:31:32 2022] DELETE /compute/v2.1/flavors/696158163/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:31:32.325884 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ea871c7c-84c6-4758-8868-193ad0891888 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:32.385513 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ea871c7c-84c6-4758-8868-193ad0891888 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/696158163/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066474 Oct 04 20:31:32.387380 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 82/165] 10.222.0.78 () {60 vars in 1221 bytes} [Tue Oct 4 20:31:32 2022] POST /compute/v2.1/flavors/696158163/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:31:32.411517 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5fb14b6a-30e9-4608-ac3f-4e5b48973f90 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:32.419388 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5fb14b6a-30e9-4608-ac3f-4e5b48973f90 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '3b681070354e428580e1ff15c29995ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e1a6ff56a04eb894224826f792e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5fb14b6a-30e9-4608-ac3f-4e5b48973f90 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Request method failure captured: Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: request: PUT /compute/v2.1/flavors/696158163/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 22 Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgcxhwG_bSEY0eYLtPalX_V-tV4FjBl5-zHWXMEiDsmB_BWaYJHzScqlzn5nKR240--zPa-QykdarGXaaCwkF27MRCMmdKQamzZ6AED75Kp9scIjBjOZ6c5WYRylaXYLY1XsE9ODkPIBm0kUe4i566K9FH_DE80ZRtOxvsWIlmM1k8 Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: d5e1a6ff56a04eb894224826f792e6bf Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:31:32.423350 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d5e1a6ff56a04eb894224826f792e6bf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d5e1a6ff56a04eb894224826f792e6bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d5e1a6ff56a04eb894224826f792e6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d5e1a6ff56a04eb894224826f792e6bf"}]}] Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: d5e1a6ff56a04eb894224826f792e6bf Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 3b681070354e428580e1ff15c29995ac Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: {"hw:numa_nodes": "1"} Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:32.425629 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'flavor_id': '696158163', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:32.426576 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 20:31:32.429345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.432689 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5fb14b6a-30e9-4608-ac3f-4e5b48973f90 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:32.432689 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5fb14b6a-30e9-4608-ac3f-4e5b48973f90 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313 tempest-FlavorsExtraSpecsNegativeTestJSON-296875313-project] 10.222.0.78 "PUT /compute/v2.1/flavors/696158163/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.029092 Oct 04 20:31:32.433839 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 83/166] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:31:32 2022] PUT /compute/v2.1/flavors/696158163/os-extra_specs/hw:numa_nodes => generated 124 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:31:32.444863 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6ebf933a-7e11-47d1-a543-6be02634ccec tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/278262188" status: 202 len: 0 microversion: 2.1 time: 0.261359 Oct 04 20:31:32.445533 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 84/167] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:32 2022] DELETE /compute/v2.1/flavors/278262188 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:32.458098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-77e5768d-a4a0-4dda-96a4-180d13baaa71 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:32.461593 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dbb4a255-ebeb-4ae1-95cc-879b74a325b5 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:32.480778 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-77e5768d-a4a0-4dda-96a4-180d13baaa71 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] HTTP exception thrown: Flavor 696158163 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-77e5768d-a4a0-4dda-96a4-180d13baaa71 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Request method failure captured: Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/flavors/696158163/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJghlaqcE7qHDIw2QNlCqyBn40TScy-oQI3_-bghAxHEL3Mdw9E-F3DaFFrOpYdrAVJtqZinth5y-R1rdCnFjVrN5fPBR3izZDUXZJbTtUrXFmBrgUu1s7HO2mp6fGnsTSAEvgX6aP9Y5Z0fN6LFNf2Z4zGsiwVpVSAX2S9_NFmq2wE Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 9055bcef5eaa491cbec9b0283ee1ec58 Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:32.491723 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:32.494495 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9055bcef5eaa491cbec9b0283ee1ec58", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9055bcef5eaa491cbec9b0283ee1ec58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9055bcef5eaa491cbec9b0283ee1ec58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9055bcef5eaa491cbec9b0283ee1ec58"}]}] Oct 04 20:31:32.494495 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 Oct 04 20:31:32.494495 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 9055bcef5eaa491cbec9b0283ee1ec58 Oct 04 20:31:32.494495 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 Oct 04 20:31:32.494495 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin Oct 04 20:31:32.494495 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:32.494495 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:32.494495 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 6b8add2d3f284861ba56957a35079b50 Oct 04 20:31:32.494495 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin Oct 04 20:31:32.494495 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:32.494495 n-d-852085-12 devstack@n-api.service[123539]: exception: Flavor 696158163 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'flavor_id': '696158163', 'id': 'hw:cpu_thread_policy'} Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 696158163 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:32.495918 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.498892 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.498892 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:32.498892 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:32.498892 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:32.498892 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:32.498892 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 696158163 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:31:32.498892 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.498892 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-77e5768d-a4a0-4dda-96a4-180d13baaa71 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Returning 404 to user: Flavor 696158163 has no extra specs with key hw:cpu_thread_policy. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:32.498892 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-77e5768d-a4a0-4dda-96a4-180d13baaa71 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/696158163/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.052750 Oct 04 20:31:32.503029 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 84/168] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:31:32 2022] DELETE /compute/v2.1/flavors/696158163/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:31:32.510079 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-dbb4a255-ebeb-4ae1-95cc-879b74a325b5 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6222 microversion: 2.1 time: 0.053859 Oct 04 20:31:32.511359 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 85/169] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:32 2022] GET /compute/v2.1/flavors/detail => generated 6222 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:32.518031 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-efb7b05c-464a-46b2-b2a9-2a0cbbe492a2 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:32.521642 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-efb7b05c-464a-46b2-b2a9-2a0cbbe492a2 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-efb7b05c-464a-46b2-b2a9-2a0cbbe492a2 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Request method failure captured: Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: request: PUT /compute/v2.1/flavors/696158163/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 27 Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJghlaqcE7qHDIw2QNlCqyBn40TScy-oQI3_-bghAxHEL3Mdw9E-F3DaFFrOpYdrAVJtqZinth5y-R1rdCnFjVrN5fPBR3izZDUXZJbTtUrXFmBrgUu1s7HO2mp6fGnsTSAEvgX6aP9Y5Z0fN6LFNf2Z4zGsiwVpVSAX2S9_NFmq2wE Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 9055bcef5eaa491cbec9b0283ee1ec58 Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:31:32.523080 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9055bcef5eaa491cbec9b0283ee1ec58", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9055bcef5eaa491cbec9b0283ee1ec58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9055bcef5eaa491cbec9b0283ee1ec58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9055bcef5eaa491cbec9b0283ee1ec58"}]}] Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 9055bcef5eaa491cbec9b0283ee1ec58 Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 6b8add2d3f284861ba56957a35079b50 Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: {"hw:cpu_policy": "shared"} Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:32.525622 n-d-852085-12 devstack@n-api.service[123540]: exception: Request body and URI mismatch Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'flavor_id': '696158163', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:32.527625 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:32.530132 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:32.530132 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:32.530132 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 04 20:31:32.530132 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.530132 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-efb7b05c-464a-46b2-b2a9-2a0cbbe492a2 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:32.530132 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-efb7b05c-464a-46b2-b2a9-2a0cbbe492a2 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/696158163/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.012882 Oct 04 20:31:32.530132 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 86/170] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:31:32 2022] PUT /compute/v2.1/flavors/696158163/os-extra_specs/hw:numa_nodes => generated 73 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:32.533974 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b1b8945b-2a27-4fe0-98f6-cb1954dad315 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:32.536256 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b1b8945b-2a27-4fe0-98f6-cb1954dad315 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:32.547272 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b1b8945b-2a27-4fe0-98f6-cb1954dad315 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:32.548497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b1b8945b-2a27-4fe0-98f6-cb1954dad315 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:32.550255 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b1b8945b-2a27-4fe0-98f6-cb1954dad315 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:32.551544 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b1b8945b-2a27-4fe0-98f6-cb1954dad315 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:32.552465 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b1b8945b-2a27-4fe0-98f6-cb1954dad315 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:32.553245 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b1b8945b-2a27-4fe0-98f6-cb1954dad315 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:32.557846 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5558aadc-fd46-4f9e-8e56-6b65219f6f75 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5558aadc-fd46-4f9e-8e56-6b65219f6f75 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Request method failure captured: Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: request: PUT /compute/v2.1/flavors/696158163/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 49 Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJghlaqcE7qHDIw2QNlCqyBn40TScy-oQI3_-bghAxHEL3Mdw9E-F3DaFFrOpYdrAVJtqZinth5y-R1rdCnFjVrN5fPBR3izZDUXZJbTtUrXFmBrgUu1s7HO2mp6fGnsTSAEvgX6aP9Y5Z0fN6LFNf2Z4zGsiwVpVSAX2S9_NFmq2wE Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 9055bcef5eaa491cbec9b0283ee1ec58 Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:31:32.591409 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:31:32.593805 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9055bcef5eaa491cbec9b0283ee1ec58", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9055bcef5eaa491cbec9b0283ee1ec58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9055bcef5eaa491cbec9b0283ee1ec58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9055bcef5eaa491cbec9b0283ee1ec58"}]}] Oct 04 20:31:32.593805 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 Oct 04 20:31:32.593805 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 9055bcef5eaa491cbec9b0283ee1ec58 Oct 04 20:31:32.593805 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 Oct 04 20:31:32.593805 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin Oct 04 20:31:32.593805 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:32.593805 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:32.593805 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 6b8add2d3f284861ba56957a35079b50 Oct 04 20:31:32.593805 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin Oct 04 20:31:32.593805 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:31:32.593805 n-d-852085-12 devstack@n-api.service[123540]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 04 20:31:32.593805 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'flavor_id': '696158163', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi On instance: Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 04 20:31:32.595412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.608945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:32.612872 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:32.612872 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:32.612872 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:31:32.612872 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:31:32.612872 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 20:31:32.612872 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:32.612872 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5558aadc-fd46-4f9e-8e56-6b65219f6f75 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:32.612872 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5558aadc-fd46-4f9e-8e56-6b65219f6f75 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/696158163/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.063731 Oct 04 20:31:32.623423 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 87/171] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:31:32 2022] PUT /compute/v2.1/flavors/696158163/os-extra_specs/hw:numa_nodes => generated 117 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:31:32.646094 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cd769845-4d3f-4a5e-9651-92618f376db3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:32.648848 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-cd769845-4d3f-4a5e-9651-92618f376db3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:32.664418 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cd769845-4d3f-4a5e-9651-92618f376db3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:32.665489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cd769845-4d3f-4a5e-9651-92618f376db3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:32.666481 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cd769845-4d3f-4a5e-9651-92618f376db3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:32.667802 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cd769845-4d3f-4a5e-9651-92618f376db3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:32.670019 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cd769845-4d3f-4a5e-9651-92618f376db3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:32.671043 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cd769845-4d3f-4a5e-9651-92618f376db3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:33.095209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b1b8945b-2a27-4fe0-98f6-cb1954dad315 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:33.106372 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b1b8945b-2a27-4fe0-98f6-cb1954dad315 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1338 microversion: 2.1 time: 0.601347 Oct 04 20:31:33.107087 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 85/172] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:32 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1338 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:33.108376 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-cd769845-4d3f-4a5e-9651-92618f376db3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:33.115311 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-61d43037-5ad8-4015-a6a7-6c809ea867bf tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1581295082", "id": 1179020257, "os-flavor-access:is_public": "False"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:33.126419 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cd769845-4d3f-4a5e-9651-92618f376db3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.499538 Oct 04 20:31:33.127607 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 88/173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:32 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:33.136603 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0985bec5-db85-416d-8e94-7eba56113c6e tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:33.292545 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-61d43037-5ad8-4015-a6a7-6c809ea867bf tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.184033 Oct 04 20:31:33.293456 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 86/174] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:33 2022] POST /compute/v2.1/flavors => generated 439 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:33.300173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6eaeef77-718f-4c67-9835-569f142aa71c tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-72545084", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "1931910749", "adminPass": "***", "networks": [{"uuid": "3268ebe1-14f5-4073-a00b-b92c6317fabf"}], "security_groups": [{"name": "tempest-securitygroup--2041211526"}], "key_name": "tempest-keypair-1076763719", "user_data": "}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:33.350396 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0985bec5-db85-416d-8e94-7eba56113c6e tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/696158163" status: 202 len: 0 microversion: 2.1 time: 0.220665 Oct 04 20:31:33.356919 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 89/175] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:33 2022] DELETE /compute/v2.1/flavors/696158163 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:33.467767 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-6eaeef77-718f-4c67-9835-569f142aa71c tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] validate_networks() for [('3268ebe1-14f5-4073-a00b-b92c6317fabf', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:31:33.674316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-88c61626-998d-49e9-a105-05cd61641b66 tempest-FlavorsAccessNegativeTestJSON-637661388 tempest-FlavorsAccessNegativeTestJSON-637661388-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "98c71e3ed7854c4c82df7a4a34375b74"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:33.679651 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-88c61626-998d-49e9-a105-05cd61641b66 tempest-FlavorsAccessNegativeTestJSON-637661388 tempest-FlavorsAccessNegativeTestJSON-637661388-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '003a541ef0c54e64bc7f02b3196a5ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c71e3ed7854c4c82df7a4a34375b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-88c61626-998d-49e9-a105-05cd61641b66 tempest-FlavorsAccessNegativeTestJSON-637661388 tempest-FlavorsAccessNegativeTestJSON-637661388-project] Request method failure captured: Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/flavors/1179020257/action HTTP/1.1 Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 67 Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgVKfChonvqep2qlJZFDze9o8Iqx6fA620Zo5K7Qdu5-nbrNs-bWbBNftWlAI6pSrCQSS7mpTeXabDOzbVPZnr4uls9uDYQkz9_IyJfkpXAOCliPpijltye5kBI1cMZACGMuu1GaVSv7SH3WIB-_lgbibKTBV8KLZVRkR_TFp9ZUhw Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 98c71e3ed7854c4c82df7a4a34375b74 Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-637661388 Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:33.688735 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:33.691455 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_98c71e3ed7854c4c82df7a4a34375b74", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98c71e3ed7854c4c82df7a4a34375b74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98c71e3ed7854c4c82df7a4a34375b74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/98c71e3ed7854c4c82df7a4a34375b74"}]}] Oct 04 20:31:33.691455 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-637661388 Oct 04 20:31:33.691455 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 98c71e3ed7854c4c82df7a4a34375b74 Oct 04 20:31:33.691455 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-637661388 Oct 04 20:31:33.691455 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FlavorsAccessNegativeTestJSON-637661388-project Oct 04 20:31:33.691455 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:33.691455 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:33.691455 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 003a541ef0c54e64bc7f02b3196a5ba1 Oct 04 20:31:33.691455 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-637661388-project Oct 04 20:31:33.691455 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:31:33.691455 n-d-852085-12 devstack@n-api.service[123540]: {"addTenantAccess": {"tenant": "98c71e3ed7854c4c82df7a4a34375b74"}} Oct 04 20:31:33.691455 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '1179020257', 'body': {'addTenantAccess': {'tenant': '98c71e3ed7854c4c82df7a4a34375b74'}}} Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:33.693692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 20:31:33.702574 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:33.707009 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-88c61626-998d-49e9-a105-05cd61641b66 tempest-FlavorsAccessNegativeTestJSON-637661388 tempest-FlavorsAccessNegativeTestJSON-637661388-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:33.707009 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-88c61626-998d-49e9-a105-05cd61641b66 tempest-FlavorsAccessNegativeTestJSON-637661388 tempest-FlavorsAccessNegativeTestJSON-637661388-project] 10.222.0.78 "POST /compute/v2.1/flavors/1179020257/action" status: 403 len: 130 microversion: 2.1 time: 0.339839 Oct 04 20:31:33.710706 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 90/176] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Oct 4 20:31:33 2022] POST /compute/v2.1/flavors/1179020257/action => generated 130 bytes in 351 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:33.720838 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b33a7577-697e-45e3-8184-f87570c206b5 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:33.781720 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b33a7577-697e-45e3-8184-f87570c206b5 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942 tempest-FlavorsExtraSpecsNegativeTestJSON-2053500942-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.068449 Oct 04 20:31:33.797292 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 91/177] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:33 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:33.806008 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b465d2ab-6270-4b68-a293-4298e2738258 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:33.983302 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b465d2ab-6270-4b68-a293-4298e2738258 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1179020257" status: 202 len: 0 microversion: 2.1 time: 0.183660 Oct 04 20:31:33.989726 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 92/178] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 4 20:31:33 2022] DELETE /compute/v2.1/flavors/1179020257 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:34.000901 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7aeb28a6-9147-40cf-a9b0-9f39fb7833d9 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:34.039118 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7aeb28a6-9147-40cf-a9b0-9f39fb7833d9 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.047106 Oct 04 20:31:34.060178 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 93/179] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:33 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:34.073755 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cd78bf6d-28aa-4ce6-9082-80e94bb9c051 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1939159025", "id": 1030308705, "os-flavor-access:is_public": "False"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:34.188538 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cd78bf6d-28aa-4ce6-9082-80e94bb9c051 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.120549 Oct 04 20:31:34.189621 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 94/180] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:34 2022] POST /compute/v2.1/flavors => generated 439 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:34.212872 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e850770d-f0c0-4130-a05a-de9adf356c2b tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:34.219761 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e850770d-f0c0-4130-a05a-de9adf356c2b tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:34.231733 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e850770d-f0c0-4130-a05a-de9adf356c2b tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:34.233236 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e850770d-f0c0-4130-a05a-de9adf356c2b tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:34.234450 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e850770d-f0c0-4130-a05a-de9adf356c2b tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:34.236170 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e850770d-f0c0-4130-a05a-de9adf356c2b tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:34.237794 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e850770d-f0c0-4130-a05a-de9adf356c2b tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:34.238586 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e850770d-f0c0-4130-a05a-de9adf356c2b tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:34.440809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e850770d-f0c0-4130-a05a-de9adf356c2b tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:34.455897 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e850770d-f0c0-4130-a05a-de9adf356c2b tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1338 microversion: 2.1 time: 0.254668 Oct 04 20:31:34.457787 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 95/181] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:34 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1338 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:34.496537 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f19c3ac0-82e8-4f42-ae73-8d836e498ed0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:34.497862 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f19c3ac0-82e8-4f42-ae73-8d836e498ed0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:34.514830 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f19c3ac0-82e8-4f42-ae73-8d836e498ed0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:34.517003 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f19c3ac0-82e8-4f42-ae73-8d836e498ed0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:34.518084 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f19c3ac0-82e8-4f42-ae73-8d836e498ed0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:34.519715 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f19c3ac0-82e8-4f42-ae73-8d836e498ed0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:34.520645 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f19c3ac0-82e8-4f42-ae73-8d836e498ed0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:34.521467 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f19c3ac0-82e8-4f42-ae73-8d836e498ed0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-6eaeef77-718f-4c67-9835-569f142aa71c tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de103658-8a67-4d18-a1df-ff5c263a76e7) Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:31:34.545298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:31:34.548027 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:31:34.550523 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:31:34.552742 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:31:34.554886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de103658-8a67-4d18-a1df-ff5c263a76e7) Oct 04 20:31:34.554886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:34.559565 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-6eaeef77-718f-4c67-9835-569f142aa71c tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:31:34.559565 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6eaeef77-718f-4c67-9835-569f142aa71c tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] Request method failure captured: Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 504 Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgDppEGiksMwC9RsC4AelpxmK98H-tvydUNOcl0gttfldKn3Bp18kgnbtXbUYut3hYyNom5hl7SbaqnA978T8gJiUvs3H8jV_wnjbCB2CtZL6aNyjVN9R4k6Z_2OMyCog9qmXMKozKEkxrMxZhcXffhu2-fjJPFe3LLfvIXuNyIzH4 Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: d593ded97dc34546bfe79cdbdac0d4c2 Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-724521506 Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:31:34.573389 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:31:34.576551 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d593ded97dc34546bfe79cdbdac0d4c2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d593ded97dc34546bfe79cdbdac0d4c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d593ded97dc34546bfe79cdbdac0d4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d593ded97dc34546bfe79cdbdac0d4c2"}]}] Oct 04 20:31:34.576551 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-724521506 Oct 04 20:31:34.576551 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: d593ded97dc34546bfe79cdbdac0d4c2 Oct 04 20:31:34.576551 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-724521506 Oct 04 20:31:34.576551 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersWithSpecificFlavorTestJSON-724521506-project Oct 04 20:31:34.576551 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:34.576551 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:34.576551 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 9baf3883d6ac4328bf3aa9ffaaa48b4f Oct 04 20:31:34.576551 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-724521506-project Oct 04 20:31:34.576551 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:34.577856 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-72545084", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "1931910749", "adminPass": "password", "networks": [{"uuid": "3268ebe1-14f5-4073-a00b-b92c6317fabf"}], "security_groups": [{"name": "tempest-securitygroup--2041211526"}], "key_name": "tempest-keypair-1076763719", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:31:34.577856 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:34.577856 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:31:34.577856 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:31:34.577856 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-server-72545084', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '1931910749', 'adminPass': 'password', 'networks': [{'uuid': '3268ebe1-14f5-4073-a00b-b92c6317fabf'}], 'security_groups': [{'name': 'tempest-securitygroup--2041211526'}], 'key_name': 'tempest-keypair-1076763719', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:31:34.577856 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:34.577856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:34.577856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:34.577856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:34.577856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:34.577856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:34.577856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:31:34.579655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:31:34.581895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:31:34.584187 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de103658-8a67-4d18-a1df-ff5c263a76e7) Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:31:34.587805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6eaeef77-718f-4c67-9835-569f142aa71c tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:31:34.589850 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:34.593376 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6eaeef77-718f-4c67-9835-569f142aa71c tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.293523 Oct 04 20:31:34.594225 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 87/182] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 1300 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:31:34.615491 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-89e3d90e-e21f-4afa-bf98-9eebedf49b9c tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "98c71e3ed7854c4c82df7a4a34375b74"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:34.848552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f19c3ac0-82e8-4f42-ae73-8d836e498ed0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:34.865672 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f19c3ac0-82e8-4f42-ae73-8d836e498ed0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.405638 Oct 04 20:31:34.868263 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 96/183] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:34 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:34.893602 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dae78ace-e922-4c4c-93e8-fff6d1eb1477 tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] Calling method '.version_select at 0x7f77efe31c10>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:35.028561 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-dae78ace-e922-4c4c-93e8-fff6d1eb1477 tempest-ServersWithSpecificFlavorTestJSON-724521506 tempest-ServersWithSpecificFlavorTestJSON-724521506-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1076763719" status: 202 len: 0 microversion: 2.1 time: 0.157770 Oct 04 20:31:35.032800 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 97/184] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:31:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1076763719 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:35.507874 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e2361ef2-becb-4713-aee6-d71e5e3a3a3c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:35.511294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e2361ef2-becb-4713-aee6-d71e5e3a3a3c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:35.550704 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2361ef2-becb-4713-aee6-d71e5e3a3a3c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:35.554316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2361ef2-becb-4713-aee6-d71e5e3a3a3c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:35.556505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2361ef2-becb-4713-aee6-d71e5e3a3a3c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:35.558393 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2361ef2-becb-4713-aee6-d71e5e3a3a3c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:35.561043 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2361ef2-becb-4713-aee6-d71e5e3a3a3c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:35.564593 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2361ef2-becb-4713-aee6-d71e5e3a3a3c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:35.901998 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-89e3d90e-e21f-4afa-bf98-9eebedf49b9c tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1030308705/action" status: 200 len: 97 microversion: 2.1 time: 1.304768 Oct 04 20:31:35.911667 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 88/185] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Oct 4 20:31:34 2022] POST /compute/v2.1/flavors/1030308705/action => generated 97 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:35.939122 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3d52c79b-ba69-4196-bcf2-d226e3e55f0e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:35.945734 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3d52c79b-ba69-4196-bcf2-d226e3e55f0e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:35.997670 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3d52c79b-ba69-4196-bcf2-d226e3e55f0e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:36.006568 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3d52c79b-ba69-4196-bcf2-d226e3e55f0e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:36.007468 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3d52c79b-ba69-4196-bcf2-d226e3e55f0e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:36.012562 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3d52c79b-ba69-4196-bcf2-d226e3e55f0e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:36.013982 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3d52c79b-ba69-4196-bcf2-d226e3e55f0e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:36.015089 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3d52c79b-ba69-4196-bcf2-d226e3e55f0e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:36.098582 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:36.615542 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e2361ef2-becb-4713-aee6-d71e5e3a3a3c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:36.641205 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e2361ef2-becb-4713-aee6-d71e5e3a3a3c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1338 microversion: 2.1 time: 1.146019 Oct 04 20:31:36.642148 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 98/186] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:35 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1338 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:36.660087 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f620f104-8893-4148-a36d-a34f9fc332a5 tempest-FlavorsAccessNegativeTestJSON-637661388 tempest-FlavorsAccessNegativeTestJSON-637661388-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "98c71e3ed7854c4c82df7a4a34375b74"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:36.666270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f620f104-8893-4148-a36d-a34f9fc332a5 tempest-FlavorsAccessNegativeTestJSON-637661388 tempest-FlavorsAccessNegativeTestJSON-637661388-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '003a541ef0c54e64bc7f02b3196a5ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c71e3ed7854c4c82df7a4a34375b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f620f104-8893-4148-a36d-a34f9fc332a5 tempest-FlavorsAccessNegativeTestJSON-637661388 tempest-FlavorsAccessNegativeTestJSON-637661388-project] Request method failure captured: Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/flavors/1030308705/action HTTP/1.1 Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 70 Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgVKfChonvqep2qlJZFDze9o8Iqx6fA620Zo5K7Qdu5-nbrNs-bWbBNftWlAI6pSrCQSS7mpTeXabDOzbVPZnr4uls9uDYQkz9_IyJfkpXAOCliPpijltye5kBI1cMZACGMuu1GaVSv7SH3WIB-_lgbibKTBV8KLZVRkR_TFp9ZUhw Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 98c71e3ed7854c4c82df7a4a34375b74 Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-637661388 Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:36.671936 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:36.674300 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_98c71e3ed7854c4c82df7a4a34375b74", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98c71e3ed7854c4c82df7a4a34375b74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98c71e3ed7854c4c82df7a4a34375b74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/98c71e3ed7854c4c82df7a4a34375b74"}]}] Oct 04 20:31:36.674300 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-637661388 Oct 04 20:31:36.674300 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 98c71e3ed7854c4c82df7a4a34375b74 Oct 04 20:31:36.674300 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-637661388 Oct 04 20:31:36.674300 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FlavorsAccessNegativeTestJSON-637661388-project Oct 04 20:31:36.674300 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:36.674300 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:36.674300 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 003a541ef0c54e64bc7f02b3196a5ba1 Oct 04 20:31:36.674300 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-637661388-project Oct 04 20:31:36.674300 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:31:36.674300 n-d-852085-12 devstack@n-api.service[123540]: {"removeTenantAccess": {"tenant": "98c71e3ed7854c4c82df7a4a34375b74"}} Oct 04 20:31:36.674300 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '1030308705', 'body': {'removeTenantAccess': {'tenant': '98c71e3ed7854c4c82df7a4a34375b74'}}} Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can( Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:36.675774 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 20:31:36.678046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:36.680250 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f620f104-8893-4148-a36d-a34f9fc332a5 tempest-FlavorsAccessNegativeTestJSON-637661388 tempest-FlavorsAccessNegativeTestJSON-637661388-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:36.682899 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f620f104-8893-4148-a36d-a34f9fc332a5 tempest-FlavorsAccessNegativeTestJSON-637661388 tempest-FlavorsAccessNegativeTestJSON-637661388-project] 10.222.0.78 "POST /compute/v2.1/flavors/1030308705/action" status: 403 len: 133 microversion: 2.1 time: 0.029609 Oct 04 20:31:36.684755 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 99/187] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Oct 4 20:31:36 2022] POST /compute/v2.1/flavors/1030308705/action => generated 133 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:36.850158 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3d52c79b-ba69-4196-bcf2-d226e3e55f0e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:36.865785 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3d52c79b-ba69-4196-bcf2-d226e3e55f0e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.951572 Oct 04 20:31:36.867369 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 89/188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:35 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:36.875741 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cc22ddbc-ea25-415a-b838-cb2a5fc68a89 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "98c71e3ed7854c4c82df7a4a34375b74"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:37.042495 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-461552002", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:37.208250 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:31:37.244472 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cc22ddbc-ea25-415a-b838-cb2a5fc68a89 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1030308705/action" status: 200 len: 21 microversion: 2.1 time: 0.374896 Oct 04 20:31:37.249356 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 90/189] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Oct 4 20:31:36 2022] POST /compute/v2.1/flavors/1030308705/action => generated 21 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:37.350150 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f238e7c9-6ec4-4de0-881a-5e92fd94bd44 tempest-FlavorsV255TestJSON-801126313 tempest-FlavorsV255TestJSON-801126313-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1186005991", "id": 1211750245, "os-flavor-access:is_public": "True"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:37.516524 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f238e7c9-6ec4-4de0-881a-5e92fd94bd44 tempest-FlavorsV255TestJSON-801126313 tempest-FlavorsV255TestJSON-801126313-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.263202 Oct 04 20:31:37.517977 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 91/190] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:31:37 2022] POST /compute/v2.1/flavors => generated 449 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:37.535986 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-825729c2-a81b-496d-ac9c-b895d46470d6 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:37.597781 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:31:37.598563 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:31:37.599514 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:31:37.600290 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:31:37.601059 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:31:37.629822 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:37.630892 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:37.631636 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:37.633059 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:37.633961 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:37.634927 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:37.646288 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-825729c2-a81b-496d-ac9c-b895d46470d6 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1030308705" status: 202 len: 0 microversion: 2.1 time: 0.117210 Oct 04 20:31:37.653280 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 92/191] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 4 20:31:37 2022] DELETE /compute/v2.1/flavors/1030308705 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:37.664467 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f4331214-8c84-4cc8-a93b-63e1f0da4c6c tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:37.695508 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Getting quotas for project e756f3ec49694205b5dccf3408cee098. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:31:37.709860 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Getting quotas for user 4b8c35b4791b41fea4edf6b6f1ef6de1 and project e756f3ec49694205b5dccf3408cee098. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:31:37.734047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Going to run 1 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:31:37.751566 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:31:37.817871 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f4331214-8c84-4cc8-a93b-63e1f0da4c6c tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1931910749" status: 202 len: 0 microversion: 2.1 time: 0.162241 Oct 04 20:31:37.819073 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 93/192] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 4 20:31:37 2022] DELETE /compute/v2.1/flavors/1931910749 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:37.921558 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-866ec351-0976-43b3-ab14-0f655614d5c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.234345 Oct 04 20:31:37.922702 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 100/193] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:31:37.941138 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7a2be33b-0a89-4321-ab4c-8c5fb3304292 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:37.994262 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7a2be33b-0a89-4321-ab4c-8c5fb3304292 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5823 microversion: 2.1 time: 0.064977 Oct 04 20:31:37.996230 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 101/194] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:37 2022] GET /compute/v2.1/flavors/detail => generated 5823 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:38.015109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-da2849f2-4382-4471-bfd2-53699ba994be tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:38.017040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-da2849f2-4382-4471-bfd2-53699ba994be tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:38.038059 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-da2849f2-4382-4471-bfd2-53699ba994be tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:38.039169 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-da2849f2-4382-4471-bfd2-53699ba994be tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:38.040136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-da2849f2-4382-4471-bfd2-53699ba994be tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:38.041602 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-da2849f2-4382-4471-bfd2-53699ba994be tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:38.042773 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-da2849f2-4382-4471-bfd2-53699ba994be tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:38.044117 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-da2849f2-4382-4471-bfd2-53699ba994be tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:38.068209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-26938be9-af8e-403a-8b99-11af332665e1 tempest-FlavorsV255TestJSON-574490929 tempest-FlavorsV255TestJSON-574490929-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:38.083525 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-26938be9-af8e-403a-8b99-11af332665e1 tempest-FlavorsV255TestJSON-574490929 tempest-FlavorsV255TestJSON-574490929-project] 10.222.0.78 "GET /compute/v2.1/flavors/1211750245" status: 200 len: 449 microversion: 2.55 time: 0.262395 Oct 04 20:31:38.084853 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 94/195] 10.222.0.78 () {60 vars in 1199 bytes} [Tue Oct 4 20:31:37 2022] GET /compute/v2.1/flavors/1211750245 => generated 449 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:38.094322 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-83249f20-c9cc-430e-888e-dc11bcad3183 tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:38.138463 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-83249f20-c9cc-430e-888e-dc11bcad3183 tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5823 microversion: 2.1 time: 0.051436 Oct 04 20:31:38.139804 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 95/196] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:38 2022] GET /compute/v2.1/flavors/detail => generated 5823 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:38.156209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2a1ab8a8-980a-4027-987e-67d50ccc140f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:38.157748 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2a1ab8a8-980a-4027-987e-67d50ccc140f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:38.172150 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a1ab8a8-980a-4027-987e-67d50ccc140f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:38.172988 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a1ab8a8-980a-4027-987e-67d50ccc140f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:38.173711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a1ab8a8-980a-4027-987e-67d50ccc140f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:38.174903 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a1ab8a8-980a-4027-987e-67d50ccc140f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:38.175714 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a1ab8a8-980a-4027-987e-67d50ccc140f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:38.176475 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a1ab8a8-980a-4027-987e-67d50ccc140f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:38.446730 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-da2849f2-4382-4471-bfd2-53699ba994be tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:38.467554 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-da2849f2-4382-4471-bfd2-53699ba994be tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1338 microversion: 2.1 time: 0.468717 Oct 04 20:31:38.469005 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 102/197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:37 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1338 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:38.478647 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-af79790b-b232-4874-94fc-db279ccde706 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:38.480119 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-af79790b-b232-4874-94fc-db279ccde706 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:38.528297 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2a1ab8a8-980a-4027-987e-67d50ccc140f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:38.544856 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2a1ab8a8-980a-4027-987e-67d50ccc140f tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.401502 Oct 04 20:31:38.546769 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 96/198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:38 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:38.556229 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0b50cd2a-02b1-4efd-bad1-b62c12ca8253 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-55921093", "id": 925915703, "os-flavor-access:is_public": "False"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:38.584889 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-af79790b-b232-4874-94fc-db279ccde706 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:38.594188 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-af79790b-b232-4874-94fc-db279ccde706 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1218 microversion: 2.1 time: 0.123225 Oct 04 20:31:38.595122 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 103/199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:38 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:38.606640 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-88699a77-2ca6-44eb-90ea-c7728f0ad69b tempest-FlavorsV255TestJSON-801126313 tempest-FlavorsV255TestJSON-801126313-project-admin] Action: 'update', calling method: .version_select at 0x7f77f5029670>, body: {"flavor": {"description": "new"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:38.664817 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0b50cd2a-02b1-4efd-bad1-b62c12ca8253 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.115537 Oct 04 20:31:38.666175 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 97/200] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:38 2022] POST /compute/v2.1/flavors => generated 434 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:38.677378 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-35450833-2cb6-4bbb-bcbc-d9c015f04066 tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:38.788585 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-88699a77-2ca6-44eb-90ea-c7728f0ad69b tempest-FlavorsV255TestJSON-801126313 tempest-FlavorsV255TestJSON-801126313-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/1211750245" status: 200 len: 450 microversion: 2.55 time: 0.191145 Oct 04 20:31:38.789480 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 104/201] 10.222.0.78 () {62 vars in 1219 bytes} [Tue Oct 4 20:31:38 2022] PUT /compute/v2.1/flavors/1211750245 => generated 450 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:38.799087 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-180368c5-b686-4d27-b970-5a43a550fe44 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a8efdc4b00404ebfb9af2fc44fe4c92a"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:38.824210 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-35450833-2cb6-4bbb-bcbc-d9c015f04066 tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2125771493" status: 202 len: 0 microversion: 2.1 time: 0.155318 Oct 04 20:31:38.826242 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 98/202] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 4 20:31:38 2022] DELETE /compute/v2.1/flavors/2125771493 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:38.835487 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-64f3e5d9-dc74-420e-a263-849b2cb40cd5 tempest-FlavorsV255TestJSON-574490929 tempest-FlavorsV255TestJSON-574490929-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:38.889428 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-64f3e5d9-dc74-420e-a263-849b2cb40cd5 tempest-FlavorsV255TestJSON-574490929 tempest-FlavorsV255TestJSON-574490929-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.060866 Oct 04 20:31:38.891163 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 99/203] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 4 20:31:38 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:31:38.907818 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-683bdcc6-163d-443f-953b-af95f038e890 tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:38.952213 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-683bdcc6-163d-443f-953b-af95f038e890 tempest-ServersWithSpecificFlavorTestJSON-2022542055 tempest-ServersWithSpecificFlavorTestJSON-2022542055-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.058736 Oct 04 20:31:38.954321 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 100/204] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:38 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:38.966039 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-167b1695-379e-4700-b848-0dade21f4f3c tempest-FlavorsV255TestJSON-574490929 tempest-FlavorsV255TestJSON-574490929-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:39.022089 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-167b1695-379e-4700-b848-0dade21f4f3c tempest-FlavorsV255TestJSON-574490929 tempest-FlavorsV255TestJSON-574490929-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.065477 Oct 04 20:31:39.024223 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 101/205] 10.222.0.78 () {60 vars in 1166 bytes} [Tue Oct 4 20:31:38 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:31:39.056401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2f19f03a-648a-48de-8d77-efbadd18e2df tempest-FlavorsV255TestJSON-801126313 tempest-FlavorsV255TestJSON-801126313-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:39.076332 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=73,nova_api:SAVEPOINT=4,nova_api:INSERT=6,nova_api:RELEASE=4,nova_api:DELETE=13 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:39.223348 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2f19f03a-648a-48de-8d77-efbadd18e2df tempest-FlavorsV255TestJSON-801126313 tempest-FlavorsV255TestJSON-801126313-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1211750245" status: 202 len: 0 microversion: 2.55 time: 0.172518 Oct 04 20:31:39.226368 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 102/206] 10.222.0.78 () {60 vars in 1202 bytes} [Tue Oct 4 20:31:39 2022] DELETE /compute/v2.1/flavors/1211750245 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:31:39.274396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8fbbbb67-e8c0-4ca5-9162-47a995552eae tempest-FlavorsV255TestJSON-801126313 tempest-FlavorsV255TestJSON-801126313-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:39.358591 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8fbbbb67-e8c0-4ca5-9162-47a995552eae tempest-FlavorsV255TestJSON-801126313 tempest-FlavorsV255TestJSON-801126313-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.121402 Oct 04 20:31:39.360475 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 103/207] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 4 20:31:39 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:31:39.507178 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-180368c5-b686-4d27-b970-5a43a550fe44 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] HTTP exception thrown: Flavor access not found for 36 / a8efdc4b00404ebfb9af2fc44fe4c92a combination. Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-180368c5-b686-4d27-b970-5a43a550fe44 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Request method failure captured: Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/flavors/925915703/action HTTP/1.1 Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 70 Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgawYQdyomfJmV30Xu4QeYVl2CULBt582t4Fc8d2i4rLPvD1h-xCbpRRfgFwDhcoUutimtEEOtQ3Q6f9y8Re9QlEKvxiLu1FtKOG4inxCT8DqgSlZ1PQkrV7ynhxn4KrbfzGpdhtKhRUNAb_fiKbZ2utO91SkscLOpsEPSjz_sTclg Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 7ed4ed8d04654505aab32609420b930e Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1287260464 Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:31:39.513251 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:31:39.516260 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7ed4ed8d04654505aab32609420b930e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ed4ed8d04654505aab32609420b930e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7ed4ed8d04654505aab32609420b930e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7ed4ed8d04654505aab32609420b930e"}]}] Oct 04 20:31:39.516260 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1287260464 Oct 04 20:31:39.516260 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 7ed4ed8d04654505aab32609420b930e Oct 04 20:31:39.516260 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1287260464 Oct 04 20:31:39.516260 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin Oct 04 20:31:39.516260 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:39.516260 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:39.516260 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 282befeaa1a94c40a9bba4f8d5441677 Oct 04 20:31:39.516260 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin Oct 04 20:31:39.516260 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:31:39.516260 n-d-852085-12 devstack@n-api.service[123540]: {"removeTenantAccess": {"tenant": "a8efdc4b00404ebfb9af2fc44fe4c92a"}} Oct 04 20:31:39.516260 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: exception: Flavor access not found for 36 / a8efdc4b00404ebfb9af2fc44fe4c92a combination. Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '925915703', 'body': {'removeTenantAccess': {'tenant': 'a8efdc4b00404ebfb9af2fc44fe4c92a'}}} Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 04 20:31:39.517968 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / a8efdc4b00404ebfb9af2fc44fe4c92a combination. Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / a8efdc4b00404ebfb9af2fc44fe4c92a combination. Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:39.520268 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:39.523501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:39.523501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:39.523501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:39.523501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:39.523501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / a8efdc4b00404ebfb9af2fc44fe4c92a combination. Oct 04 20:31:39.523501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:39.528055 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6e947352-e6f1-4b96-8fa8-368cc5c8dcb9 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:39.530202 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-180368c5-b686-4d27-b970-5a43a550fe44 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Returning 404 to user: Flavor access not found for 36 / a8efdc4b00404ebfb9af2fc44fe4c92a combination. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:39.532685 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6e947352-e6f1-4b96-8fa8-368cc5c8dcb9 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:39.536299 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-180368c5-b686-4d27-b970-5a43a550fe44 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/925915703/action" status: 404 len: 124 microversion: 2.1 time: 0.743717 Oct 04 20:31:39.537830 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 105/208] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Oct 4 20:31:38 2022] POST /compute/v2.1/flavors/925915703/action => generated 124 bytes in 748 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:39.556827 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ffb73e71-b8dd-483b-aab0-25e552cfd73d tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:39.570488 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6e947352-e6f1-4b96-8fa8-368cc5c8dcb9 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:39.573700 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6e947352-e6f1-4b96-8fa8-368cc5c8dcb9 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:39.577241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6e947352-e6f1-4b96-8fa8-368cc5c8dcb9 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:39.579981 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6e947352-e6f1-4b96-8fa8-368cc5c8dcb9 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:39.585406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6e947352-e6f1-4b96-8fa8-368cc5c8dcb9 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:39.588470 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6e947352-e6f1-4b96-8fa8-368cc5c8dcb9 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:39.749205 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ffb73e71-b8dd-483b-aab0-25e552cfd73d tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/925915703" status: 202 len: 0 microversion: 2.1 time: 0.202124 Oct 04 20:31:39.750719 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 106/209] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:39 2022] DELETE /compute/v2.1/flavors/925915703 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:39.760136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-10ed2eeb-1e50-4cb2-afd5-63f17874ba3d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:39.762963 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-10ed2eeb-1e50-4cb2-afd5-63f17874ba3d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:39.774449 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-10ed2eeb-1e50-4cb2-afd5-63f17874ba3d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:39.775435 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-10ed2eeb-1e50-4cb2-afd5-63f17874ba3d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:39.776260 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-10ed2eeb-1e50-4cb2-afd5-63f17874ba3d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:39.778596 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-10ed2eeb-1e50-4cb2-afd5-63f17874ba3d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:39.778835 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-10ed2eeb-1e50-4cb2-afd5-63f17874ba3d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:39.779524 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-10ed2eeb-1e50-4cb2-afd5-63f17874ba3d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:40.584573 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6e947352-e6f1-4b96-8fa8-368cc5c8dcb9 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:40.633990 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6e947352-e6f1-4b96-8fa8-368cc5c8dcb9 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1338 microversion: 2.1 time: 1.107326 Oct 04 20:31:40.637571 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 104/210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:39 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1338 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:40.659066 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bf18b916-9402-45ee-b65f-9400c3b6ec3c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:40.664783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-bf18b916-9402-45ee-b65f-9400c3b6ec3c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:40.665231 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-10ed2eeb-1e50-4cb2-afd5-63f17874ba3d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:40.682464 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bf18b916-9402-45ee-b65f-9400c3b6ec3c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:40.683072 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bf18b916-9402-45ee-b65f-9400c3b6ec3c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:40.684324 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bf18b916-9402-45ee-b65f-9400c3b6ec3c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:40.685516 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bf18b916-9402-45ee-b65f-9400c3b6ec3c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:40.686249 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bf18b916-9402-45ee-b65f-9400c3b6ec3c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:40.686939 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bf18b916-9402-45ee-b65f-9400c3b6ec3c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:40.693279 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-10ed2eeb-1e50-4cb2-afd5-63f17874ba3d tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.940376 Oct 04 20:31:40.704167 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 107/211] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:39 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:40.722231 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d2d84d88-87e4-4164-99e8-4132e4711d3e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:40.776219 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d2d84d88-87e4-4164-99e8-4132e4711d3e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069867 Oct 04 20:31:40.792001 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 108/212] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:40.966897 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bf18b916-9402-45ee-b65f-9400c3b6ec3c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:40.996126 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bf18b916-9402-45ee-b65f-9400c3b6ec3c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1222 microversion: 2.1 time: 0.356786 Oct 04 20:31:41.019381 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 105/213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:40 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1222 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:41.685450 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b0824c9b-d590-4ec7-bd42-ff188160c81c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:41.688595 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b0824c9b-d590-4ec7-bd42-ff188160c81c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:41.712331 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0824c9b-d590-4ec7-bd42-ff188160c81c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:41.713550 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0824c9b-d590-4ec7-bd42-ff188160c81c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:41.714607 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0824c9b-d590-4ec7-bd42-ff188160c81c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:41.716708 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0824c9b-d590-4ec7-bd42-ff188160c81c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:41.717960 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0824c9b-d590-4ec7-bd42-ff188160c81c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:41.719009 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0824c9b-d590-4ec7-bd42-ff188160c81c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:41.751818 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0dd1bcac-d7e6-4efc-96c4-0666f2c6f591 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:41.754687 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-0dd1bcac-d7e6-4efc-96c4-0666f2c6f591 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:41.779246 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0dd1bcac-d7e6-4efc-96c4-0666f2c6f591 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:41.786411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0dd1bcac-d7e6-4efc-96c4-0666f2c6f591 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:41.787664 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0dd1bcac-d7e6-4efc-96c4-0666f2c6f591 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:41.789279 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0dd1bcac-d7e6-4efc-96c4-0666f2c6f591 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:41.799308 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0dd1bcac-d7e6-4efc-96c4-0666f2c6f591 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:41.801375 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0dd1bcac-d7e6-4efc-96c4-0666f2c6f591 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:42.583550 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b0824c9b-d590-4ec7-bd42-ff188160c81c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:42.600285 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b0824c9b-d590-4ec7-bd42-ff188160c81c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1338 microversion: 2.1 time: 0.921588 Oct 04 20:31:42.601942 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-0dd1bcac-d7e6-4efc-96c4-0666f2c6f591 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:42.603702 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 109/214] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:41 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1338 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:42.618488 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ed55d8b4-8097-4b31-878c-711920f99b00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:42.627287 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ed55d8b4-8097-4b31-878c-711920f99b00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:42.662172 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ed55d8b4-8097-4b31-878c-711920f99b00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:42.663069 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ed55d8b4-8097-4b31-878c-711920f99b00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:42.678388 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0dd1bcac-d7e6-4efc-96c4-0666f2c6f591 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.933457 Oct 04 20:31:42.680496 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ed55d8b4-8097-4b31-878c-711920f99b00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:42.689998 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ed55d8b4-8097-4b31-878c-711920f99b00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:42.693141 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ed55d8b4-8097-4b31-878c-711920f99b00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:42.697599 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ed55d8b4-8097-4b31-878c-711920f99b00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:42.715572 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 106/215] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:41 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:42.929411 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ed55d8b4-8097-4b31-878c-711920f99b00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:42.955330 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ed55d8b4-8097-4b31-878c-711920f99b00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1278 microversion: 2.1 time: 0.343420 Oct 04 20:31:42.957350 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 110/216] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:42 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1278 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:43.224005 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-98dbf84f-6703-4a8e-a6b1-19b2d3b03dee req-adf96e44-7b0b-4d4c-9f5d-09d53f06d39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660c3eff-854d-4e7c-8247-4a992eda69ce", "name": "network-vif-plugged", "status": "completed", "tag": "c2470e19-f860-43fa-ba0b-4b54f80cea9b"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:43.282958 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-98dbf84f-6703-4a8e-a6b1-19b2d3b03dee req-adf96e44-7b0b-4d4c-9f5d-09d53f06d39a service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:43.285309 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-98dbf84f-6703-4a8e-a6b1-19b2d3b03dee req-adf96e44-7b0b-4d4c-9f5d-09d53f06d39a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:43.286372 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-98dbf84f-6703-4a8e-a6b1-19b2d3b03dee req-adf96e44-7b0b-4d4c-9f5d-09d53f06d39a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:43.330164 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-98dbf84f-6703-4a8e-a6b1-19b2d3b03dee req-adf96e44-7b0b-4d4c-9f5d-09d53f06d39a service nova] Creating event network-vif-plugged:c2470e19-f860-43fa-ba0b-4b54f80cea9b for instance 660c3eff-854d-4e7c-8247-4a992eda69ce on n-h1-852085-12 Oct 04 20:31:43.332118 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-98dbf84f-6703-4a8e-a6b1-19b2d3b03dee req-adf96e44-7b0b-4d4c-9f5d-09d53f06d39a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=123539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:31:43.332840 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-98dbf84f-6703-4a8e-a6b1-19b2d3b03dee req-adf96e44-7b0b-4d4c-9f5d-09d53f06d39a service nova] Acquired lock "compute-rpcapi-router" {{(pid=123539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:31:43.335101 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4084dedf-e10a-41c3-94c5-dee06ac200e3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:43.336753 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4084dedf-e10a-41c3-94c5-dee06ac200e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:43.338949 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4084dedf-e10a-41c3-94c5-dee06ac200e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:43.340605 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4084dedf-e10a-41c3-94c5-dee06ac200e3 None None] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:43.341701 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4084dedf-e10a-41c3-94c5-dee06ac200e3 None None] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:43.342800 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4084dedf-e10a-41c3-94c5-dee06ac200e3 None None] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:43.363849 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.compute.rpcapi [None req-4084dedf-e10a-41c3-94c5-dee06ac200e3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 20:31:43.365879 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4084dedf-e10a-41c3-94c5-dee06ac200e3 None None] Releasing lock "compute-rpcapi-router" {{(pid=123539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:31:43.428177 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4084dedf-e10a-41c3-94c5-dee06ac200e3 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.702448 Oct 04 20:31:43.430326 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 107/217] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:43.651344 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-475f37db-b049-45ab-808c-336107dfe546 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:43.653162 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-475f37db-b049-45ab-808c-336107dfe546 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:43.679281 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-475f37db-b049-45ab-808c-336107dfe546 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:43.680487 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-475f37db-b049-45ab-808c-336107dfe546 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:43.681395 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-475f37db-b049-45ab-808c-336107dfe546 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:43.688276 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-475f37db-b049-45ab-808c-336107dfe546 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:43.689517 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-475f37db-b049-45ab-808c-336107dfe546 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:43.691124 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-475f37db-b049-45ab-808c-336107dfe546 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:43.747823 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4c378546-aa39-4a04-8b1f-ccdbaa2c8a69 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:43.749694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4c378546-aa39-4a04-8b1f-ccdbaa2c8a69 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:43.762413 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4c378546-aa39-4a04-8b1f-ccdbaa2c8a69 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:43.763679 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4c378546-aa39-4a04-8b1f-ccdbaa2c8a69 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:43.764711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4c378546-aa39-4a04-8b1f-ccdbaa2c8a69 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:43.766346 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4c378546-aa39-4a04-8b1f-ccdbaa2c8a69 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:43.767477 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4c378546-aa39-4a04-8b1f-ccdbaa2c8a69 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:43.768499 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4c378546-aa39-4a04-8b1f-ccdbaa2c8a69 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:45.335010 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-475f37db-b049-45ab-808c-336107dfe546 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:45.347821 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4c378546-aa39-4a04-8b1f-ccdbaa2c8a69 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:45.374820 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4c378546-aa39-4a04-8b1f-ccdbaa2c8a69 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 1.647094 Oct 04 20:31:45.383273 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 108/218] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:43 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:45.407717 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a4cd7b2e-fccd-4de2-8527-ed2562362619 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:45.413581 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-475f37db-b049-45ab-808c-336107dfe546 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1338 microversion: 2.1 time: 1.761704 Oct 04 20:31:45.414314 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a4cd7b2e-fccd-4de2-8527-ed2562362619 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:45.417331 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 111/219] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:43 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1338 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:45.436932 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a4cd7b2e-fccd-4de2-8527-ed2562362619 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:45.439995 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a4cd7b2e-fccd-4de2-8527-ed2562362619 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:45.446145 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a4cd7b2e-fccd-4de2-8527-ed2562362619 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:45.447780 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a4cd7b2e-fccd-4de2-8527-ed2562362619 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:45.448859 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a4cd7b2e-fccd-4de2-8527-ed2562362619 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:45.452809 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a4cd7b2e-fccd-4de2-8527-ed2562362619 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:45.469663 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-e73057cd-6b7f-4ab4-81f6-5453d3f0eb37 req-82f70f46-2443-4cd5-b5f9-a0ceb550e363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0867584d-2285-41b4-b1b9-0af13aa79dc1", "name": "network-vif-plugged", "status": "completed", "tag": "33c37c69-333d-405a-a27c-efb298d34226"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:45.492530 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e73057cd-6b7f-4ab4-81f6-5453d3f0eb37 req-82f70f46-2443-4cd5-b5f9-a0ceb550e363 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:45.497443 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e73057cd-6b7f-4ab4-81f6-5453d3f0eb37 req-82f70f46-2443-4cd5-b5f9-a0ceb550e363 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:45.498533 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e73057cd-6b7f-4ab4-81f6-5453d3f0eb37 req-82f70f46-2443-4cd5-b5f9-a0ceb550e363 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:45.531922 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-e73057cd-6b7f-4ab4-81f6-5453d3f0eb37 req-82f70f46-2443-4cd5-b5f9-a0ceb550e363 service nova] Creating event network-vif-plugged:33c37c69-333d-405a-a27c-efb298d34226 for instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 on n-h1-852085-12 Oct 04 20:31:45.551752 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-e73057cd-6b7f-4ab4-81f6-5453d3f0eb37 req-82f70f46-2443-4cd5-b5f9-a0ceb550e363 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086617 Oct 04 20:31:45.563005 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 112/220] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:45.719646 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a4cd7b2e-fccd-4de2-8527-ed2562362619 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:45.730936 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a4cd7b2e-fccd-4de2-8527-ed2562362619 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1276 microversion: 2.1 time: 0.345699 Oct 04 20:31:45.748578 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 109/221] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:45 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1276 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:46.441358 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-59dea1d6-0a57-4017-8fbc-26a0a2f365c6 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:46.443474 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-59dea1d6-0a57-4017-8fbc-26a0a2f365c6 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:46.469825 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59dea1d6-0a57-4017-8fbc-26a0a2f365c6 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:46.470188 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-795249f5-e899-4817-9a57-468987502fb4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:46.471119 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59dea1d6-0a57-4017-8fbc-26a0a2f365c6 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:46.472617 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59dea1d6-0a57-4017-8fbc-26a0a2f365c6 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:46.476368 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59dea1d6-0a57-4017-8fbc-26a0a2f365c6 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:46.477626 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59dea1d6-0a57-4017-8fbc-26a0a2f365c6 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:46.479183 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59dea1d6-0a57-4017-8fbc-26a0a2f365c6 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:46.482115 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-795249f5-e899-4817-9a57-468987502fb4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:46.549329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-795249f5-e899-4817-9a57-468987502fb4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:46.550175 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-795249f5-e899-4817-9a57-468987502fb4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:46.551121 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-795249f5-e899-4817-9a57-468987502fb4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:46.574961 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-795249f5-e899-4817-9a57-468987502fb4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:46.575791 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-795249f5-e899-4817-9a57-468987502fb4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:46.577477 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:DELETE=12,nova_api:SELECT=83,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:46.587113 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-795249f5-e899-4817-9a57-468987502fb4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:47.101087 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-59dea1d6-0a57-4017-8fbc-26a0a2f365c6 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:47.138476 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-59dea1d6-0a57-4017-8fbc-26a0a2f365c6 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.701241 Oct 04 20:31:47.148848 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 113/222] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:46 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:47.162515 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3f2ce337-3616-4dfc-82e1-de01521958b7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:47.165736 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3f2ce337-3616-4dfc-82e1-de01521958b7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:47.179772 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3f2ce337-3616-4dfc-82e1-de01521958b7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:47.180787 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3f2ce337-3616-4dfc-82e1-de01521958b7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:47.181642 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3f2ce337-3616-4dfc-82e1-de01521958b7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:47.183047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3f2ce337-3616-4dfc-82e1-de01521958b7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:47.185939 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3f2ce337-3616-4dfc-82e1-de01521958b7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:47.186777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3f2ce337-3616-4dfc-82e1-de01521958b7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:47.322697 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-795249f5-e899-4817-9a57-468987502fb4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:47.348682 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-795249f5-e899-4817-9a57-468987502fb4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1338 microversion: 2.1 time: 0.895788 Oct 04 20:31:47.349227 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 110/223] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:46 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1338 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:47.490437 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3f2ce337-3616-4dfc-82e1-de01521958b7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:47.520305 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3f2ce337-3616-4dfc-82e1-de01521958b7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 0.374507 Oct 04 20:31:47.535178 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 114/224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:47 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:47.968717 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fac923b9-9a87-4eb8-9983-9c5493243172 tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028 tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:47.979598 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-fac923b9-9a87-4eb8-9983-9c5493243172 tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028 tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fac923b9-9a87-4eb8-9983-9c5493243172 tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028 tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028-project-admin] Request method failure captured: Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgy83ys-P3zWlN167Ix8piyPmWhI6CnQ0KL2PHYOu5andaiVQZ3LOS0U4pCR7tWA7sT_mYuIcTNpu6_9zqO93NlRV0IYoX21BSfKXgyeixdXLWb2FSpMrlP7QO__MPIYyJ5Zs0bu0WYXgkQfVc50wc-OzFwSsS0RD6HIcbCoG2utSc Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: d6b8f92c44fc4a7d98fa4cef12af2e6a Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028 Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:47.994560 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:47.998147 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d6b8f92c44fc4a7d98fa4cef12af2e6a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d6b8f92c44fc4a7d98fa4cef12af2e6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d6b8f92c44fc4a7d98fa4cef12af2e6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d6b8f92c44fc4a7d98fa4cef12af2e6a"}]}] Oct 04 20:31:47.998147 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028 Oct 04 20:31:47.998147 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: d6b8f92c44fc4a7d98fa4cef12af2e6a Oct 04 20:31:47.998147 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028 Oct 04 20:31:47.998147 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028-project-admin Oct 04 20:31:47.998147 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:47.998147 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:47.998147 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 1675b0dea7ee471d846310c2581e2d1e Oct 04 20:31:47.998147 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028-project-admin Oct 04 20:31:47.998147 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:47.998147 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid timestamp for date invalid_time Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'invalid_time'} Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:47.999515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.009711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fac923b9-9a87-4eb8-9983-9c5493243172 tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028 tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:48.030784 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fac923b9-9a87-4eb8-9983-9c5493243172 tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028 tempest-InstanceUsageAuditLogNegativeTestJSON-1605021028-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.679475 Oct 04 20:31:48.041475 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 111/225] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 691 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:48.048876 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:48.187217 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2800468d-cf7c-4404-930f-7196ab56d169 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:48.189490 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2800468d-cf7c-4404-930f-7196ab56d169 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:48.206568 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2800468d-cf7c-4404-930f-7196ab56d169 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:48.207685 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2800468d-cf7c-4404-930f-7196ab56d169 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:48.209761 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2800468d-cf7c-4404-930f-7196ab56d169 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:48.211974 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2800468d-cf7c-4404-930f-7196ab56d169 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:48.217191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2800468d-cf7c-4404-930f-7196ab56d169 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:48.217191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2800468d-cf7c-4404-930f-7196ab56d169 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:48.552664 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2800468d-cf7c-4404-930f-7196ab56d169 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:48.570451 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2800468d-cf7c-4404-930f-7196ab56d169 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1341 microversion: 2.1 time: 0.393771 Oct 04 20:31:48.572427 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 112/226] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:48 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1341 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:48.590698 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=8 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:48.616429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-98bc3186-6dcc-41d2-a20f-895d3e7e3a09 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:48.618135 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-98bc3186-6dcc-41d2-a20f-895d3e7e3a09 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:48.640480 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-98bc3186-6dcc-41d2-a20f-895d3e7e3a09 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:48.643268 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-98bc3186-6dcc-41d2-a20f-895d3e7e3a09 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:48.644698 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-98bc3186-6dcc-41d2-a20f-895d3e7e3a09 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:48.648865 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-98bc3186-6dcc-41d2-a20f-895d3e7e3a09 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:48.653063 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-98bc3186-6dcc-41d2-a20f-895d3e7e3a09 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:48.654090 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-98bc3186-6dcc-41d2-a20f-895d3e7e3a09 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:48.742097 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8611d869-7256-4ff2-bef7-fa760b91d23e tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:48.745983 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8611d869-7256-4ff2-bef7-fa760b91d23e tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '3b96fba70dbf4586b522c5bd1cb74f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce6d5049a93493289028932b886affd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8611d869-7256-4ff2-bef7-fa760b91d23e tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project] Request method failure captured: Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgvDwGx4rlIGh1d5x4lp4pll0ELtEuGpJ7Q1bymjMGvYdfk73UuiHxlR3U3tnd63dXT9Tbds5XTCfAOin-W-aH0LE7ScZQelol2fdqGZRQJR-CYBAvFePGGOHrZY5rvpAdbvhHTGm5K2eGNtCyFcwrmPhxsMEUi6L_gW8M5axBtxLQ Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 0ce6d5049a93493289028932b886affd Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:48.750627 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:48.753391 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0ce6d5049a93493289028932b886affd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ce6d5049a93493289028932b886affd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ce6d5049a93493289028932b886affd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0ce6d5049a93493289028932b886affd"}]}] Oct 04 20:31:48.753391 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 Oct 04 20:31:48.753391 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 0ce6d5049a93493289028932b886affd Oct 04 20:31:48.753391 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 Oct 04 20:31:48.753391 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project Oct 04 20:31:48.753391 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:48.753391 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:48.753391 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 3b96fba70dbf4586b522c5bd1cb74f16 Oct 04 20:31:48.753391 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project Oct 04 20:31:48.753391 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: action_args: {} Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:48.754638 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 20:31:48.763655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.766820 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8611d869-7256-4ff2-bef7-fa760b91d23e tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:48.766820 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8611d869-7256-4ff2-bef7-fa760b91d23e tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.718796 Oct 04 20:31:48.769609 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 115/227] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 4 20:31:48 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 729 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:31:48.780209 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-232f12eb-950d-41a4-904e-795c562ff29a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:48.781761 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-232f12eb-950d-41a4-904e-795c562ff29a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:48.801337 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-232f12eb-950d-41a4-904e-795c562ff29a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:48.806629 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-232f12eb-950d-41a4-904e-795c562ff29a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:48.808533 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-232f12eb-950d-41a4-904e-795c562ff29a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:48.810590 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-232f12eb-950d-41a4-904e-795c562ff29a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:48.812330 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-232f12eb-950d-41a4-904e-795c562ff29a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:48.814058 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-232f12eb-950d-41a4-904e-795c562ff29a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:49.094794 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-98bc3186-6dcc-41d2-a20f-895d3e7e3a09 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:49.114604 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-98bc3186-6dcc-41d2-a20f-895d3e7e3a09 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1338 microversion: 2.1 time: 0.538576 Oct 04 20:31:49.116792 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 113/228] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:48 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1338 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:49.126738 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-60d40db7-ca31-47c3-805c-81208d6c326c tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:49.131483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-60d40db7-ca31-47c3-805c-81208d6c326c tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '3b96fba70dbf4586b522c5bd1cb74f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce6d5049a93493289028932b886affd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-60d40db7-ca31-47c3-805c-81208d6c326c tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project] Request method failure captured: Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2020:31:48 HTTP/1.1 Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgvDwGx4rlIGh1d5x4lp4pll0ELtEuGpJ7Q1bymjMGvYdfk73UuiHxlR3U3tnd63dXT9Tbds5XTCfAOin-W-aH0LE7ScZQelol2fdqGZRQJR-CYBAvFePGGOHrZY5rvpAdbvhHTGm5K2eGNtCyFcwrmPhxsMEUi6L_gW8M5axBtxLQ Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 0ce6d5049a93493289028932b886affd Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:31:49.135513 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:31:49.140958 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0ce6d5049a93493289028932b886affd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ce6d5049a93493289028932b886affd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ce6d5049a93493289028932b886affd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0ce6d5049a93493289028932b886affd"}]}] Oct 04 20:31:49.140958 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 Oct 04 20:31:49.140958 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 0ce6d5049a93493289028932b886affd Oct 04 20:31:49.140958 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 Oct 04 20:31:49.140958 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project Oct 04 20:31:49.140958 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:49.140958 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:49.140958 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 3b96fba70dbf4586b522c5bd1cb74f16 Oct 04 20:31:49.140958 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project Oct 04 20:31:49.140958 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '2022-10-04 20:31:48'} Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:49.142031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 20:31:49.145249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.147497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-60d40db7-ca31-47c3-805c-81208d6c326c tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:49.148731 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-60d40db7-ca31-47c3-805c-81208d6c326c tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396 tempest-InstanceUsageAuditLogNegativeTestJSON-1071291396-project] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 20:31:48" status: 403 len: 128 microversion: 2.1 time: 0.019708 Oct 04 20:31:49.150602 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 114/229] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:31:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2020%3A31%3A48 => generated 128 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:49.199672 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-232f12eb-950d-41a4-904e-795c562ff29a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:49.207248 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=100 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:49.216468 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-232f12eb-950d-41a4-904e-795c562ff29a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 0.444640 Oct 04 20:31:49.217705 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 116/230] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:48 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:49.633420 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d6438e1b-80e7-4ec7-a54a-0a9acd54005e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:49.634988 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d6438e1b-80e7-4ec7-a54a-0a9acd54005e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:49.649456 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d6438e1b-80e7-4ec7-a54a-0a9acd54005e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:49.650778 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d6438e1b-80e7-4ec7-a54a-0a9acd54005e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:49.651347 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d6438e1b-80e7-4ec7-a54a-0a9acd54005e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:49.652509 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d6438e1b-80e7-4ec7-a54a-0a9acd54005e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:49.653090 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d6438e1b-80e7-4ec7-a54a-0a9acd54005e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:49.653867 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d6438e1b-80e7-4ec7-a54a-0a9acd54005e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.109470 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d6438e1b-80e7-4ec7-a54a-0a9acd54005e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:50.124566 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d6438e1b-80e7-4ec7-a54a-0a9acd54005e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1491 microversion: 2.1 time: 0.502359 Oct 04 20:31:50.125601 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 115/231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:49 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1491 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:50.172614 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8beffd95-dc02-4cd8-92d7-7bbbe8ce1cdc tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:50.179565 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8beffd95-dc02-4cd8-92d7-7bbbe8ce1cdc tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:50.197913 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8beffd95-dc02-4cd8-92d7-7bbbe8ce1cdc tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.198413 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8beffd95-dc02-4cd8-92d7-7bbbe8ce1cdc tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.199006 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8beffd95-dc02-4cd8-92d7-7bbbe8ce1cdc tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.205867 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8beffd95-dc02-4cd8-92d7-7bbbe8ce1cdc tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.206693 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8beffd95-dc02-4cd8-92d7-7bbbe8ce1cdc tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.207278 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8beffd95-dc02-4cd8-92d7-7bbbe8ce1cdc tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.666977 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8beffd95-dc02-4cd8-92d7-7bbbe8ce1cdc tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:50.710545 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8beffd95-dc02-4cd8-92d7-7bbbe8ce1cdc tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1488 microversion: 2.1 time: 0.554826 Oct 04 20:31:50.757450 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 117/232] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:50 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1488 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:50.765441 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1d9420af-f61a-4b88-a987-258ea7f1eb61 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:50.766629 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1d9420af-f61a-4b88-a987-258ea7f1eb61 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:50.811986 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-efcc3445-c13d-4a99-bc29-3501f93a3f9c tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:50.812878 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-efcc3445-c13d-4a99-bc29-3501f93a3f9c tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:50.834100 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d9420af-f61a-4b88-a987-258ea7f1eb61 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.835026 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d9420af-f61a-4b88-a987-258ea7f1eb61 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.835920 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d9420af-f61a-4b88-a987-258ea7f1eb61 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.838277 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d9420af-f61a-4b88-a987-258ea7f1eb61 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.839970 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d9420af-f61a-4b88-a987-258ea7f1eb61 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.840854 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d9420af-f61a-4b88-a987-258ea7f1eb61 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.866218 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-efcc3445-c13d-4a99-bc29-3501f93a3f9c tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.870490 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-efcc3445-c13d-4a99-bc29-3501f93a3f9c tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.877011 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-efcc3445-c13d-4a99-bc29-3501f93a3f9c tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.877520 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-efcc3445-c13d-4a99-bc29-3501f93a3f9c tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.878022 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-efcc3445-c13d-4a99-bc29-3501f93a3f9c tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.878471 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-efcc3445-c13d-4a99-bc29-3501f93a3f9c tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:51.152237 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1d9420af-f61a-4b88-a987-258ea7f1eb61 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:51.180718 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1d9420af-f61a-4b88-a987-258ea7f1eb61 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 0.418092 Oct 04 20:31:51.180718 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 118/233] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:50 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:51.183007 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-49a03e66-569b-49fd-982d-40c7b2555308 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:51.184523 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-49a03e66-569b-49fd-982d-40c7b2555308 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:51.193194 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49a03e66-569b-49fd-982d-40c7b2555308 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:51.193999 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49a03e66-569b-49fd-982d-40c7b2555308 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:51.194678 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49a03e66-569b-49fd-982d-40c7b2555308 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:51.195862 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49a03e66-569b-49fd-982d-40c7b2555308 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:51.196696 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49a03e66-569b-49fd-982d-40c7b2555308 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:51.197414 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49a03e66-569b-49fd-982d-40c7b2555308 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:51.227320 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-efcc3445-c13d-4a99-bc29-3501f93a3f9c tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:31:51.564661 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:52.394756 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-efcc3445-c13d-4a99-bc29-3501f93a3f9c tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 204 len: 0 microversion: 2.1 time: 2.233938 Oct 04 20:31:52.395815 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-49a03e66-569b-49fd-982d-40c7b2555308 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1641 microversion: 2.1 time: 1.215185 Oct 04 20:31:52.396456 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 119/234] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:51 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1641 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:52.398206 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 116/235] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:31:50 2022] DELETE /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 0 bytes in 2241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:31:52.417666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ed37d3ac-be3d-4121-a9b2-e2a50e86fe97 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:52.419090 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ed37d3ac-be3d-4121-a9b2-e2a50e86fe97 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:52.437438 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ed37d3ac-be3d-4121-a9b2-e2a50e86fe97 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:52.438516 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ed37d3ac-be3d-4121-a9b2-e2a50e86fe97 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:52.440576 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ed37d3ac-be3d-4121-a9b2-e2a50e86fe97 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:52.443374 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ed37d3ac-be3d-4121-a9b2-e2a50e86fe97 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:52.445859 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ed37d3ac-be3d-4121-a9b2-e2a50e86fe97 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:52.446940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ed37d3ac-be3d-4121-a9b2-e2a50e86fe97 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:52.764380 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ed37d3ac-be3d-4121-a9b2-e2a50e86fe97 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:52.783233 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ed37d3ac-be3d-4121-a9b2-e2a50e86fe97 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 0.382928 Oct 04 20:31:52.784306 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 120/236] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:52 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:52.805906 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9c4d4717-f001-4383-b2d9-7b894fbb9b5c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:52.805906 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9c4d4717-f001-4383-b2d9-7b894fbb9b5c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:52.805906 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c4d4717-f001-4383-b2d9-7b894fbb9b5c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:52.810231 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c4d4717-f001-4383-b2d9-7b894fbb9b5c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:52.812683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c4d4717-f001-4383-b2d9-7b894fbb9b5c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:52.815684 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c4d4717-f001-4383-b2d9-7b894fbb9b5c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:52.816559 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c4d4717-f001-4383-b2d9-7b894fbb9b5c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:52.817375 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c4d4717-f001-4383-b2d9-7b894fbb9b5c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.092441 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9c4d4717-f001-4383-b2d9-7b894fbb9b5c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:53.111929 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9c4d4717-f001-4383-b2d9-7b894fbb9b5c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1497 microversion: 2.1 time: 0.324876 Oct 04 20:31:53.114059 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 121/237] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:52 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1497 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:53.128644 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7930b506-4a17-49ff-8e5b-cd4079324e7c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.131923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7930b506-4a17-49ff-8e5b-cd4079324e7c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:53.144293 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7930b506-4a17-49ff-8e5b-cd4079324e7c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.145432 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7930b506-4a17-49ff-8e5b-cd4079324e7c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.147178 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7930b506-4a17-49ff-8e5b-cd4079324e7c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.148489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7930b506-4a17-49ff-8e5b-cd4079324e7c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.150571 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7930b506-4a17-49ff-8e5b-cd4079324e7c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.152413 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7930b506-4a17-49ff-8e5b-cd4079324e7c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.216863 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-766405ac-cd43-4cfe-a347-e04a76355c83 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Calling method '.version_select at 0x7f77efbb93a0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.223665 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-766405ac-cd43-4cfe-a347-e04a76355c83 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.224265 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-766405ac-cd43-4cfe-a347-e04a76355c83 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.225031 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-766405ac-cd43-4cfe-a347-e04a76355c83 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.244800 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7930b506-4a17-49ff-8e5b-cd4079324e7c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:31:53.274325 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-766405ac-cd43-4cfe-a347-e04a76355c83 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.287164 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-766405ac-cd43-4cfe-a347-e04a76355c83 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.287164 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-766405ac-cd43-4cfe-a347-e04a76355c83 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.315064 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-766405ac-cd43-4cfe-a347-e04a76355c83 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.316014 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-766405ac-cd43-4cfe-a347-e04a76355c83 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.322245 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-766405ac-cd43-4cfe-a347-e04a76355c83 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.336247 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-766405ac-cd43-4cfe-a347-e04a76355c83 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.934085 Oct 04 20:31:53.343978 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 117/238] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:53.351216 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fce917b9-a32d-4208-8d71-a39ccf14751a tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Calling method '.version_select at 0x7f77efdaa5e0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.356842 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fce917b9-a32d-4208-8d71-a39ccf14751a tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.357593 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fce917b9-a32d-4208-8d71-a39ccf14751a tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.358666 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fce917b9-a32d-4208-8d71-a39ccf14751a tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.366562 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:53.391001 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fce917b9-a32d-4208-8d71-a39ccf14751a tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.391943 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fce917b9-a32d-4208-8d71-a39ccf14751a tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.392694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fce917b9-a32d-4208-8d71-a39ccf14751a tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.417281 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fce917b9-a32d-4208-8d71-a39ccf14751a tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.419908 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fce917b9-a32d-4208-8d71-a39ccf14751a tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.420991 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fce917b9-a32d-4208-8d71-a39ccf14751a tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.436776 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fce917b9-a32d-4208-8d71-a39ccf14751a tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.090870 Oct 04 20:31:53.438308 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 118/239] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:53.466029 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8cb3a838-3663-42ce-8047-88ed3ee032aa tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Calling method '.version_select at 0x7f77efbb2280>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.468173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8cb3a838-3663-42ce-8047-88ed3ee032aa tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.468849 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8cb3a838-3663-42ce-8047-88ed3ee032aa tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.469592 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8cb3a838-3663-42ce-8047-88ed3ee032aa tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.492376 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8cb3a838-3663-42ce-8047-88ed3ee032aa tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.493823 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8cb3a838-3663-42ce-8047-88ed3ee032aa tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.494857 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8cb3a838-3663-42ce-8047-88ed3ee032aa tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.516491 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8cb3a838-3663-42ce-8047-88ed3ee032aa tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.517781 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8cb3a838-3663-42ce-8047-88ed3ee032aa tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.518838 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8cb3a838-3663-42ce-8047-88ed3ee032aa tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.531050 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8cb3a838-3663-42ce-8047-88ed3ee032aa tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.068564 Oct 04 20:31:53.532909 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 119/240] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:53.553027 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bae439c1-11f2-4ee4-908c-95bc8bf486ac tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Calling method '.version_select at 0x7f77efdaad30>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.559123 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bae439c1-11f2-4ee4-908c-95bc8bf486ac tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.560456 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bae439c1-11f2-4ee4-908c-95bc8bf486ac tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.561468 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bae439c1-11f2-4ee4-908c-95bc8bf486ac tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.596561 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bae439c1-11f2-4ee4-908c-95bc8bf486ac tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.597516 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bae439c1-11f2-4ee4-908c-95bc8bf486ac tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.598303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bae439c1-11f2-4ee4-908c-95bc8bf486ac tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.612234 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bae439c1-11f2-4ee4-908c-95bc8bf486ac tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.067024 Oct 04 20:31:53.614507 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 120/241] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:53.644467 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b0b4ab13-947e-41e1-95e1-548dc62bf809 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Calling method '.version_select at 0x7f77efbb20d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.648842 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b0b4ab13-947e-41e1-95e1-548dc62bf809 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.650450 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b0b4ab13-947e-41e1-95e1-548dc62bf809 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.652779 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b0b4ab13-947e-41e1-95e1-548dc62bf809 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.711201 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b0b4ab13-947e-41e1-95e1-548dc62bf809 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.072386 Oct 04 20:31:53.712803 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 121/242] 10.222.0.78 () {58 vars in 1179 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:53.736736 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-80fcdb7c-083f-4dc1-a4be-4a317c22b466 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Calling method '.version_select at 0x7f77efdaa3a0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.758200 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80fcdb7c-083f-4dc1-a4be-4a317c22b466 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.764868 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80fcdb7c-083f-4dc1-a4be-4a317c22b466 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.766566 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80fcdb7c-083f-4dc1-a4be-4a317c22b466 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.803576 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80fcdb7c-083f-4dc1-a4be-4a317c22b466 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.804944 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80fcdb7c-083f-4dc1-a4be-4a317c22b466 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.805836 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80fcdb7c-083f-4dc1-a4be-4a317c22b466 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.846779 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80fcdb7c-083f-4dc1-a4be-4a317c22b466 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.848192 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80fcdb7c-083f-4dc1-a4be-4a317c22b466 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.848999 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80fcdb7c-083f-4dc1-a4be-4a317c22b466 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.871406 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-80fcdb7c-083f-4dc1-a4be-4a317c22b466 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.142574 Oct 04 20:31:53.872721 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 122/243] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:53.894135 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cce82032-5e2c-40f7-9e58-ede1c0c810a3 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.894546 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cce82032-5e2c-40f7-9e58-ede1c0c810a3 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:53.909900 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cce82032-5e2c-40f7-9e58-ede1c0c810a3 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.911030 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cce82032-5e2c-40f7-9e58-ede1c0c810a3 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.911884 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cce82032-5e2c-40f7-9e58-ede1c0c810a3 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.913179 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cce82032-5e2c-40f7-9e58-ede1c0c810a3 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.913996 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cce82032-5e2c-40f7-9e58-ede1c0c810a3 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.915539 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cce82032-5e2c-40f7-9e58-ede1c0c810a3 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.931355 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7930b506-4a17-49ff-8e5b-cd4079324e7c tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 204 len: 0 microversion: 2.1 time: 0.814618 Oct 04 20:31:53.932324 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 122/244] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:31:53 2022] DELETE /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:31:53.940840 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1f8a9ff6-e7f2-410e-88a7-f6238e768290 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Calling method '.version_select at 0x7f77efdeb0d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.944485 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f8a9ff6-e7f2-410e-88a7-f6238e768290 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.945726 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f8a9ff6-e7f2-410e-88a7-f6238e768290 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.946689 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f8a9ff6-e7f2-410e-88a7-f6238e768290 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.975851 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f8a9ff6-e7f2-410e-88a7-f6238e768290 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.976879 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f8a9ff6-e7f2-410e-88a7-f6238e768290 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.977744 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f8a9ff6-e7f2-410e-88a7-f6238e768290 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.989701 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1f8a9ff6-e7f2-410e-88a7-f6238e768290 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.055379 Oct 04 20:31:53.991414 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 123/245] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:53.999484 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b8b3dd0f-a6de-4503-9678-9052738a0cba tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:54.001152 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b8b3dd0f-a6de-4503-9678-9052738a0cba tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:54.014140 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b8b3dd0f-a6de-4503-9678-9052738a0cba tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.017884 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b8b3dd0f-a6de-4503-9678-9052738a0cba tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.017884 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b8b3dd0f-a6de-4503-9678-9052738a0cba tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.017884 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b8b3dd0f-a6de-4503-9678-9052738a0cba tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.018366 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b8b3dd0f-a6de-4503-9678-9052738a0cba tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.018992 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b8b3dd0f-a6de-4503-9678-9052738a0cba tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.456478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-cce82032-5e2c-40f7-9e58-ede1c0c810a3 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:54.476262 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cce82032-5e2c-40f7-9e58-ede1c0c810a3 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 0.601552 Oct 04 20:31:54.488156 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b8b3dd0f-a6de-4503-9678-9052738a0cba tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:54.488321 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 123/246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:54.517101 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b8b3dd0f-a6de-4503-9678-9052738a0cba tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1494 microversion: 2.1 time: 0.522393 Oct 04 20:31:54.517838 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f226cfba-e7af-417d-a106-59fe1e0208e1 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Calling method '.version_select at 0x7f77efdaa9d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:54.523071 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f226cfba-e7af-417d-a106-59fe1e0208e1 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.524484 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f226cfba-e7af-417d-a106-59fe1e0208e1 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.525561 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f226cfba-e7af-417d-a106-59fe1e0208e1 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.529530 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 124/247] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1494 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:54.570434 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-805d405f-e2fe-4e7a-a08f-76dde5bb7993 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:54.571543 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-805d405f-e2fe-4e7a-a08f-76dde5bb7993 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:54.576485 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f226cfba-e7af-417d-a106-59fe1e0208e1 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.577835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f226cfba-e7af-417d-a106-59fe1e0208e1 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.578974 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f226cfba-e7af-417d-a106-59fe1e0208e1 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.588812 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-805d405f-e2fe-4e7a-a08f-76dde5bb7993 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.589843 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-805d405f-e2fe-4e7a-a08f-76dde5bb7993 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.595792 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f226cfba-e7af-417d-a106-59fe1e0208e1 tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.094484 Oct 04 20:31:54.603098 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-805d405f-e2fe-4e7a-a08f-76dde5bb7993 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.605598 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-805d405f-e2fe-4e7a-a08f-76dde5bb7993 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.606828 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-805d405f-e2fe-4e7a-a08f-76dde5bb7993 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.607897 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-805d405f-e2fe-4e7a-a08f-76dde5bb7993 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.613588 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 124/248] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:54 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:54.630707 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-16c62aa4-9a75-4701-b831-2b296581ccad tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Calling method '.version_select at 0x7f77efa034c0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:54.635910 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-16c62aa4-9a75-4701-b831-2b296581ccad tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.637354 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-16c62aa4-9a75-4701-b831-2b296581ccad tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.638533 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-16c62aa4-9a75-4701-b831-2b296581ccad tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.666816 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-16c62aa4-9a75-4701-b831-2b296581ccad tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.668628 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-16c62aa4-9a75-4701-b831-2b296581ccad tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.669491 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-16c62aa4-9a75-4701-b831-2b296581ccad tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.700392 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-16c62aa4-9a75-4701-b831-2b296581ccad tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.701450 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-16c62aa4-9a75-4701-b831-2b296581ccad tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.702383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-16c62aa4-9a75-4701-b831-2b296581ccad tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.945699 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-805d405f-e2fe-4e7a-a08f-76dde5bb7993 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:54.963742 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-805d405f-e2fe-4e7a-a08f-76dde5bb7993 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1497 microversion: 2.1 time: 0.431874 Oct 04 20:31:54.965748 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 125/249] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:54 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1497 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:55.085504 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-16c62aa4-9a75-4701-b831-2b296581ccad tempest-HypervisorAdminTestJSON-619759096 tempest-HypervisorAdminTestJSON-619759096-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.457352 Oct 04 20:31:55.085504 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 125/250] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 4 20:31:54 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:55.273047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-1e39e417-0dbb-4004-9f6c-5b9dafcff6c7 req-8134cccb-5351-4bd1-9934-8ab0293d74fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "657c60d3-dfa6-4665-aa9c-66cf28399f64", "tag": "92bc6db0-cee2-4ded-8108-fb4d85ea7465"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:55.289646 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-1e39e417-0dbb-4004-9f6c-5b9dafcff6c7 req-8134cccb-5351-4bd1-9934-8ab0293d74fe service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:55.291023 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-1e39e417-0dbb-4004-9f6c-5b9dafcff6c7 req-8134cccb-5351-4bd1-9934-8ab0293d74fe service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:55.292148 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-1e39e417-0dbb-4004-9f6c-5b9dafcff6c7 req-8134cccb-5351-4bd1-9934-8ab0293d74fe service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:55.526101 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cb74d07b-da7f-4cb2-b488-a17957d69676 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:55.528893 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cb74d07b-da7f-4cb2-b488-a17957d69676 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:55.543573 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cb74d07b-da7f-4cb2-b488-a17957d69676 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:55.544971 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cb74d07b-da7f-4cb2-b488-a17957d69676 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:55.546147 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cb74d07b-da7f-4cb2-b488-a17957d69676 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:55.547747 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cb74d07b-da7f-4cb2-b488-a17957d69676 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:55.548694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cb74d07b-da7f-4cb2-b488-a17957d69676 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:55.549521 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cb74d07b-da7f-4cb2-b488-a17957d69676 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:55.579376 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-1e39e417-0dbb-4004-9f6c-5b9dafcff6c7 req-8134cccb-5351-4bd1-9934-8ab0293d74fe service nova] Creating event network-changed:92bc6db0-cee2-4ded-8108-fb4d85ea7465 for instance 657c60d3-dfa6-4665-aa9c-66cf28399f64 on n-h2-852085-12 Oct 04 20:31:55.591746 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-1e39e417-0dbb-4004-9f6c-5b9dafcff6c7 req-8134cccb-5351-4bd1-9934-8ab0293d74fe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325563 Oct 04 20:31:55.593489 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 126/251] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:55.603152 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1a5ee3e1-dbeb-4f13-ab94-97c05fa4942d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:55.604580 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1a5ee3e1-dbeb-4f13-ab94-97c05fa4942d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:55.624179 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a5ee3e1-dbeb-4f13-ab94-97c05fa4942d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:55.633556 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a5ee3e1-dbeb-4f13-ab94-97c05fa4942d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:55.634605 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a5ee3e1-dbeb-4f13-ab94-97c05fa4942d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:55.636842 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a5ee3e1-dbeb-4f13-ab94-97c05fa4942d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:55.638496 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a5ee3e1-dbeb-4f13-ab94-97c05fa4942d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:55.639571 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a5ee3e1-dbeb-4f13-ab94-97c05fa4942d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.304547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-cb74d07b-da7f-4cb2-b488-a17957d69676 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:56.320526 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cb74d07b-da7f-4cb2-b488-a17957d69676 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 0.801996 Oct 04 20:31:56.344601 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 126/252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:55 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:56.443531 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1a5ee3e1-dbeb-4f13-ab94-97c05fa4942d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:56.467695 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1a5ee3e1-dbeb-4f13-ab94-97c05fa4942d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1494 microversion: 2.1 time: 0.871729 Oct 04 20:31:56.468699 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 127/253] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:55 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1494 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:56.488036 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0377b921-1a68-4b5a-8b7b-4facd2aa80aa tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:56.489103 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0377b921-1a68-4b5a-8b7b-4facd2aa80aa tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:56.500238 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0377b921-1a68-4b5a-8b7b-4facd2aa80aa tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.501409 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0377b921-1a68-4b5a-8b7b-4facd2aa80aa tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.502379 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0377b921-1a68-4b5a-8b7b-4facd2aa80aa tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.504456 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0377b921-1a68-4b5a-8b7b-4facd2aa80aa tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.505427 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0377b921-1a68-4b5a-8b7b-4facd2aa80aa tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.506444 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0377b921-1a68-4b5a-8b7b-4facd2aa80aa tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.908516 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cadbd6b5-8cf3-49f1-9fa5-4d4e58cd7236 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Calling method '.version_select at 0x7f77ef901790>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:56.916598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cadbd6b5-8cf3-49f1-9fa5-4d4e58cd7236 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.918044 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cadbd6b5-8cf3-49f1-9fa5-4d4e58cd7236 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.919075 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cadbd6b5-8cf3-49f1-9fa5-4d4e58cd7236 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.956531 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cadbd6b5-8cf3-49f1-9fa5-4d4e58cd7236 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.957703 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cadbd6b5-8cf3-49f1-9fa5-4d4e58cd7236 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.958486 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cadbd6b5-8cf3-49f1-9fa5-4d4e58cd7236 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.973001 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0377b921-1a68-4b5a-8b7b-4facd2aa80aa tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:56.982624 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cadbd6b5-8cf3-49f1-9fa5-4d4e58cd7236 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.983549 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cadbd6b5-8cf3-49f1-9fa5-4d4e58cd7236 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.984373 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cadbd6b5-8cf3-49f1-9fa5-4d4e58cd7236 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.994383 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0377b921-1a68-4b5a-8b7b-4facd2aa80aa tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1497 microversion: 2.1 time: 0.521414 Oct 04 20:31:56.996941 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 128/254] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:56 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1497 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:57.008130 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cadbd6b5-8cf3-49f1-9fa5-4d4e58cd7236 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.659994 Oct 04 20:31:57.021976 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 127/255] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:57.222248 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b63b779c-72a8-473c-9d94-fc689a1e83d7 tempest-HypervisorAdminNegativeUnderV252Test-748768284 tempest-HypervisorAdminNegativeUnderV252Test-748768284-project] Calling method '.version_select at 0x7f77f405d820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b63b779c-72a8-473c-9d94-fc689a1e83d7 tempest-HypervisorAdminNegativeUnderV252Test-748768284 tempest-HypervisorAdminNegativeUnderV252Test-748768284-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '3746dba8216340c1b88ed1cba03efac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f749d752d24c0dad0e30c671ab132a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b63b779c-72a8-473c-9d94-fc689a1e83d7 tempest-HypervisorAdminNegativeUnderV252Test-748768284 tempest-HypervisorAdminNegativeUnderV252Test-748768284-project] Request method failure captured: Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-hypervisors/n-h1-852085-12/search HTTP/1.1 Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJg6f1-VkQ9Sn-Vk8gyfhYRmlTtnm1c_TvaYh_e7M79efwCpqe2FscPfdscQanzxkrqrYQtIplI7mHUnuRFyNDFyehnypJeUcW0D6CK3E3Jr1d8CA6-KuaWoHpxNRD8HGjqgc15HCXOCfBoVy5ROF0nrsQupsxToni3yxG86pROAapU Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 77f749d752d24c0dad0e30c671ab132a Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-748768284 Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:57.234618 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:57.237646 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_77f749d752d24c0dad0e30c671ab132a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f749d752d24c0dad0e30c671ab132a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f749d752d24c0dad0e30c671ab132a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/77f749d752d24c0dad0e30c671ab132a"}]}] Oct 04 20:31:57.237646 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-748768284 Oct 04 20:31:57.237646 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 77f749d752d24c0dad0e30c671ab132a Oct 04 20:31:57.237646 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-748768284 Oct 04 20:31:57.237646 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-748768284-project Oct 04 20:31:57.237646 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:57.237646 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:57.237646 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 3746dba8216340c1b88ed1cba03efac9 Oct 04 20:31:57.237646 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-748768284-project Oct 04 20:31:57.237646 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:31:57.237646 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 20:31:57.237646 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'n-h1-852085-12'} Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:57.239191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 20:31:57.241323 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:57.254471 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b63b779c-72a8-473c-9d94-fc689a1e83d7 tempest-HypervisorAdminNegativeUnderV252Test-748768284 tempest-HypervisorAdminNegativeUnderV252Test-748768284-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:57.254471 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b63b779c-72a8-473c-9d94-fc689a1e83d7 tempest-HypervisorAdminNegativeUnderV252Test-748768284 tempest-HypervisorAdminNegativeUnderV252Test-748768284-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/n-h1-852085-12/search" status: 403 len: 117 microversion: 2.1 time: 0.208557 Oct 04 20:31:57.266669 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2aeeda76-c691-4ba4-b4de-cf044b8f920c tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Calling method '.version_select at 0x7f77efbc1d30>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.268782 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 129/256] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Oct 4 20:31:57 2022] GET /compute/v2.1/os-hypervisors/n-h1-852085-12/search => generated 117 bytes in 246 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:57.279051 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2aeeda76-c691-4ba4-b4de-cf044b8f920c tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.279051 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2aeeda76-c691-4ba4-b4de-cf044b8f920c tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.279051 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2aeeda76-c691-4ba4-b4de-cf044b8f920c tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.325120 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-2aeeda76-c691-4ba4-b4de-cf044b8f920c tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2aeeda76-c691-4ba4-b4de-cf044b8f920c tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Request method failure captured: Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJg7n8C76JGvkR8KKcW4XwZrQZkb4o21zM6IKBMPTAq6AM1h8No7oxZGACzwR4lHa0NL1vbUqMIxqUSI-KUVVE983p05azfg3Pj0PY9_j-L65rUMotrjTLGKqN6XOP85ebfJShZyN7zfXXVWrijL8mg_NmYtpyDLLlqXbb7abMOVjsg Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 4077681dfa494f79806ad8e9597eb381 Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1062877203 Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:57.329016 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:57.331557 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4077681dfa494f79806ad8e9597eb381", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4077681dfa494f79806ad8e9597eb381"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4077681dfa494f79806ad8e9597eb381"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4077681dfa494f79806ad8e9597eb381"}]}] Oct 04 20:31:57.331557 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1062877203 Oct 04 20:31:57.331557 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 4077681dfa494f79806ad8e9597eb381 Oct 04 20:31:57.331557 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1062877203 Oct 04 20:31:57.331557 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin Oct 04 20:31:57.331557 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:57.331557 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:57.331557 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 933db2f9ffc242c9b4bf36091a0d6e10 Oct 04 20:31:57.331557 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin Oct 04 20:31:57.331557 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:57.331557 n-d-852085-12 devstack@n-api.service[123539]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 20:31:57.331557 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:57.333061 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:57.335267 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:57.335267 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:57.335267 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:57.335267 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 20:31:57.335267 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:57.335267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2aeeda76-c691-4ba4-b4de-cf044b8f920c tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:57.337633 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2aeeda76-c691-4ba4-b4de-cf044b8f920c tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.074965 Oct 04 20:31:57.347585 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 128/257] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:31:57 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:57.364988 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bea972f1-71ba-4361-974c-3c6cac38996e tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Calling method '.version_select at 0x7f77efe7fee0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.383470 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-846592dd-d3c6-4f19-859a-a5f9188e3fd2 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.387098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-846592dd-d3c6-4f19-859a-a5f9188e3fd2 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:57.393128 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bea972f1-71ba-4361-974c-3c6cac38996e tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.396595 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bea972f1-71ba-4361-974c-3c6cac38996e tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.398771 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bea972f1-71ba-4361-974c-3c6cac38996e tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.406092 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-846592dd-d3c6-4f19-859a-a5f9188e3fd2 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.407838 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-846592dd-d3c6-4f19-859a-a5f9188e3fd2 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.409167 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-846592dd-d3c6-4f19-859a-a5f9188e3fd2 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.410808 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-846592dd-d3c6-4f19-859a-a5f9188e3fd2 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.411783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-846592dd-d3c6-4f19-859a-a5f9188e3fd2 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.412532 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-846592dd-d3c6-4f19-859a-a5f9188e3fd2 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.473861 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bea972f1-71ba-4361-974c-3c6cac38996e tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.476100 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bea972f1-71ba-4361-974c-3c6cac38996e tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.477218 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bea972f1-71ba-4361-974c-3c6cac38996e tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.506172 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bea972f1-71ba-4361-974c-3c6cac38996e tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.509082 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bea972f1-71ba-4361-974c-3c6cac38996e tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.509956 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bea972f1-71ba-4361-974c-3c6cac38996e tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.523415 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bea972f1-71ba-4361-974c-3c6cac38996e tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.166266 Oct 04 20:31:57.528664 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 130/258] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:57.552207 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c4b591f5-f4d6-4e6e-8e26-7fc9307f4ecf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.559081 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c4b591f5-f4d6-4e6e-8e26-7fc9307f4ecf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:57.608099 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4b591f5-f4d6-4e6e-8e26-7fc9307f4ecf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.611843 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4b591f5-f4d6-4e6e-8e26-7fc9307f4ecf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.613367 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4b591f5-f4d6-4e6e-8e26-7fc9307f4ecf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.621353 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4b591f5-f4d6-4e6e-8e26-7fc9307f4ecf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.622358 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4b591f5-f4d6-4e6e-8e26-7fc9307f4ecf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.625070 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4b591f5-f4d6-4e6e-8e26-7fc9307f4ecf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.898634 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c4b591f5-f4d6-4e6e-8e26-7fc9307f4ecf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:57.928298 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c4b591f5-f4d6-4e6e-8e26-7fc9307f4ecf tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1452 microversion: 2.1 time: 0.388313 Oct 04 20:31:57.929612 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 131/259] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:57 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1452 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:57.945058 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-55fa2c7a-8cee-44d4-82bd-47d1d7727f24 tempest-HypervisorAdminNegativeUnderV252Test-748768284 tempest-HypervisorAdminNegativeUnderV252Test-748768284-project] Calling method '.version_select at 0x7f77efd39a60>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.949196 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-55fa2c7a-8cee-44d4-82bd-47d1d7727f24 tempest-HypervisorAdminNegativeUnderV252Test-748768284 tempest-HypervisorAdminNegativeUnderV252Test-748768284-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '3746dba8216340c1b88ed1cba03efac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f749d752d24c0dad0e30c671ab132a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-55fa2c7a-8cee-44d4-82bd-47d1d7727f24 tempest-HypervisorAdminNegativeUnderV252Test-748768284 tempest-HypervisorAdminNegativeUnderV252Test-748768284-project] Request method failure captured: Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJg6f1-VkQ9Sn-Vk8gyfhYRmlTtnm1c_TvaYh_e7M79efwCpqe2FscPfdscQanzxkrqrYQtIplI7mHUnuRFyNDFyehnypJeUcW0D6CK3E3Jr1d8CA6-KuaWoHpxNRD8HGjqgc15HCXOCfBoVy5ROF0nrsQupsxToni3yxG86pROAapU Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 77f749d752d24c0dad0e30c671ab132a Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-748768284 Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:31:57.951446 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:31:57.953141 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_77f749d752d24c0dad0e30c671ab132a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f749d752d24c0dad0e30c671ab132a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f749d752d24c0dad0e30c671ab132a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/77f749d752d24c0dad0e30c671ab132a"}]}] Oct 04 20:31:57.953141 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-748768284 Oct 04 20:31:57.953141 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 77f749d752d24c0dad0e30c671ab132a Oct 04 20:31:57.953141 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-748768284 Oct 04 20:31:57.953141 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-748768284-project Oct 04 20:31:57.953141 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:31:57.953141 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:31:57.953141 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 3746dba8216340c1b88ed1cba03efac9 Oct 04 20:31:57.953141 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-748768284-project Oct 04 20:31:57.953141 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:31:57.953141 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 20:31:57.953141 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '1'} Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:57.953941 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 20:31:57.955332 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:31:57.958502 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-55fa2c7a-8cee-44d4-82bd-47d1d7727f24 tempest-HypervisorAdminNegativeUnderV252Test-748768284 tempest-HypervisorAdminNegativeUnderV252Test-748768284-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:57.959648 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-55fa2c7a-8cee-44d4-82bd-47d1d7727f24 tempest-HypervisorAdminNegativeUnderV252Test-748768284 tempest-HypervisorAdminNegativeUnderV252Test-748768284-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.028464 Oct 04 20:31:57.960830 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 132/260] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 4 20:31:57 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:57.975008 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-1491744f-0ead-430d-b48b-201255fdd1a7 req-3c5f2e22-1407-44df-973e-266552718a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0867584d-2285-41b4-b1b9-0af13aa79dc1", "name": "network-vif-deleted", "tag": "33c37c69-333d-405a-a27c-efb298d34226"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:58.007626 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-846592dd-d3c6-4f19-859a-a5f9188e3fd2 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:58.029139 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-846592dd-d3c6-4f19-859a-a5f9188e3fd2 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 0.652883 Oct 04 20:31:58.029350 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-1491744f-0ead-430d-b48b-201255fdd1a7 req-3c5f2e22-1407-44df-973e-266552718a41 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.029514 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 129/261] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:57 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:58.029673 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-1491744f-0ead-430d-b48b-201255fdd1a7 req-3c5f2e22-1407-44df-973e-266552718a41 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.029673 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-1491744f-0ead-430d-b48b-201255fdd1a7 req-3c5f2e22-1407-44df-973e-266552718a41 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:58.035413 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d0e6a4cd-bd87-4534-b3bd-43fe35523ab7 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Calling method '.version_select at 0x7f77efbc18b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:58.038919 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0e6a4cd-bd87-4534-b3bd-43fe35523ab7 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.039851 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0e6a4cd-bd87-4534-b3bd-43fe35523ab7 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.040659 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0e6a4cd-bd87-4534-b3bd-43fe35523ab7 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:58.051313 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-d0e6a4cd-bd87-4534-b3bd-43fe35523ab7 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] HTTP exception thrown: No hypervisor matching 'a918da93-c418-45f4-aa7e-a9748c37361d' could be found. Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d0e6a4cd-bd87-4534-b3bd-43fe35523ab7 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Request method failure captured: Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-hypervisors/a918da93-c418-45f4-aa7e-a9748c37361d/servers HTTP/1.1 Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJg7n8C76JGvkR8KKcW4XwZrQZkb4o21zM6IKBMPTAq6AM1h8No7oxZGACzwR4lHa0NL1vbUqMIxqUSI-KUVVE983p05azfg3Pj0PY9_j-L65rUMotrjTLGKqN6XOP85ebfJShZyN7zfXXVWrijL8mg_NmYtpyDLLlqXbb7abMOVjsg Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 4077681dfa494f79806ad8e9597eb381 Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1062877203 Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:31:58.053313 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:31:58.056447 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4077681dfa494f79806ad8e9597eb381", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4077681dfa494f79806ad8e9597eb381"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4077681dfa494f79806ad8e9597eb381"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4077681dfa494f79806ad8e9597eb381"}]}] Oct 04 20:31:58.056447 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1062877203 Oct 04 20:31:58.056447 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 4077681dfa494f79806ad8e9597eb381 Oct 04 20:31:58.056447 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1062877203 Oct 04 20:31:58.056447 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin Oct 04 20:31:58.056447 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:31:58.056447 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:31:58.056447 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 933db2f9ffc242c9b4bf36091a0d6e10 Oct 04 20:31:58.056447 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin Oct 04 20:31:58.056447 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:31:58.056447 n-d-852085-12 devstack@n-api.service[123539]: exception: No hypervisor matching 'a918da93-c418-45f4-aa7e-a9748c37361d' could be found. Oct 04 20:31:58.056447 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'a918da93-c418-45f4-aa7e-a9748c37361d'} Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'a918da93-c418-45f4-aa7e-a9748c37361d' could be found. Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:58.057893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:58.059538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:58.059538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:58.059538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:58.059538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:58.059538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'a918da93-c418-45f4-aa7e-a9748c37361d' could be found. Oct 04 20:31:58.059538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:31:58.061018 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d0e6a4cd-bd87-4534-b3bd-43fe35523ab7 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] Returning 404 to user: No hypervisor matching 'a918da93-c418-45f4-aa7e-a9748c37361d' could be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:58.066254 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d0e6a4cd-bd87-4534-b3bd-43fe35523ab7 tempest-HypervisorAdminNegativeUnderV252Test-1062877203 tempest-HypervisorAdminNegativeUnderV252Test-1062877203-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/a918da93-c418-45f4-aa7e-a9748c37361d/servers" status: 404 len: 123 microversion: 2.1 time: 0.040143 Oct 04 20:31:58.073271 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 130/262] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Oct 4 20:31:58 2022] GET /compute/v2.1/os-hypervisors/a918da93-c418-45f4-aa7e-a9748c37361d/servers => generated 123 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:58.075755 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-1491744f-0ead-430d-b48b-201255fdd1a7 req-3c5f2e22-1407-44df-973e-266552718a41 service nova] Creating event network-vif-deleted:33c37c69-333d-405a-a27c-efb298d34226 for instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 on n-h1-852085-12 Oct 04 20:31:58.082256 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-66311898-e968-4827-ab35-2817ec54295a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:58.096293 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-66311898-e968-4827-ab35-2817ec54295a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:58.100670 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-1491744f-0ead-430d-b48b-201255fdd1a7 req-3c5f2e22-1407-44df-973e-266552718a41 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132319 Oct 04 20:31:58.101765 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 133/263] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:58.114563 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-66311898-e968-4827-ab35-2817ec54295a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.116013 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-66311898-e968-4827-ab35-2817ec54295a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.117123 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-66311898-e968-4827-ab35-2817ec54295a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:58.118996 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-66311898-e968-4827-ab35-2817ec54295a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.120598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-66311898-e968-4827-ab35-2817ec54295a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.121826 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-66311898-e968-4827-ab35-2817ec54295a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:58.268143 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-a76648a6-9a9e-4495-94c0-17d7c10619af req-a341ab76-1824-4051-9290-c22c0bb0a5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660c3eff-854d-4e7c-8247-4a992eda69ce", "name": "network-vif-deleted", "tag": "c2470e19-f860-43fa-ba0b-4b54f80cea9b"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:58.321000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-a76648a6-9a9e-4495-94c0-17d7c10619af req-a341ab76-1824-4051-9290-c22c0bb0a5b8 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.337756 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-a76648a6-9a9e-4495-94c0-17d7c10619af req-a341ab76-1824-4051-9290-c22c0bb0a5b8 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.340901 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-a76648a6-9a9e-4495-94c0-17d7c10619af req-a341ab76-1824-4051-9290-c22c0bb0a5b8 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:58.345043 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-66311898-e968-4827-ab35-2817ec54295a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:58.359392 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-66311898-e968-4827-ab35-2817ec54295a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1455 microversion: 2.1 time: 0.281073 Oct 04 20:31:58.373961 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 131/264] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:58 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1455 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:58.404784 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-a76648a6-9a9e-4495-94c0-17d7c10619af req-a341ab76-1824-4051-9290-c22c0bb0a5b8 service nova] Creating event network-vif-deleted:c2470e19-f860-43fa-ba0b-4b54f80cea9b for instance 660c3eff-854d-4e7c-8247-4a992eda69ce on n-h1-852085-12 Oct 04 20:31:58.425318 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-a76648a6-9a9e-4495-94c0-17d7c10619af req-a341ab76-1824-4051-9290-c22c0bb0a5b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168013 Oct 04 20:31:58.427221 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 134/265] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:58.971913 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:58.973207 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:58.994002 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.995478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.996058 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:58.996833 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.997413 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.998086 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:59.075388 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:59.076393 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-76ca8aef-aa37-4574-91d3-70c4632b880d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:59.076961 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:59.077323 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:59.077954 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-76ca8aef-aa37-4574-91d3-70c4632b880d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:59.078898 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lazy-loading 'fault' on Instance uuid 0867584d-2285-41b4-b1b9-0af13aa79dc1 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:31:59.093964 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-76ca8aef-aa37-4574-91d3-70c4632b880d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:59.097074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-76ca8aef-aa37-4574-91d3-70c4632b880d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:59.097074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-76ca8aef-aa37-4574-91d3-70c4632b880d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:59.097460 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-76ca8aef-aa37-4574-91d3-70c4632b880d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:59.098573 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-76ca8aef-aa37-4574-91d3-70c4632b880d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:59.100053 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-76ca8aef-aa37-4574-91d3-70c4632b880d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:59.249242 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72398073905c49ee952b40ce1a53fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ded24c70b54fc5bb73d54fd1537abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:59.282684 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cd60fdf7-1104-41fc-8de9-6814c35f4826 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 200 len: 1328 microversion: 2.1 time: 0.314982 Oct 04 20:31:59.283914 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 132/266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:58 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 1328 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:59.393176 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:59.393779 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:59.410842 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:59.412617 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:59.413596 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:59.416364 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:59.421274 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:59.421274 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:59.585605 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:59.586118 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:59.586638 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:59.587243 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lazy-loading 'fault' on Instance uuid 660c3eff-854d-4e7c-8247-4a992eda69ce {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:31:59.743025 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:59.781714 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ae32ec6a-ca26-4e68-baf8-94c6d46ca69b tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 200 len: 1331 microversion: 2.1 time: 0.390707 Oct 04 20:31:59.786195 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 133/267] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:59 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 1331 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:00.060989 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-76ca8aef-aa37-4574-91d3-70c4632b880d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:00.085474 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-76ca8aef-aa37-4574-91d3-70c4632b880d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 1.016739 Oct 04 20:32:00.097547 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 135/268] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:59 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:00.341809 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cb0892b4-51e9-4861-9155-ae934f47d91d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:00.342906 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cb0892b4-51e9-4861-9155-ae934f47d91d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:00.365230 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cb0892b4-51e9-4861-9155-ae934f47d91d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.366614 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cb0892b4-51e9-4861-9155-ae934f47d91d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.367889 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cb0892b4-51e9-4861-9155-ae934f47d91d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.369576 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cb0892b4-51e9-4861-9155-ae934f47d91d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.371289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cb0892b4-51e9-4861-9155-ae934f47d91d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.372375 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cb0892b4-51e9-4861-9155-ae934f47d91d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.424577 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-cb0892b4-51e9-4861-9155-ae934f47d91d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] HTTP exception thrown: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cb0892b4-51e9-4861-9155-ae934f47d91d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Request method failure captured: Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 HTTP/1.1 Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJf7yVTZBn3xKyM2P073GKzwLeGu1hJXdwzlKPNCfC4VMp00Xanle1Bed7wqJiN32pqzujd0oDWnZbBNSLT5Z_sYn-kj0IqCyYatgYKswU8NuUmHcCBYpRhIwZJMsrKW3CtPDqWCUHvdUC0Tm6a7D-kHeEiuSbklF_Mnbe4iwSdDQ4g Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: d0ded24c70b54fc5bb73d54fd1537abb Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-AggregatesAdminTestJSON-2056268426 Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:32:00.430689 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:32:00.433525 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d0ded24c70b54fc5bb73d54fd1537abb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d0ded24c70b54fc5bb73d54fd1537abb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d0ded24c70b54fc5bb73d54fd1537abb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d0ded24c70b54fc5bb73d54fd1537abb"}]}] Oct 04 20:32:00.433525 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-AggregatesAdminTestJSON-2056268426 Oct 04 20:32:00.433525 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: d0ded24c70b54fc5bb73d54fd1537abb Oct 04 20:32:00.433525 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2056268426 Oct 04 20:32:00.433525 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-AggregatesAdminTestJSON-2056268426-project Oct 04 20:32:00.433525 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:00.433525 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:00.433525 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 72398073905c49ee952b40ce1a53fd28 Oct 04 20:32:00.433525 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-AggregatesAdminTestJSON-2056268426-project Oct 04 20:32:00.433525 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:32:00.433525 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:00.433525 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '0867584d-2285-41b4-b1b9-0af13aa79dc1'} Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:00.440766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:00.443269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.445154 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cb0892b4-51e9-4861-9155-ae934f47d91d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Returning 404 to user: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:00.445154 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cb0892b4-51e9-4861-9155-ae934f47d91d tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 404 len: 111 microversion: 2.1 time: 0.106850 Oct 04 20:32:00.449560 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 134/269] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:00 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:00.465472 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c8752444-097e-4e2e-a94c-01927c5398ff tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852085-12"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:00.508363 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c8752444-097e-4e2e-a94c-01927c5398ff tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.511951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c8752444-097e-4e2e-a94c-01927c5398ff tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.513453 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c8752444-097e-4e2e-a94c-01927c5398ff tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.523592 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:00.825264 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c69f3646-4e10-4b85-b116-6a47230fcf79 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:00.826936 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c69f3646-4e10-4b85-b116-6a47230fcf79 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:00.841360 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c69f3646-4e10-4b85-b116-6a47230fcf79 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.842980 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c69f3646-4e10-4b85-b116-6a47230fcf79 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.845433 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c69f3646-4e10-4b85-b116-6a47230fcf79 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.847565 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c69f3646-4e10-4b85-b116-6a47230fcf79 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.848727 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c69f3646-4e10-4b85-b116-6a47230fcf79 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.850990 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c69f3646-4e10-4b85-b116-6a47230fcf79 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.902707 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-c69f3646-4e10-4b85-b116-6a47230fcf79 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] HTTP exception thrown: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c69f3646-4e10-4b85-b116-6a47230fcf79 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Request method failure captured: Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce HTTP/1.1 Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJf7KgqHQaon8yx_4NdgYCvKwAuQ5vq_E18Qd9Jbsj6nmOv4l-Ghb-l49U0l3WJqoVm5GGBPPfA0A7xcYdBPUf5PBKr0F1hy5lKhjihI_yfaRIfwAfIFoWiGXksYQd-DOs1E9k5t5gPP_l0p0YBk6q_CyUMyV4MmBXqXt2MisIUz-tc Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 13bcdec8c8d64e97b49281a0e16b0d79 Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:32:00.905866 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:32:00.917588 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_13bcdec8c8d64e97b49281a0e16b0d79", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/13bcdec8c8d64e97b49281a0e16b0d79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/13bcdec8c8d64e97b49281a0e16b0d79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/13bcdec8c8d64e97b49281a0e16b0d79"}]}] Oct 04 20:32:00.917588 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:00.917588 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 13bcdec8c8d64e97b49281a0e16b0d79 Oct 04 20:32:00.917588 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:00.917588 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-DeleteServersAdminTestJSON-2089848328-project Oct 04 20:32:00.917588 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:00.917588 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:00.917588 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: c0986e6de5204c4d86e24184039366e0 Oct 04 20:32:00.917588 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-DeleteServersAdminTestJSON-2089848328-project Oct 04 20:32:00.917588 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:32:00.917588 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:00.917588 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '660c3eff-854d-4e7c-8247-4a992eda69ce'} Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:00.918789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:00.919983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.921310 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c69f3646-4e10-4b85-b116-6a47230fcf79 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Returning 404 to user: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:00.921310 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c69f3646-4e10-4b85-b116-6a47230fcf79 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 404 len: 111 microversion: 2.1 time: 0.092596 Oct 04 20:32:00.921310 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 135/270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:00 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:01.100675 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c8752444-097e-4e2e-a94c-01927c5398ff tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 297 microversion: 2.1 time: 0.644286 Oct 04 20:32:01.102398 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 136/271] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 4 20:32:00 2022] POST /compute/v2.1/os-aggregates/5/action => generated 297 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:01.128777 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cd3e2713-6803-4efc-8128-5fe1151f21de tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:01.142675 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8a2c7bf1-26a7-4de6-849d-141d6c1358be tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:01.149425 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8a2c7bf1-26a7-4de6-849d-141d6c1358be tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:01.195178 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a2c7bf1-26a7-4de6-849d-141d6c1358be tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:01.195853 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a2c7bf1-26a7-4de6-849d-141d6c1358be tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:01.197330 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a2c7bf1-26a7-4de6-849d-141d6c1358be tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:01.198487 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a2c7bf1-26a7-4de6-849d-141d6c1358be tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:01.199699 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a2c7bf1-26a7-4de6-849d-141d6c1358be tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:01.200472 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a2c7bf1-26a7-4de6-849d-141d6c1358be tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:01.342172 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cd3e2713-6803-4efc-8128-5fe1151f21de tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.224209 Oct 04 20:32:01.346986 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 136/272] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:32:01 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 20:32:01.359773 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-713110079", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:01.550305 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:32:01.973771 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8a2c7bf1-26a7-4de6-849d-141d6c1358be tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:02.002612 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8a2c7bf1-26a7-4de6-849d-141d6c1358be tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 0.865784 Oct 04 20:32:02.005476 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 137/273] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:01 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:02.037074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0aeac8c6-9d04-4080-86c3-550c47d5cef5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-325332320"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:02.037074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.aggregate [None req-0aeac8c6-9d04-4080-86c3-550c47d5cef5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Generated uuid 14067cb7-0215-4264-8777-1442d18499ef for aggregate {{(pid=123540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:32:02.181317 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:32:02.182023 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:32:02.182656 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:32:02.183814 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:32:02.184576 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:32:02.202769 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:02.206013 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:02.206013 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:02.207039 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:02.207654 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:02.208262 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:02.217751 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:02.227786 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:02.235207 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Getting quotas for project 13bcdec8c8d64e97b49281a0e16b0d79. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:02.240531 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Getting quotas for user c0986e6de5204c4d86e24184039366e0 and project 13bcdec8c8d64e97b49281a0e16b0d79. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:02.255914 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:32:02.259087 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:32:02.306202 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0aeac8c6-9d04-4080-86c3-550c47d5cef5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.297876 Oct 04 20:32:02.329275 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 138/274] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:32:02 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:02.337773 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1f32c452-7117-4ab3-9e5f-a28c6c1f37e0 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852085-12"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:02.374632 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f32c452-7117-4ab3-9e5f-a28c6c1f37e0 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:02.374632 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f32c452-7117-4ab3-9e5f-a28c6c1f37e0 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:02.374632 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f32c452-7117-4ab3-9e5f-a28c6c1f37e0 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:02.575984 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-38811c87-391d-4090-bf73-f9f45e0c480e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226657 Oct 04 20:32:02.578952 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 137/275] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:32:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:32:02.626574 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-600546ba-470a-415d-a978-37a0a75462e7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:02.629768 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-600546ba-470a-415d-a978-37a0a75462e7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:02.916608 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-600546ba-470a-415d-a978-37a0a75462e7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:02.948063 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-600546ba-470a-415d-a978-37a0a75462e7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1219 microversion: 2.1 time: 0.359123 Oct 04 20:32:02.949748 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 138/276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:02 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1219 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:03.042576 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-84157355-d137-4c54-bcbc-d5de50c14aa8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:03.043873 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-84157355-d137-4c54-bcbc-d5de50c14aa8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:03.071934 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1f32c452-7117-4ab3-9e5f-a28c6c1f37e0 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.740533 Oct 04 20:32:03.073216 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 139/277] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 4 20:32:02 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:03.090975 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-84157355-d137-4c54-bcbc-d5de50c14aa8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.092576 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-84157355-d137-4c54-bcbc-d5de50c14aa8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.093727 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-84157355-d137-4c54-bcbc-d5de50c14aa8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.094415 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e40bd83e-fb91-438a-a23a-62775cf4f766 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:03.101687 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-84157355-d137-4c54-bcbc-d5de50c14aa8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.101687 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-84157355-d137-4c54-bcbc-d5de50c14aa8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.101687 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-84157355-d137-4c54-bcbc-d5de50c14aa8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.110825 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e40bd83e-fb91-438a-a23a-62775cf4f766 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.022266 Oct 04 20:32:03.124315 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 140/278] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 4 20:32:03 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:32:03.132888 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0ca254c9-b622-49fe-b09c-8ac54e6434c5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852085-12"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:03.153201 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0ca254c9-b622-49fe-b09c-8ac54e6434c5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.153991 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0ca254c9-b622-49fe-b09c-8ac54e6434c5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.154684 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0ca254c9-b622-49fe-b09c-8ac54e6434c5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.818073 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0ca254c9-b622-49fe-b09c-8ac54e6434c5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.691419 Oct 04 20:32:03.839263 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 141/279] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Oct 4 20:32:03 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:03.880291 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ba67765d-115f-46de-8561-6fa836dab89e tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:04.023975 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-84157355-d137-4c54-bcbc-d5de50c14aa8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:04.043101 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-84157355-d137-4c54-bcbc-d5de50c14aa8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 1.005480 Oct 04 20:32:04.045332 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 139/280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:03 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:04.066710 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-39ce43d1-66b8-48a1-b837-fdd2b67304dd tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:04.067861 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-39ce43d1-66b8-48a1-b837-fdd2b67304dd tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:04.127107 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ba67765d-115f-46de-8561-6fa836dab89e tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.275479 Oct 04 20:32:04.141926 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 142/281] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:32:03 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:32:04.153851 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a5c72ba1-fa10-46af-83bf-c833c966b5a4 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-417417850"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:04.174522 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.aggregate [None req-a5c72ba1-fa10-46af-83bf-c833c966b5a4 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Generated uuid 48d6a053-6060-48de-8f16-e1e3b29696e2 for aggregate {{(pid=123540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:32:04.369204 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a5c72ba1-fa10-46af-83bf-c833c966b5a4 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.225530 Oct 04 20:32:04.378429 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 143/282] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:32:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:04.417607 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dee688ec-ce1d-48c4-812b-8bc22daf8b15 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852085-12"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:04.510985 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dee688ec-ce1d-48c4-812b-8bc22daf8b15 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:04.526800 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dee688ec-ce1d-48c4-812b-8bc22daf8b15 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:04.527961 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dee688ec-ce1d-48c4-812b-8bc22daf8b15 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:04.568804 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-39ce43d1-66b8-48a1-b837-fdd2b67304dd tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:04.609192 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-39ce43d1-66b8-48a1-b837-fdd2b67304dd tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1219 microversion: 2.1 time: 0.560511 Oct 04 20:32:04.610260 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 140/283] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:04 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1219 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:04.641864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:05.110637 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-14bce75a-4b2e-4d22-a4b4-67d439ff3e2e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:05.115585 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-14bce75a-4b2e-4d22-a4b4-67d439ff3e2e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:05.143308 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14bce75a-4b2e-4d22-a4b4-67d439ff3e2e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:05.145062 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14bce75a-4b2e-4d22-a4b4-67d439ff3e2e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:05.145637 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14bce75a-4b2e-4d22-a4b4-67d439ff3e2e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:05.146979 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14bce75a-4b2e-4d22-a4b4-67d439ff3e2e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:05.148199 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14bce75a-4b2e-4d22-a4b4-67d439ff3e2e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:05.149158 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14bce75a-4b2e-4d22-a4b4-67d439ff3e2e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:05.249615 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-dee688ec-ce1d-48c4-812b-8bc22daf8b15 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.854575 Oct 04 20:32:05.262196 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 144/284] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 20:32:04 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:32:05.280137 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2e81cf32-7e7d-485b-a864-5a1d10ad559e tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:05.304725 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2e81cf32-7e7d-485b-a864-5a1d10ad559e tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.034137 Oct 04 20:32:05.309503 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 145/285] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 4 20:32:05 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:05.337056 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c4423141-b480-4cfb-8429-2d11ceca6fd6 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852085-12"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:05.375160 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4423141-b480-4cfb-8429-2d11ceca6fd6 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:05.377306 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4423141-b480-4cfb-8429-2d11ceca6fd6 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:05.379905 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4423141-b480-4cfb-8429-2d11ceca6fd6 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:05.775780 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-14bce75a-4b2e-4d22-a4b4-67d439ff3e2e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:05.815685 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-14bce75a-4b2e-4d22-a4b4-67d439ff3e2e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 0.723667 Oct 04 20:32:05.821838 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 141/286] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:05 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:05.833088 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-965005f9-a52d-443e-be5d-4036751d61e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:05.846715 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-965005f9-a52d-443e-be5d-4036751d61e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:05.876968 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-965005f9-a52d-443e-be5d-4036751d61e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:05.880356 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-965005f9-a52d-443e-be5d-4036751d61e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:05.886502 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-965005f9-a52d-443e-be5d-4036751d61e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:05.886502 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-965005f9-a52d-443e-be5d-4036751d61e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:05.893390 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-965005f9-a52d-443e-be5d-4036751d61e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:05.895611 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-965005f9-a52d-443e-be5d-4036751d61e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:06.228372 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c4423141-b480-4cfb-8429-2d11ceca6fd6 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.901462 Oct 04 20:32:06.234193 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 146/287] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 20:32:05 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:06.274730 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-85385f77-1063-42d3-8e41-921f8212e87c tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:06.299114 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-965005f9-a52d-443e-be5d-4036751d61e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:06.318544 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-965005f9-a52d-443e-be5d-4036751d61e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1215 microversion: 2.1 time: 0.494418 Oct 04 20:32:06.320886 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 142/288] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:05 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1215 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:06.458221 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-85385f77-1063-42d3-8e41-921f8212e87c tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.208930 Oct 04 20:32:06.460623 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 147/289] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:32:06 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:32:06.484865 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2be209c3-9115-4a40-ac0a-487b7cdea311 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2080667881"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:06.499459 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.aggregate [None req-2be209c3-9115-4a40-ac0a-487b7cdea311 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Generated uuid 6215c7a3-409b-4512-ba64-55644720f98e for aggregate {{(pid=123539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:32:06.567500 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-99244a35-5a66-48db-8201-cae899b7273d req-31848b6e-eccc-4482-9805-cc7da49972b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "657c60d3-dfa6-4665-aa9c-66cf28399f64", "name": "network-vif-plugged", "status": "completed", "tag": "92bc6db0-cee2-4ded-8108-fb4d85ea7465"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:06.589659 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-99244a35-5a66-48db-8201-cae899b7273d req-31848b6e-eccc-4482-9805-cc7da49972b7 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:06.590479 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-99244a35-5a66-48db-8201-cae899b7273d req-31848b6e-eccc-4482-9805-cc7da49972b7 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:06.591194 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-99244a35-5a66-48db-8201-cae899b7273d req-31848b6e-eccc-4482-9805-cc7da49972b7 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:06.638376 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-99244a35-5a66-48db-8201-cae899b7273d req-31848b6e-eccc-4482-9805-cc7da49972b7 service nova] Creating event network-vif-plugged:92bc6db0-cee2-4ded-8108-fb4d85ea7465 for instance 657c60d3-dfa6-4665-aa9c-66cf28399f64 on n-h2-852085-12 Oct 04 20:32:06.649247 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-99244a35-5a66-48db-8201-cae899b7273d req-31848b6e-eccc-4482-9805-cc7da49972b7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086630 Oct 04 20:32:06.651358 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 148/290] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:06.717105 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2be209c3-9115-4a40-ac0a-487b7cdea311 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.238629 Oct 04 20:32:06.717105 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 143/291] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:32:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:06.727691 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-042b2163-33ba-4d96-ab37-87451d661e34 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852085-12"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:06.754974 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-042b2163-33ba-4d96-ab37-87451d661e34 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:06.755521 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-042b2163-33ba-4d96-ab37-87451d661e34 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:06.756009 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-042b2163-33ba-4d96-ab37-87451d661e34 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:06.848850 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-72e26917-c352-49df-ac55-1b58d67ff17f tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:06.849747 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-72e26917-c352-49df-ac55-1b58d67ff17f tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:06.860175 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-72e26917-c352-49df-ac55-1b58d67ff17f tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:06.861167 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-72e26917-c352-49df-ac55-1b58d67ff17f tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:06.861824 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-72e26917-c352-49df-ac55-1b58d67ff17f tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:06.862996 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-72e26917-c352-49df-ac55-1b58d67ff17f tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:06.863850 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-72e26917-c352-49df-ac55-1b58d67ff17f tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:06.864387 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-72e26917-c352-49df-ac55-1b58d67ff17f tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:07.434386 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-042b2163-33ba-4d96-ab37-87451d661e34 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 244 microversion: 2.1 time: 0.712200 Oct 04 20:32:07.435385 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 149/292] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 20:32:06 2022] POST /compute/v2.1/os-aggregates/11/action => generated 244 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:07.481582 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-46c00b1b-6657-432b-b659-0340201ae8a9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:07.501379 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-46c00b1b-6657-432b-b659-0340201ae8a9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:07.506012 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-72e26917-c352-49df-ac55-1b58d67ff17f tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:07.522157 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-72e26917-c352-49df-ac55-1b58d67ff17f tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 0.677236 Oct 04 20:32:07.529425 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 144/293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:06 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:07.534866 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-46c00b1b-6657-432b-b659-0340201ae8a9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:07.535829 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-46c00b1b-6657-432b-b659-0340201ae8a9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:07.536464 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-46c00b1b-6657-432b-b659-0340201ae8a9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:07.537643 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-46c00b1b-6657-432b-b659-0340201ae8a9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:07.538375 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-46c00b1b-6657-432b-b659-0340201ae8a9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:07.539036 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-46c00b1b-6657-432b-b659-0340201ae8a9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:07.552498 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-82c61d23-82f6-4703-a146-c1baee1577ef tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852085-12"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:07.610934 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-82c61d23-82f6-4703-a146-c1baee1577ef tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:07.613983 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-82c61d23-82f6-4703-a146-c1baee1577ef tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:07.613983 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-82c61d23-82f6-4703-a146-c1baee1577ef tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:08.161607 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-82c61d23-82f6-4703-a146-c1baee1577ef tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.629788 Oct 04 20:32:08.163618 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 145/294] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 20:32:07 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:08.207685 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b4343095-03ce-4fe9-a5d7-7f1b82adaa99 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:08.305400 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-46c00b1b-6657-432b-b659-0340201ae8a9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:08.350672 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-46c00b1b-6657-432b-b659-0340201ae8a9 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1279 microversion: 2.1 time: 0.911233 Oct 04 20:32:08.353275 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 150/295] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:07 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1279 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:08.429615 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b4343095-03ce-4fe9-a5d7-7f1b82adaa99 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.248431 Oct 04 20:32:08.449802 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d4c791e4-9f61-4da9-9544-d5b14848c115 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-85769138"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:08.459083 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.aggregate [None req-d4c791e4-9f61-4da9-9544-d5b14848c115 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Generated uuid a22e696b-56b1-4b5d-8550-b0cf6f462308 for aggregate {{(pid=123540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:32:08.466390 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 146/296] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:32:08 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:32:08.541329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7b0519a0-1f2a-44b7-a1d7-bb099eb98599 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1754315194"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:08.548658 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.aggregate [None req-7b0519a0-1f2a-44b7-a1d7-bb099eb98599 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Generated uuid feb8acc6-cba8-432d-996d-561fd83d99b4 for aggregate {{(pid=123539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:32:08.630223 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d4c791e4-9f61-4da9-9544-d5b14848c115 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.188059 Oct 04 20:32:08.633654 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 151/297] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:32:08 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:08.657818 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f40137d2-d0fb-4489-9bd3-c161d76f6424 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:08.660571 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f40137d2-d0fb-4489-9bd3-c161d76f6424 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:08.700420 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f40137d2-d0fb-4489-9bd3-c161d76f6424 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:08.705172 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f40137d2-d0fb-4489-9bd3-c161d76f6424 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:08.710785 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f40137d2-d0fb-4489-9bd3-c161d76f6424 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:08.715703 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f40137d2-d0fb-4489-9bd3-c161d76f6424 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:08.716183 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7b0519a0-1f2a-44b7-a1d7-bb099eb98599 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.178616 Oct 04 20:32:08.717176 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 147/298] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:32:08 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:32:08.741205 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f40137d2-d0fb-4489-9bd3-c161d76f6424 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:08.741205 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f40137d2-d0fb-4489-9bd3-c161d76f6424 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:08.741612 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4d31a951-693c-4486-b414-8520d89ecd25 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:08.894269 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4d31a951-693c-4486-b414-8520d89ecd25 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.175342 Oct 04 20:32:08.895871 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 148/299] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:32:08 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:32:08.915752 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-25b94259-3890-4059-a10b-757cd6391cd3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852085-12"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:08.968685 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25b94259-3890-4059-a10b-757cd6391cd3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:08.972309 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25b94259-3890-4059-a10b-757cd6391cd3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:08.973275 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25b94259-3890-4059-a10b-757cd6391cd3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:09.589946 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f40137d2-d0fb-4489-9bd3-c161d76f6424 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:09.611621 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f40137d2-d0fb-4489-9bd3-c161d76f6424 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1318 microversion: 2.1 time: 0.963023 Oct 04 20:32:09.623371 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 152/300] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:08 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1318 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:09.648613 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3433cdaf-58d9-402e-b352-b75c0a91d944 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:09.670456 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-3433cdaf-58d9-402e-b352-b75c0a91d944 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 04 20:32:09.671351 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-25b94259-3890-4059-a10b-757cd6391cd3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 244 microversion: 2.1 time: 0.769789 Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3433cdaf-58d9-402e-b352-b75c0a91d944 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Request method failure captured: Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgBhKHGk0NHaib-v9jsjOhK3_jDKJfyxvrJlcA73sdZWNRxJTUyoLwcxK6XyGu3Nqg9lKUhdk_2oRrQEQsTHCprpLfSqCdGZ9TKE2OynF3fa78NvdfWPwfImtEpfSeWjz-awPn616jAXQMSxXWj0KkNA8XDyJ3qTdW_qlX952EH7nY Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 3c732865ac764dfc83bace2444770db8 Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminTestJSON-708441017 Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:32:09.685171 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3c732865ac764dfc83bace2444770db8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3c732865ac764dfc83bace2444770db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3c732865ac764dfc83bace2444770db8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3c732865ac764dfc83bace2444770db8"}]}] Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminTestJSON-708441017 Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 3c732865ac764dfc83bace2444770db8 Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-708441017 Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminTestJSON-708441017-project-admin Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: b8be11263dbb46b6988fcf068c452374 Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminTestJSON-708441017-project-admin Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: exception: Aggregate 12 could not be found. Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '12'} Oct 04 20:32:09.688036 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:09.689727 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 04 20:32:09.692130 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:09.696447 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3433cdaf-58d9-402e-b352-b75c0a91d944 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:09.696613 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 149/301] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 20:32:08 2022] POST /compute/v2.1/os-aggregates/13/action => generated 244 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:09.696767 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3433cdaf-58d9-402e-b352-b75c0a91d944 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.057378 Oct 04 20:32:09.696767 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 153/302] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:32:09 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:32:09.709419 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4cc73d00-02ac-42b8-8a7e-cdd93119a773 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:09.711363 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4cc73d00-02ac-42b8-8a7e-cdd93119a773 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:09.727362 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4cc73d00-02ac-42b8-8a7e-cdd93119a773 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:09.728781 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4cc73d00-02ac-42b8-8a7e-cdd93119a773 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:09.730813 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4cc73d00-02ac-42b8-8a7e-cdd93119a773 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:09.732723 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4cc73d00-02ac-42b8-8a7e-cdd93119a773 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:09.734142 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4cc73d00-02ac-42b8-8a7e-cdd93119a773 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:09.744522 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4cc73d00-02ac-42b8-8a7e-cdd93119a773 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:10.824381 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4cc73d00-02ac-42b8-8a7e-cdd93119a773 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:10.853527 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4cc73d00-02ac-42b8-8a7e-cdd93119a773 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1319 microversion: 2.1 time: 1.155642 Oct 04 20:32:10.883467 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 154/303] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:09 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1319 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:10.909582 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4cb4f892-7579-4ab2-9444-20e8da4f6518 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852085-12"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:10.934431 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4cb4f892-7579-4ab2-9444-20e8da4f6518 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '2a7aaeb417c04b7085a6e752268963c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a6c60df0b14717bf52f10dbe8d68c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4cb4f892-7579-4ab2-9444-20e8da4f6518 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Request method failure captured: Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 43 Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJf649nv-tbYxgR4zV87jnq_6GGcpVUbENA3U1lTf0_n2fUBGe1E4NwZidPBeEXTx4VpwMyS-aS97oWKEalLYNHG98wtcTt2o2J5gfM25h30aqnOrqW0RFtJ5nwfdpaB4qaxRu6_6rPqRLI3WED4xk4tT-GZVw6EdsNEyCCPw-E-u9A Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 43a6c60df0b14717bf52f10dbe8d68c2 Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:32:10.943284 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_43a6c60df0b14717bf52f10dbe8d68c2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43a6c60df0b14717bf52f10dbe8d68c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43a6c60df0b14717bf52f10dbe8d68c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/43a6c60df0b14717bf52f10dbe8d68c2"}]}] Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 43a6c60df0b14717bf52f10dbe8d68c2 Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119113897 Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminNegativeTestJSON-119113897-project Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 2a7aaeb417c04b7085a6e752268963c8 Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119113897-project Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: {"remove_host": {"host": "n-h1-852085-12"}} Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:32:10.946197 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-852085-12'}}} Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:10.947446 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 20:32:10.950689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:10.953957 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4cb4f892-7579-4ab2-9444-20e8da4f6518 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:10.956410 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4cb4f892-7579-4ab2-9444-20e8da4f6518 tempest-AggregatesAdminNegativeTestJSON-119113897 tempest-AggregatesAdminNegativeTestJSON-119113897-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.066216 Oct 04 20:32:10.968515 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 155/304] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 20:32:10 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 78 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:10.974603 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a1837c9b-41fa-4430-ac82-512c2e619688 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:11.002311 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-a1837c9b-41fa-4430-ac82-512c2e619688 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a1837c9b-41fa-4430-ac82-512c2e619688 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Request method failure captured: Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgBhKHGk0NHaib-v9jsjOhK3_jDKJfyxvrJlcA73sdZWNRxJTUyoLwcxK6XyGu3Nqg9lKUhdk_2oRrQEQsTHCprpLfSqCdGZ9TKE2OynF3fa78NvdfWPwfImtEpfSeWjz-awPn616jAXQMSxXWj0KkNA8XDyJ3qTdW_qlX952EH7nY Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 3c732865ac764dfc83bace2444770db8 Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminTestJSON-708441017 Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:32:11.006442 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3c732865ac764dfc83bace2444770db8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3c732865ac764dfc83bace2444770db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3c732865ac764dfc83bace2444770db8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3c732865ac764dfc83bace2444770db8"}]}] Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminTestJSON-708441017 Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 3c732865ac764dfc83bace2444770db8 Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-708441017 Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminTestJSON-708441017-project-admin Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: b8be11263dbb46b6988fcf068c452374 Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminTestJSON-708441017-project-admin Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: exception: Aggregate 12 could not be found. Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '12'} Oct 04 20:32:11.009172 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:32:11.012128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:11.015710 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:11.018159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:11.018159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:11.018159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:11.018159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 04 20:32:11.018159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:11.018785 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-76954956-9d52-4869-85e4-f7d9f88cf87b tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Calling method '.version_select at 0x7f77ef8c4820>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:11.024449 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a1837c9b-41fa-4430-ac82-512c2e619688 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:11.024449 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a1837c9b-41fa-4430-ac82-512c2e619688 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.058027 Oct 04 20:32:11.026359 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 156/305] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:32:10 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:32:11.034988 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-76954956-9d52-4869-85e4-f7d9f88cf87b tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b36382b47d6541a8b810035d777fd624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2549113f2a84de09ec0c0094762c4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:11.041329 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7bb4bdf9-17bc-40b5-8623-69013e5a3f5a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:11.042838 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7bb4bdf9-17bc-40b5-8623-69013e5a3f5a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-76954956-9d52-4869-85e4-f7d9f88cf87b tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Request method failure captured: Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJhGInyhuupGbntiNdY3K6cy0b7tKoG_wnE8zdwWyNubD3WElVqwuM_9-uWRRZK-Mfg6Kn5YwAY8RRvqvj08RN7PJC3jf58qhp6J1GRDBajaALylLK5-Gymieat5j41lm49GstTniDKFbeWT8fN36hlToUzhsRKMm9UZ5L4dFHU_QKw Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: b2549113f2a84de09ec0c0094762c4a1 Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:32:11.045119 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2549113f2a84de09ec0c0094762c4a1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2549113f2a84de09ec0c0094762c4a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2549113f2a84de09ec0c0094762c4a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2549113f2a84de09ec0c0094762c4a1"}]}] Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: b2549113f2a84de09ec0c0094762c4a1 Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HypervisorAdminNegativeTestJSON-848962409-project Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b36382b47d6541a8b810035d777fd624 Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-848962409-project Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: action_args: {} Oct 04 20:32:11.047899 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:11.066074 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 20:32:11.077411 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:11.080385 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-76954956-9d52-4869-85e4-f7d9f88cf87b tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:11.080385 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-76954956-9d52-4869-85e4-f7d9f88cf87b tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 1.354996 Oct 04 20:32:11.080385 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 150/306] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 4 20:32:09 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 1362 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:11.103054 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7bb4bdf9-17bc-40b5-8623-69013e5a3f5a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:11.104383 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7bb4bdf9-17bc-40b5-8623-69013e5a3f5a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:11.105684 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7bb4bdf9-17bc-40b5-8623-69013e5a3f5a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:11.106582 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1c4830a7-9fd5-4da6-8185-4f3ad56e838a tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852085-12"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:11.109150 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7bb4bdf9-17bc-40b5-8623-69013e5a3f5a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:11.110448 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7bb4bdf9-17bc-40b5-8623-69013e5a3f5a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:11.111611 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7bb4bdf9-17bc-40b5-8623-69013e5a3f5a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:11.153088 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c4830a7-9fd5-4da6-8185-4f3ad56e838a tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:11.153981 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c4830a7-9fd5-4da6-8185-4f3ad56e838a tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:11.155677 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c4830a7-9fd5-4da6-8185-4f3ad56e838a tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:11.791319 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1c4830a7-9fd5-4da6-8185-4f3ad56e838a tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.739892 Oct 04 20:32:11.793036 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 151/307] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 20:32:11 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:11.813928 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8053b0a5-fc6d-498d-bd90-1bc06828892b tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-511672549", "name": "tempest-test_aggregate-478406773"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:11.839200 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.aggregate [None req-8053b0a5-fc6d-498d-bd90-1bc06828892b tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Generated uuid 621d44c2-36b0-4199-b061-a91e2ba78947 for aggregate {{(pid=123539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:32:12.005779 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8053b0a5-fc6d-498d-bd90-1bc06828892b tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.210306 Oct 04 20:32:12.007435 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 152/308] 10.222.0.78 () {60 vars in 1165 bytes} [Tue Oct 4 20:32:11 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:12.010025 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7bb4bdf9-17bc-40b5-8623-69013e5a3f5a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:12.030982 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0202a748-7803-4177-8123-fe76803fb427 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Calling method '.version_select at 0x7f77ef8860d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:12.036460 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-0202a748-7803-4177-8123-fe76803fb427 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b36382b47d6541a8b810035d777fd624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2549113f2a84de09ec0c0094762c4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0202a748-7803-4177-8123-fe76803fb427 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Request method failure captured: Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJhGInyhuupGbntiNdY3K6cy0b7tKoG_wnE8zdwWyNubD3WElVqwuM_9-uWRRZK-Mfg6Kn5YwAY8RRvqvj08RN7PJC3jf58qhp6J1GRDBajaALylLK5-Gymieat5j41lm49GstTniDKFbeWT8fN36hlToUzhsRKMm9UZ5L4dFHU_QKw Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: b2549113f2a84de09ec0c0094762c4a1 Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:32:12.039001 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2549113f2a84de09ec0c0094762c4a1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2549113f2a84de09ec0c0094762c4a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2549113f2a84de09ec0c0094762c4a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2549113f2a84de09ec0c0094762c4a1"}]}] Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: b2549113f2a84de09ec0c0094762c4a1 Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HypervisorAdminNegativeTestJSON-848962409-project Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b36382b47d6541a8b810035d777fd624 Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-848962409-project Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: action_args: {} Oct 04 20:32:12.041698 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:12.044265 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 20:32:12.047815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:12.052520 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7bb4bdf9-17bc-40b5-8623-69013e5a3f5a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1468 microversion: 2.1 time: 1.010481 Oct 04 20:32:12.052719 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0202a748-7803-4177-8123-fe76803fb427 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:12.052719 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0202a748-7803-4177-8123-fe76803fb427 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.028098 Oct 04 20:32:12.059916 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 157/309] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:11 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1468 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:12.062611 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 153/310] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:32:12 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:12.086185 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b030165c-7556-4974-a689-993406b681e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:12.094532 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b030165c-7556-4974-a689-993406b681e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:12.096239 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-335b702c-fcc3-4272-8465-f2ea0a3e5423 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:12.113985 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b030165c-7556-4974-a689-993406b681e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:12.114328 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b030165c-7556-4974-a689-993406b681e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:12.114936 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b030165c-7556-4974-a689-993406b681e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:12.126277 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b030165c-7556-4974-a689-993406b681e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:12.128191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b030165c-7556-4974-a689-993406b681e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:12.129629 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b030165c-7556-4974-a689-993406b681e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:12.223347 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:12.252561 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-335b702c-fcc3-4272-8465-f2ea0a3e5423 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.188488 Oct 04 20:32:12.252561 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 158/311] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:32:12 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:32:12.651786 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b030165c-7556-4974-a689-993406b681e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:12.683425 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b030165c-7556-4974-a689-993406b681e0 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1319 microversion: 2.1 time: 0.610126 Oct 04 20:32:12.685607 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 154/312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:12 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:12.696243 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b90aafcd-60cc-4b3c-bcb5-071b49118162 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:12.880421 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b90aafcd-60cc-4b3c-bcb5-071b49118162 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.192897 Oct 04 20:32:12.881435 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 155/313] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:32:12 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:32:12.888449 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3caa3407-79d0-4dc5-903e-f595b7a59f05 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Calling method '.version_select at 0x7f77ef8e3820>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:12.898476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3caa3407-79d0-4dc5-903e-f595b7a59f05 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b36382b47d6541a8b810035d777fd624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2549113f2a84de09ec0c0094762c4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3caa3407-79d0-4dc5-903e-f595b7a59f05 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Request method failure captured: Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJhGInyhuupGbntiNdY3K6cy0b7tKoG_wnE8zdwWyNubD3WElVqwuM_9-uWRRZK-Mfg6Kn5YwAY8RRvqvj08RN7PJC3jf58qhp6J1GRDBajaALylLK5-Gymieat5j41lm49GstTniDKFbeWT8fN36hlToUzhsRKMm9UZ5L4dFHU_QKw Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: b2549113f2a84de09ec0c0094762c4a1 Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:32:12.906103 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2549113f2a84de09ec0c0094762c4a1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2549113f2a84de09ec0c0094762c4a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2549113f2a84de09ec0c0094762c4a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2549113f2a84de09ec0c0094762c4a1"}]}] Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: b2549113f2a84de09ec0c0094762c4a1 Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-HypervisorAdminNegativeTestJSON-848962409-project Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b36382b47d6541a8b810035d777fd624 Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-848962409-project Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: action_args: {} Oct 04 20:32:12.908897 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:12.911203 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 20:32:12.915006 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:12.927479 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3caa3407-79d0-4dc5-903e-f595b7a59f05 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:12.930200 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3caa3407-79d0-4dc5-903e-f595b7a59f05 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.046149 Oct 04 20:32:12.931220 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 156/314] 10.222.0.78 () {58 vars in 1179 bytes} [Tue Oct 4 20:32:12 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:13.121091 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5739cbdd-99b3-4b7a-b2e7-1946032551ca tempest-NetworksTest-869767651 tempest-NetworksTest-869767651-project-admin] Calling method '.version_select at 0x7f77efd129d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:13.484647 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-698058966", "block_migration": true, "disk_over_commit": false}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:13.490992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:13.505083 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:13.506637 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:13.508785 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:13.511409 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:13.512685 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:13.513824 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f956697c-27ce-4132-82bb-e17c24f34efd) Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:32:13.792926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:13.794925 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:32:13.797205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f956697c-27ce-4132-82bb-e17c24f34efd) Oct 04 20:32:13.799175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.800938 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:13.800938 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Request method failure captured: Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64/action HTTP/1.1 Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 106 Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgoI5IDDy8J9_VZASuoTykioW0FJkRS_zipjO-iG6zviIxj7fsKiOlnmiNqMElyVuOKp7rLaqMQFPKXd8JXvugMWrW2ERwp9f10BIdob_iCdl_pyeRIz5swyyakwKuZz3ZFTWfTWayvDLD2MX55XAlgesrm8-wNBWoGLr_Fo0DCUjY Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 8208e592a1494535b5d215fedbc63704 Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-LiveMigrationNegativeTest-1087114981 Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:32:13.804528 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:32:13.807931 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8208e592a1494535b5d215fedbc63704", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8208e592a1494535b5d215fedbc63704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8208e592a1494535b5d215fedbc63704"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8208e592a1494535b5d215fedbc63704"}]}] Oct 04 20:32:13.807931 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-LiveMigrationNegativeTest-1087114981 Oct 04 20:32:13.807931 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 8208e592a1494535b5d215fedbc63704 Oct 04 20:32:13.807931 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1087114981 Oct 04 20:32:13.807931 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-LiveMigrationNegativeTest-1087114981-project-admin Oct 04 20:32:13.807931 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:13.807931 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:13.807931 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: a839bd7f69904d51a0fa4f325911c43d Oct 04 20:32:13.807931 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-LiveMigrationNegativeTest-1087114981-project-admin Oct 04 20:32:13.807931 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:32:13.807931 n-d-852085-12 devstack@n-api.service[123539]: {"os-migrateLive": {"host": "tempest-host-698058966", "block_migration": true, "disk_over_commit": false}} Oct 04 20:32:13.807931 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '657c60d3-dfa6-4665-aa9c-66cf28399f64', 'body': {'os-migrateLive': {'host': 'tempest-host-698058966', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:32:13.809490 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:13.811697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:32:13.813704 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f956697c-27ce-4132-82bb-e17c24f34efd) Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:13.815912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.817893 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.820077 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:13.820077 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:13.820077 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-eb6c7859-e142-4ffa-9602-ac5e58279dfc tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64/action" status: 500 len: 214 microversion: 2.1 time: 0.876615 Oct 04 20:32:13.820077 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 157/315] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Oct 4 20:32:12 2022] POST /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64/action => generated 214 bytes in 883 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:32:13.840429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-256c34a0-132a-4734-9b8d-9a55a94d2c87 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1492761729"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:13.856985 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.aggregate [None req-256c34a0-132a-4734-9b8d-9a55a94d2c87 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Generated uuid 47e4bede-c553-4dc3-a28f-b96e9c6e65c5 for aggregate {{(pid=123539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:32:13.861385 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5739cbdd-99b3-4b7a-b2e7-1946032551ca tempest-NetworksTest-869767651 tempest-NetworksTest-869767651-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks" status: 200 len: 2630 microversion: 2.1 time: 1.598615 Oct 04 20:32:13.864780 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 159/316] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:32:12 2022] GET /compute/v2.1/os-networks => generated 2630 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:13.875901 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5b18faad-33dc-4d62-a39e-f9ed716b2c32 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:13.891008 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-5b18faad-33dc-4d62-a39e-f9ed716b2c32 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5b18faad-33dc-4d62-a39e-f9ed716b2c32 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Request method failure captured: Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgBhKHGk0NHaib-v9jsjOhK3_jDKJfyxvrJlcA73sdZWNRxJTUyoLwcxK6XyGu3Nqg9lKUhdk_2oRrQEQsTHCprpLfSqCdGZ9TKE2OynF3fa78NvdfWPwfImtEpfSeWjz-awPn616jAXQMSxXWj0KkNA8XDyJ3qTdW_qlX952EH7nY Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 3c732865ac764dfc83bace2444770db8 Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminTestJSON-708441017 Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:32:13.898498 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3c732865ac764dfc83bace2444770db8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3c732865ac764dfc83bace2444770db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3c732865ac764dfc83bace2444770db8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3c732865ac764dfc83bace2444770db8"}]}] Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminTestJSON-708441017 Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 3c732865ac764dfc83bace2444770db8 Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-708441017 Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminTestJSON-708441017-project-admin Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: b8be11263dbb46b6988fcf068c452374 Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminTestJSON-708441017-project-admin Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: exception: Aggregate 14 could not be found. Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '14'} Oct 04 20:32:13.901457 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:13.904600 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 04 20:32:13.906555 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:13.918134 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5b18faad-33dc-4d62-a39e-f9ed716b2c32 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:13.920922 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5b18faad-33dc-4d62-a39e-f9ed716b2c32 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.053692 Oct 04 20:32:13.922418 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 160/317] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:32:13 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:32:14.071343 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-256c34a0-132a-4734-9b8d-9a55a94d2c87 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.246940 Oct 04 20:32:14.073526 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 158/318] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:32:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:14.089145 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-518ddcc6-9f38-485e-a3f5-7fb9c18e376a req-783a9521-f83e-4e7a-940e-3afcc2f8b45d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47fee7a-3d2d-4741-a563-feaba1355fd2", "tag": "67745228-c055-4896-94e6-ee8141b63c6d"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:14.129686 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-518ddcc6-9f38-485e-a3f5-7fb9c18e376a req-783a9521-f83e-4e7a-940e-3afcc2f8b45d service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:14.130711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-518ddcc6-9f38-485e-a3f5-7fb9c18e376a req-783a9521-f83e-4e7a-940e-3afcc2f8b45d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:14.147684 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-518ddcc6-9f38-485e-a3f5-7fb9c18e376a req-783a9521-f83e-4e7a-940e-3afcc2f8b45d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:14.183324 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-518ddcc6-9f38-485e-a3f5-7fb9c18e376a req-783a9521-f83e-4e7a-940e-3afcc2f8b45d service nova] Creating event network-changed:67745228-c055-4896-94e6-ee8141b63c6d for instance c47fee7a-3d2d-4741-a563-feaba1355fd2 on n-h1-852085-12 Oct 04 20:32:14.192407 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-518ddcc6-9f38-485e-a3f5-7fb9c18e376a req-783a9521-f83e-4e7a-940e-3afcc2f8b45d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116158 Oct 04 20:32:14.195450 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 159/319] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:14.217429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9be3756c-e218-4ff3-91a4-597b205523cc tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:14.217429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9be3756c-e218-4ff3-91a4-597b205523cc tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:14.257265 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9be3756c-e218-4ff3-91a4-597b205523cc tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:14.264542 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9be3756c-e218-4ff3-91a4-597b205523cc tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:14.275685 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9be3756c-e218-4ff3-91a4-597b205523cc tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:14.282474 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9be3756c-e218-4ff3-91a4-597b205523cc tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:14.285476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9be3756c-e218-4ff3-91a4-597b205523cc tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:14.289455 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9be3756c-e218-4ff3-91a4-597b205523cc tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:14.590393 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=10 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:14.732696 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d9128ff2-4798-4b36-8146-a67290bc0217 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Calling method '.version_select at 0x7f77efe5f790>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:14.740208 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9128ff2-4798-4b36-8146-a67290bc0217 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:14.741786 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9128ff2-4798-4b36-8146-a67290bc0217 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:14.743543 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9128ff2-4798-4b36-8146-a67290bc0217 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:14.782850 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9128ff2-4798-4b36-8146-a67290bc0217 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:14.783993 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9128ff2-4798-4b36-8146-a67290bc0217 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:14.784940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9128ff2-4798-4b36-8146-a67290bc0217 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:14.809851 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9128ff2-4798-4b36-8146-a67290bc0217 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:14.810977 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9128ff2-4798-4b36-8146-a67290bc0217 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:14.812223 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9128ff2-4798-4b36-8146-a67290bc0217 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:14.825865 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d9128ff2-4798-4b36-8146-a67290bc0217 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.901140 Oct 04 20:32:14.831532 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 161/320] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:32:13 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:14.843237 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f8d023fa-d0c6-4bfe-9468-fc14fe675b28 tempest-NetworksTest-869767651 tempest-NetworksTest-869767651-project-admin] Calling method '.version_select at 0x7f77efd12a60>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:15.267773 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9be3756c-e218-4ff3-91a4-597b205523cc tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:15.284058 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9be3756c-e218-4ff3-91a4-597b205523cc tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1319 microversion: 2.1 time: 1.081390 Oct 04 20:32:15.288420 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 160/321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:14 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1319 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:15.302198 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4c3349d6-f31d-4a9b-8a64-4ace27e274a2 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:15.323470 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f8d023fa-d0c6-4bfe-9468-fc14fe675b28 tempest-NetworksTest-869767651 tempest-NetworksTest-869767651-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks/52a60aae-e230-4bd7-89bc-781767fd7892" status: 200 len: 652 microversion: 2.1 time: 0.487904 Oct 04 20:32:15.324927 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 162/322] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:32:14 2022] GET /compute/v2.1/os-networks/52a60aae-e230-4bd7-89bc-781767fd7892 => generated 652 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:15.348102 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-13c76083-ed75-411b-935b-39b5c3f302a3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:15.363746 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-4c3349d6-f31d-4a9b-8a64-4ace27e274a2 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4c3349d6-f31d-4a9b-8a64-4ace27e274a2 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Request method failure captured: Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgBhKHGk0NHaib-v9jsjOhK3_jDKJfyxvrJlcA73sdZWNRxJTUyoLwcxK6XyGu3Nqg9lKUhdk_2oRrQEQsTHCprpLfSqCdGZ9TKE2OynF3fa78NvdfWPwfImtEpfSeWjz-awPn616jAXQMSxXWj0KkNA8XDyJ3qTdW_qlX952EH7nY Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 3c732865ac764dfc83bace2444770db8 Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-AggregatesAdminTestJSON-708441017 Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:32:15.373160 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3c732865ac764dfc83bace2444770db8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3c732865ac764dfc83bace2444770db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3c732865ac764dfc83bace2444770db8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3c732865ac764dfc83bace2444770db8"}]}] Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-AggregatesAdminTestJSON-708441017 Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 3c732865ac764dfc83bace2444770db8 Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-708441017 Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-AggregatesAdminTestJSON-708441017-project-admin Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b8be11263dbb46b6988fcf068c452374 Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-AggregatesAdminTestJSON-708441017-project-admin Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: exception: Aggregate 14 could not be found. Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '14'} Oct 04 20:32:15.375934 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:32:15.377257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:15.379429 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:15.382138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:15.382138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:15.382138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:15.382138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 04 20:32:15.382138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.389435 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4c3349d6-f31d-4a9b-8a64-4ace27e274a2 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:15.391794 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4c3349d6-f31d-4a9b-8a64-4ace27e274a2 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.100415 Oct 04 20:32:15.395984 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 161/323] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:32:15 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:32:15.404997 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-13c76083-ed75-411b-935b-39b5c3f302a3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:15.407861 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-442794865", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:15.412616 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-13c76083-ed75-411b-935b-39b5c3f302a3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:15.413667 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-13c76083-ed75-411b-935b-39b5c3f302a3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:15.445347 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-13c76083-ed75-411b-935b-39b5c3f302a3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:15.446659 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-13c76083-ed75-411b-935b-39b5c3f302a3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:15.448265 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-13c76083-ed75-411b-935b-39b5c3f302a3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:15.476172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.compute.aggregates [None req-13c76083-ed75-411b-935b-39b5c3f302a3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 20:32:15.477260 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-13c76083-ed75-411b-935b-39b5c3f302a3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-13c76083-ed75-411b-935b-39b5c3f302a3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Request method failure captured: Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 42 Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJgAmJyE4m9DQPG2iunY9YVIyue6gS1OKIJPuEzNOxiMCiMOXtcPHuHmWtLQDZb_vWBsM58RalEsHfWIT8GowCD44ZmeluHPpB82ixi-hd_KWr0GIe0l_oKWRpd4Cx7vaAzwuhasrR86gnQTY2q5NH1FAgPFEBhgdu5oFZaeMxD1G2w Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:32:15.483970 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cb8231cbd10e4f4ea7eb62bf99dd0791", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cb8231cbd10e4f4ea7eb62bf99dd0791"}]}] Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: cb8231cbd10e4f4ea7eb62bf99dd0791 Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-679779781 Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: fa6f52cb0cd643e98535ba532fe2c384 Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: {"remove_host": {"host": "nonexist_host"}} Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:32:15.486554 n-d-852085-12 devstack@n-api.service[123540]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 20:32:15.488452 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 04 20:32:15.490590 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.493362 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:15.495939 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:15.495939 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:15.495939 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:15.495939 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:15.495939 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 04 20:32:15.495939 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.495939 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-13c76083-ed75-411b-935b-39b5c3f302a3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:15.495939 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-13c76083-ed75-411b-935b-39b5c3f302a3 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.158174 Oct 04 20:32:15.495939 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 163/324] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 20:32:15 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:32:15.500971 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0d7fab13-47dc-468b-976e-caa2e2b8879f tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Calling method '.version_select at 0x7f77efd31e50>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:15.501766 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0d7fab13-47dc-468b-976e-caa2e2b8879f tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b36382b47d6541a8b810035d777fd624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2549113f2a84de09ec0c0094762c4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0d7fab13-47dc-468b-976e-caa2e2b8879f tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Request method failure captured: Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJhGInyhuupGbntiNdY3K6cy0b7tKoG_wnE8zdwWyNubD3WElVqwuM_9-uWRRZK-Mfg6Kn5YwAY8RRvqvj08RN7PJC3jf58qhp6J1GRDBajaALylLK5-Gymieat5j41lm49GstTniDKFbeWT8fN36hlToUzhsRKMm9UZ5L4dFHU_QKw Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: b2549113f2a84de09ec0c0094762c4a1 Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:32:15.504835 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2549113f2a84de09ec0c0094762c4a1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2549113f2a84de09ec0c0094762c4a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2549113f2a84de09ec0c0094762c4a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2549113f2a84de09ec0c0094762c4a1"}]}] Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: b2549113f2a84de09ec0c0094762c4a1 Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-HypervisorAdminNegativeTestJSON-848962409-project Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: b36382b47d6541a8b810035d777fd624 Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-848962409-project Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '1'} Oct 04 20:32:15.507819 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:15.509413 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 20:32:15.511958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:15.515368 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0d7fab13-47dc-468b-976e-caa2e2b8879f tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:15.515368 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0d7fab13-47dc-468b-976e-caa2e2b8879f tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.018936 Oct 04 20:32:15.515368 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 164/325] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 4 20:32:15 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:15.548194 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-36d3fed0-c209-4511-9d0a-75906af22b63 tempest-NetworksTest-869767651 tempest-NetworksTest-869767651-project-admin] Calling method '.version_select at 0x7f77efd129d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:15.626267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:32:16.141042 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-36d3fed0-c209-4511-9d0a-75906af22b63 tempest-NetworksTest-869767651 tempest-NetworksTest-869767651-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks" status: 200 len: 2630 microversion: 2.1 time: 0.628788 Oct 04 20:32:16.142317 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 165/326] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:32:15 2022] GET /compute/v2.1/os-networks => generated 2630 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:16.155784 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-497032c1-6905-4f93-8e0f-f45203a13ef8 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1456440911"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:16.163425 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.aggregate [None req-497032c1-6905-4f93-8e0f-f45203a13ef8 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Generated uuid 7f491bf2-7f21-41f7-b86f-0bb5c23149ea for aggregate {{(pid=123540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:32:16.335188 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-497032c1-6905-4f93-8e0f-f45203a13ef8 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.190552 Oct 04 20:32:16.349347 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 166/327] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:32:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:16.360660 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d186b849-d206-4c32-9285-83dd990aefd1 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:16.534839 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d186b849-d206-4c32-9285-83dd990aefd1 tempest-AggregatesAdminNegativeTestJSON-679779781 tempest-AggregatesAdminNegativeTestJSON-679779781-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.181765 Oct 04 20:32:16.536006 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 167/328] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:32:16 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:32:16.560943 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-77bec43c-50c0-4ef4-9abb-8e206d5c8b67 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Calling method '.version_select at 0x7f77efd12e50>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:16.569101 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-77bec43c-50c0-4ef4-9abb-8e206d5c8b67 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] HTTP exception thrown: Hypervisor with ID 'b5e0ac7a-77a4-4989-92e6-1a5ce9fb76ed' could not be found. Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-77bec43c-50c0-4ef4-9abb-8e206d5c8b67 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Request method failure captured: Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-hypervisors/b5e0ac7a-77a4-4989-92e6-1a5ce9fb76ed/uptime HTTP/1.1 Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJhIg6k-taWnUAZ9E_vNoKVSEpV7jfo8M6XGJ1b2BnX-laFFkujft9h9-voU7W3zVt_ShJIhAsZz2_uW4_PuGQwPyqWxYYFZC9Vi001Om7EyKbLy5T0aKolfWeKzgrnh12lak1LQr-oM5NtUvJbYSi8srEbYuPmXSIpmXXLN03xCZTc Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 069c65953ec14f159b943500c268603e Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-977787190 Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:32:16.585797 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:32:16.588791 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_069c65953ec14f159b943500c268603e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/069c65953ec14f159b943500c268603e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/069c65953ec14f159b943500c268603e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/069c65953ec14f159b943500c268603e"}]}] Oct 04 20:32:16.588791 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-977787190 Oct 04 20:32:16.588791 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 069c65953ec14f159b943500c268603e Oct 04 20:32:16.588791 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-977787190 Oct 04 20:32:16.588791 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin Oct 04 20:32:16.588791 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:16.588791 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:16.588791 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: c14176100e684d63a997c4b8038b0416 Oct 04 20:32:16.588791 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin Oct 04 20:32:16.588791 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:32:16.588791 n-d-852085-12 devstack@n-api.service[123540]: exception: Hypervisor with ID 'b5e0ac7a-77a4-4989-92e6-1a5ce9fb76ed' could not be found. Oct 04 20:32:16.588791 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'b5e0ac7a-77a4-4989-92e6-1a5ce9fb76ed'} Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'b5e0ac7a-77a4-4989-92e6-1a5ce9fb76ed' Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 20:32:16.590001 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'b5e0ac7a-77a4-4989-92e6-1a5ce9fb76ed' could not be found. Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:16.592793 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:16.595303 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:16.595303 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:16.595303 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:16.595303 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:16.595303 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:16.595303 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'b5e0ac7a-77a4-4989-92e6-1a5ce9fb76ed' could not be found. Oct 04 20:32:16.595303 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:16.595303 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-77bec43c-50c0-4ef4-9abb-8e206d5c8b67 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Returning 404 to user: Hypervisor with ID 'b5e0ac7a-77a4-4989-92e6-1a5ce9fb76ed' could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:16.595303 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-77bec43c-50c0-4ef4-9abb-8e206d5c8b67 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/b5e0ac7a-77a4-4989-92e6-1a5ce9fb76ed/uptime" status: 404 len: 123 microversion: 2.1 time: 0.050400 Oct 04 20:32:16.595303 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 168/329] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 4 20:32:16 2022] GET /compute/v2.1/os-hypervisors/b5e0ac7a-77a4-4989-92e6-1a5ce9fb76ed/uptime => generated 123 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:16.616048 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:32:16.616241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:32:16.616724 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:32:16.617324 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:32:16.618939 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:32:16.622445 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4b9c1e88-641f-4f2b-9d1d-f07657b6efb7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:16.623943 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4b9c1e88-641f-4f2b-9d1d-f07657b6efb7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:16.632967 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9,nova_api:DELETE=8 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:16.636066 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b9c1e88-641f-4f2b-9d1d-f07657b6efb7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:16.637022 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b9c1e88-641f-4f2b-9d1d-f07657b6efb7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:16.637815 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b9c1e88-641f-4f2b-9d1d-f07657b6efb7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:16.639202 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b9c1e88-641f-4f2b-9d1d-f07657b6efb7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:16.640163 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b9c1e88-641f-4f2b-9d1d-f07657b6efb7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:16.641201 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4b9c1e88-641f-4f2b-9d1d-f07657b6efb7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:16.645500 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:16.650992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:16.650992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:16.650992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:16.651620 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:16.652433 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:16.700822 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Getting quotas for project e756f3ec49694205b5dccf3408cee098. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:16.713325 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Getting quotas for user 4b8c35b4791b41fea4edf6b6f1ef6de1 and project e756f3ec49694205b5dccf3408cee098. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:16.752097 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:32:16.757811 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:32:17.032925 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e0ccab8c-2cc1-4a42-8b8e-f15b4b4e3085 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.634699 Oct 04 20:32:17.049984 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 162/330] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:32:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:32:17.087842 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-209716bc-418b-461b-b145-8d9c84030e0f tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:17.131474 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-209716bc-418b-461b-b145-8d9c84030e0f tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.079073 Oct 04 20:32:17.137250 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 163/331] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:32:17 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:17.174689 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4b9c1e88-641f-4f2b-9d1d-f07657b6efb7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:17.218884 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4b9c1e88-641f-4f2b-9d1d-f07657b6efb7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1319 microversion: 2.1 time: 0.605103 Oct 04 20:32:17.233620 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 169/332] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:16 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1319 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:17.267855 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c3f8172d-8546-40a2-a8d3-f4dc19174322 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Calling method '.version_select at 0x7f77efcd1670>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:17.275726 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c3f8172d-8546-40a2-a8d3-f4dc19174322 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:17.284936 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c3f8172d-8546-40a2-a8d3-f4dc19174322 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:17.286070 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c3f8172d-8546-40a2-a8d3-f4dc19174322 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:17.352137 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c3f8172d-8546-40a2-a8d3-f4dc19174322 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:17.354673 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c3f8172d-8546-40a2-a8d3-f4dc19174322 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:17.357525 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c3f8172d-8546-40a2-a8d3-f4dc19174322 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:17.406208 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c3f8172d-8546-40a2-a8d3-f4dc19174322 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:17.408803 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c3f8172d-8546-40a2-a8d3-f4dc19174322 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:17.413123 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c3f8172d-8546-40a2-a8d3-f4dc19174322 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:17.439290 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c3f8172d-8546-40a2-a8d3-f4dc19174322 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.196832 Oct 04 20:32:17.454275 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 170/333] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:32:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:17.481066 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0f4afe4c-98e1-41ad-935e-2950ee7c0e76 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:17.487212 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0f4afe4c-98e1-41ad-935e-2950ee7c0e76 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:17.650371 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0f4afe4c-98e1-41ad-935e-2950ee7c0e76 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:17.663756 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0f4afe4c-98e1-41ad-935e-2950ee7c0e76 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1218 microversion: 2.1 time: 0.207543 Oct 04 20:32:17.665188 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 171/334] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:17 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:17.686091 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8fb4dc05-1c6c-4757-90ed-a221fb8b8956 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:17.901625 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8fb4dc05-1c6c-4757-90ed-a221fb8b8956 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.234435 Oct 04 20:32:17.905924 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 172/335] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 20:32:17 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:17.937304 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1744c108-c627-42e2-a578-ca42aed79dc0 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Calling method '.version_select at 0x7f77efcd1d30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:17.941725 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1744c108-c627-42e2-a578-ca42aed79dc0 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b36382b47d6541a8b810035d777fd624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2549113f2a84de09ec0c0094762c4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1744c108-c627-42e2-a578-ca42aed79dc0 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Request method failure captured: Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJhGInyhuupGbntiNdY3K6cy0b7tKoG_wnE8zdwWyNubD3WElVqwuM_9-uWRRZK-Mfg6Kn5YwAY8RRvqvj08RN7PJC3jf58qhp6J1GRDBajaALylLK5-Gymieat5j41lm49GstTniDKFbeWT8fN36hlToUzhsRKMm9UZ5L4dFHU_QKw Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: b2549113f2a84de09ec0c0094762c4a1 Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:32:17.945805 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2549113f2a84de09ec0c0094762c4a1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2549113f2a84de09ec0c0094762c4a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2549113f2a84de09ec0c0094762c4a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2549113f2a84de09ec0c0094762c4a1"}]}] Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: b2549113f2a84de09ec0c0094762c4a1 Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-848962409 Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-HypervisorAdminNegativeTestJSON-848962409-project Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: b36382b47d6541a8b810035d777fd624 Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-848962409-project Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '1'} Oct 04 20:32:17.949263 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:17.951000 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 20:32:17.960017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:17.962153 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1744c108-c627-42e2-a578-ca42aed79dc0 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:17.962153 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1744c108-c627-42e2-a578-ca42aed79dc0 tempest-HypervisorAdminNegativeTestJSON-848962409 tempest-HypervisorAdminNegativeTestJSON-848962409-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.046183 Oct 04 20:32:17.962153 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 173/336] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:32:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:17.972834 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-eacfde8e-6d9e-4245-a0d7-aae2e0b89cb7 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:17.993072 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-eacfde8e-6d9e-4245-a0d7-aae2e0b89cb7 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.027498 Oct 04 20:32:18.007547 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 174/337] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:32:17 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:18.022362 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-40a694a7-3c46-4748-bc67-060e39649080 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Calling method '.version_select at 0x7f77efd31f70>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:18.028215 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-40a694a7-3c46-4748-bc67-060e39649080 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] HTTP exception thrown: Hypervisor with ID '453faf0a-35ef-4608-9bb9-cddc009b4f97' could not be found. Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-40a694a7-3c46-4748-bc67-060e39649080 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Request method failure captured: Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-hypervisors/453faf0a-35ef-4608-9bb9-cddc009b4f97 HTTP/1.1 Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJhIg6k-taWnUAZ9E_vNoKVSEpV7jfo8M6XGJ1b2BnX-laFFkujft9h9-voU7W3zVt_ShJIhAsZz2_uW4_PuGQwPyqWxYYFZC9Vi001Om7EyKbLy5T0aKolfWeKzgrnh12lak1LQr-oM5NtUvJbYSi8srEbYuPmXSIpmXXLN03xCZTc Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 069c65953ec14f159b943500c268603e Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-977787190 Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:32:18.034630 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:32:18.036265 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_069c65953ec14f159b943500c268603e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/069c65953ec14f159b943500c268603e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/069c65953ec14f159b943500c268603e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/069c65953ec14f159b943500c268603e"}]}] Oct 04 20:32:18.036265 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-977787190 Oct 04 20:32:18.036265 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 069c65953ec14f159b943500c268603e Oct 04 20:32:18.036265 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-977787190 Oct 04 20:32:18.036265 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin Oct 04 20:32:18.036265 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:18.036265 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:18.036265 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: c14176100e684d63a997c4b8038b0416 Oct 04 20:32:18.036265 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin Oct 04 20:32:18.036265 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:32:18.036265 n-d-852085-12 devstack@n-api.service[123540]: exception: Hypervisor with ID '453faf0a-35ef-4608-9bb9-cddc009b4f97' could not be found. Oct 04 20:32:18.036265 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '453faf0a-35ef-4608-9bb9-cddc009b4f97'} Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '453faf0a-35ef-4608-9bb9-cddc009b4f97' Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 20:32:18.037350 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:32:18.040891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '453faf0a-35ef-4608-9bb9-cddc009b4f97' could not be found. Oct 04 20:32:18.045891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:18.045891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:18.045891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:18.045891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:18.045891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:18.045891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:18.045891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:18.045891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:18.045891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '453faf0a-35ef-4608-9bb9-cddc009b4f97' could not be found. Oct 04 20:32:18.045891 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:18.050092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-40a694a7-3c46-4748-bc67-060e39649080 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] Returning 404 to user: Hypervisor with ID '453faf0a-35ef-4608-9bb9-cddc009b4f97' could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:18.053514 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-40a694a7-3c46-4748-bc67-060e39649080 tempest-HypervisorAdminNegativeTestJSON-977787190 tempest-HypervisorAdminNegativeTestJSON-977787190-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/453faf0a-35ef-4608-9bb9-cddc009b4f97" status: 404 len: 123 microversion: 2.1 time: 0.041035 Oct 04 20:32:18.055728 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 175/338] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 4 20:32:18 2022] GET /compute/v2.1/os-hypervisors/453faf0a-35ef-4608-9bb9-cddc009b4f97 => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:18.070683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d34a424e-be33-4ca1-b1c6-9c973a12abe2 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:18.201816 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ee267349-b8b9-4936-a353-03ca34d352e8 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Calling method '.version_select at 0x7f77ef8e3790>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:18.233222 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d34a424e-be33-4ca1-b1c6-9c973a12abe2 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.173683 Oct 04 20:32:18.241558 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 176/339] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:32:18 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:32:18.258205 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee267349-b8b9-4936-a353-03ca34d352e8 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:18.259060 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee267349-b8b9-4936-a353-03ca34d352e8 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:18.260017 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee267349-b8b9-4936-a353-03ca34d352e8 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:18.261584 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee267349-b8b9-4936-a353-03ca34d352e8 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:18.273630 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee267349-b8b9-4936-a353-03ca34d352e8 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:18.275249 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-38a92f51-3129-4dab-9783-e65cc024d215 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-404130084", "availability_zone": "tempest-test_az-1316324522"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:18.280433 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee267349-b8b9-4936-a353-03ca34d352e8 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:18.408099 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.aggregate [None req-38a92f51-3129-4dab-9783-e65cc024d215 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Generated uuid 8ad82ffe-a695-4668-b252-909e0694e297 for aggregate {{(pid=123540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:32:18.435250 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ee267349-b8b9-4936-a353-03ca34d352e8 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 1.294878 Oct 04 20:32:18.438594 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 164/340] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 4 20:32:17 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:18.453175 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-af3495c1-1a87-41cc-bda5-b5ebebb078cf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:18.455357 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-af3495c1-1a87-41cc-bda5-b5ebebb078cf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:18.471331 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af3495c1-1a87-41cc-bda5-b5ebebb078cf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:18.473294 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af3495c1-1a87-41cc-bda5-b5ebebb078cf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:18.474676 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af3495c1-1a87-41cc-bda5-b5ebebb078cf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:18.477125 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af3495c1-1a87-41cc-bda5-b5ebebb078cf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:18.481227 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af3495c1-1a87-41cc-bda5-b5ebebb078cf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:18.483047 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af3495c1-1a87-41cc-bda5-b5ebebb078cf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:18.666161 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-38a92f51-3129-4dab-9783-e65cc024d215 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.417878 Oct 04 20:32:18.668703 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 177/341] 10.222.0.78 () {60 vars in 1165 bytes} [Tue Oct 4 20:32:18 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:18.850156 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-97b08ce6-7d95-477f-830b-99b9f097fcdf tempest-FloatingIPsAssociationTestJSON-970355948 tempest-FloatingIPsAssociationTestJSON-970355948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-999246063", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "4571e3e1-616b-42ac-9a49-36e519084249"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:18.984681 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-97b08ce6-7d95-477f-830b-99b9f097fcdf tempest-FloatingIPsAssociationTestJSON-970355948 tempest-FloatingIPsAssociationTestJSON-970355948-project] validate_networks() for [('4571e3e1-616b-42ac-9a49-36e519084249', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:32:19.063984 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-af3495c1-1a87-41cc-bda5-b5ebebb078cf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:19.082100 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-af3495c1-1a87-41cc-bda5-b5ebebb078cf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1319 microversion: 2.1 time: 0.638851 Oct 04 20:32:19.084446 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 165/342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:18 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1319 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:19.094376 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-430b4902-c170-42d8-a6b0-b52dfe20aaba tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Calling method '.version_select at 0x7f77ef86c430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:19.103055 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-430b4902-c170-42d8-a6b0-b52dfe20aaba tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:19.104973 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-430b4902-c170-42d8-a6b0-b52dfe20aaba tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:19.106293 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-430b4902-c170-42d8-a6b0-b52dfe20aaba tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:19.108277 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-430b4902-c170-42d8-a6b0-b52dfe20aaba tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:19.109798 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-430b4902-c170-42d8-a6b0-b52dfe20aaba tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:19.110968 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-430b4902-c170-42d8-a6b0-b52dfe20aaba tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:19.181096 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-430b4902-c170-42d8-a6b0-b52dfe20aaba tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.093239 Oct 04 20:32:19.186820 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 166/343] 10.222.0.78 () {58 vars in 1139 bytes} [Tue Oct 4 20:32:19 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:19.198104 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-95806b5d-fc4d-4b22-844f-ad1478d65786 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-404130084_new", "availability_zone": "tempest-test_az-1316324522_new"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:19.621253 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-95806b5d-fc4d-4b22-844f-ad1478d65786 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:19.626950 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-95806b5d-fc4d-4b22-844f-ad1478d65786 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:19.628657 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-95806b5d-fc4d-4b22-844f-ad1478d65786 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-97b08ce6-7d95-477f-830b-99b9f097fcdf tempest-FloatingIPsAssociationTestJSON-970355948 tempest-FloatingIPsAssociationTestJSON-970355948-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-adcb2157-cded-48d3-95dd-972b7d2cc859) Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:32:19.716815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:19.720780 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:32:19.722666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:32:19.726801 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-adcb2157-cded-48d3-95dd-972b7d2cc859) Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-97b08ce6-7d95-477f-830b-99b9f097fcdf tempest-FloatingIPsAssociationTestJSON-970355948 tempest-FloatingIPsAssociationTestJSON-970355948-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-97b08ce6-7d95-477f-830b-99b9f097fcdf tempest-FloatingIPsAssociationTestJSON-970355948 tempest-FloatingIPsAssociationTestJSON-970355948-project] Request method failure captured: Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 215 Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJhRhyDkqTY5oNkuW7miZXBkDAIfKR55o3lG21suAfazrYB1l-jMPBobYmUJtyvB37heRS7bFt_pQ4ioxSDm8Fz6H50j-8pv2kB3UJ2BHLZKG_-Td70mqODw7w4iOOyol9BOONUPWqDmTk3yaQS1GDHW8atf8UEsFoKtY5_wdlKFhtg Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 3f55ea5d23454a1783f1719ec6bac06e Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-970355948 Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:32:19.732488 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:32:19.738721 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f55ea5d23454a1783f1719ec6bac06e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f55ea5d23454a1783f1719ec6bac06e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f55ea5d23454a1783f1719ec6bac06e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f55ea5d23454a1783f1719ec6bac06e"}]}] Oct 04 20:32:19.738721 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-970355948 Oct 04 20:32:19.738721 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 3f55ea5d23454a1783f1719ec6bac06e Oct 04 20:32:19.738721 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-970355948 Oct 04 20:32:19.738721 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FloatingIPsAssociationTestJSON-970355948-project Oct 04 20:32:19.738721 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:19.738721 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:19.738721 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: f2337ea7fc534f7f967d58d4947eb4e4 Oct 04 20:32:19.738721 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-970355948-project Oct 04 20:32:19.738721 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:32:19.738721 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-999246063", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "4571e3e1-616b-42ac-9a49-36e519084249"}]}} Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-FloatingIPsAssociationTestJSON-server-999246063', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '4571e3e1-616b-42ac-9a49-36e519084249'}]}}} Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:32:19.749051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:19.750266 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:32:19.751505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:32:19.752525 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-adcb2157-cded-48d3-95dd-972b7d2cc859) Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:19.753551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:19.759791 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:19.759791 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:19.759791 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:19.759791 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:19.759791 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:19.759791 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-97b08ce6-7d95-477f-830b-99b9f097fcdf tempest-FloatingIPsAssociationTestJSON-970355948 tempest-FloatingIPsAssociationTestJSON-970355948-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:19.759791 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:19.759791 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-97b08ce6-7d95-477f-830b-99b9f097fcdf tempest-FloatingIPsAssociationTestJSON-970355948 tempest-FloatingIPsAssociationTestJSON-970355948-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.057300 Oct 04 20:32:19.759791 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 178/344] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:32:18 2022] POST /compute/v2.1/servers => generated 214 bytes in 1063 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:32:19.771060 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7f2d53bc-cc06-401d-84dd-76b1447b7065 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:19.776719 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7f2d53bc-cc06-401d-84dd-76b1447b7065 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:19.809332 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7f2d53bc-cc06-401d-84dd-76b1447b7065 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:19.812192 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7f2d53bc-cc06-401d-84dd-76b1447b7065 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:19.815791 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7f2d53bc-cc06-401d-84dd-76b1447b7065 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:19.820362 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7f2d53bc-cc06-401d-84dd-76b1447b7065 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:19.823316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7f2d53bc-cc06-401d-84dd-76b1447b7065 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:19.832311 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7f2d53bc-cc06-401d-84dd-76b1447b7065 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:19.888369 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-95806b5d-fc4d-4b22-844f-ad1478d65786 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.696253 Oct 04 20:32:19.891556 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 167/345] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Oct 4 20:32:19 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:19.920801 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-79fb5ada-66d4-4914-9fc3-dfa4de18980a tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Calling method '.version_select at 0x7f77efbc1dc0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:19.939645 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-79fb5ada-66d4-4914-9fc3-dfa4de18980a tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:19.941282 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-79fb5ada-66d4-4914-9fc3-dfa4de18980a tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:19.950432 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-79fb5ada-66d4-4914-9fc3-dfa4de18980a tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:19.952553 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-79fb5ada-66d4-4914-9fc3-dfa4de18980a tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:19.954479 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-79fb5ada-66d4-4914-9fc3-dfa4de18980a tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:19.973080 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-79fb5ada-66d4-4914-9fc3-dfa4de18980a tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:20.071291 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-79fb5ada-66d4-4914-9fc3-dfa4de18980a tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.176820 Oct 04 20:32:20.084639 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7f2d53bc-cc06-401d-84dd-76b1447b7065 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:20.092740 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 168/346] 10.222.0.78 () {58 vars in 1145 bytes} [Tue Oct 4 20:32:19 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:32:20.098731 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7f2d53bc-cc06-401d-84dd-76b1447b7065 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1222 microversion: 2.1 time: 0.340631 Oct 04 20:32:20.099454 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 179/347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:19 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1222 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:20.113304 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2d9d328d-31cb-46e9-ab36-4f75628ef349 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:20.144965 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2d9d328d-31cb-46e9-ab36-4f75628ef349 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.049970 Oct 04 20:32:20.147001 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 169/348] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 4 20:32:20 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:20.150022 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-29dd4dcb-9300-4d51-a126-698e0e50259d tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Calling method '.version_select at 0x7f77efd6ac10>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:20.158758 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a3972dae-f759-4b42-99b3-1245c1dbe500 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:20.160487 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a3972dae-f759-4b42-99b3-1245c1dbe500 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:20.178878 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-29dd4dcb-9300-4d51-a126-698e0e50259d tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:20.179909 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-29dd4dcb-9300-4d51-a126-698e0e50259d tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:20.180740 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-29dd4dcb-9300-4d51-a126-698e0e50259d tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:20.183110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a3972dae-f759-4b42-99b3-1245c1dbe500 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:20.184401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a3972dae-f759-4b42-99b3-1245c1dbe500 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:20.190300 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a3972dae-f759-4b42-99b3-1245c1dbe500 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:20.190731 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-29dd4dcb-9300-4d51-a126-698e0e50259d tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:20.191412 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-29dd4dcb-9300-4d51-a126-698e0e50259d tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:20.191971 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-29dd4dcb-9300-4d51-a126-698e0e50259d tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:20.193035 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a3972dae-f759-4b42-99b3-1245c1dbe500 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:20.196694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a3972dae-f759-4b42-99b3-1245c1dbe500 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:20.201572 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a3972dae-f759-4b42-99b3-1245c1dbe500 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:20.255264 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:20.303913 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-29dd4dcb-9300-4d51-a126-698e0e50259d tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.171324 Oct 04 20:32:20.313629 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 180/349] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 4 20:32:20 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:20.331541 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-10171365-8ec2-4edd-abd0-ea832493e1c5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:20.525156 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-10171365-8ec2-4edd-abd0-ea832493e1c5 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.209341 Oct 04 20:32:20.529665 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 181/350] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:32:20 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:32:20.548053 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3cab86f0-c05b-4743-ad94-777502f908eb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Calling method '.version_select at 0x7f77efaecaf0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:20.569489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3cab86f0-c05b-4743-ad94-777502f908eb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:20.576752 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3cab86f0-c05b-4743-ad94-777502f908eb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:20.577698 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3cab86f0-c05b-4743-ad94-777502f908eb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:20.579128 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3cab86f0-c05b-4743-ad94-777502f908eb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:20.588945 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3cab86f0-c05b-4743-ad94-777502f908eb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:20.609591 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3cab86f0-c05b-4743-ad94-777502f908eb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:20.759636 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3cab86f0-c05b-4743-ad94-777502f908eb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.227513 Oct 04 20:32:20.760812 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 182/351] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:32:20 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:20.789168 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ee760805-e185-49b8-bd29-0c876db1f4e9 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-935924635"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:20.797991 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.aggregate [None req-ee760805-e185-49b8-bd29-0c876db1f4e9 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Generated uuid 2cbf83bd-4f97-48eb-bd13-1b668a713e13 for aggregate {{(pid=123540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:32:20.912010 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a3972dae-f759-4b42-99b3-1245c1dbe500 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:20.940091 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a3972dae-f759-4b42-99b3-1245c1dbe500 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1319 microversion: 2.1 time: 0.790553 Oct 04 20:32:20.963940 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 170/352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:20 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1319 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:20.982000 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-040580e6-3df3-456d-b47b-13898fea9b65 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Calling method '.version_select at 0x7f77ef8e3e50>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:20.990481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-040580e6-3df3-456d-b47b-13898fea9b65 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.000698 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-040580e6-3df3-456d-b47b-13898fea9b65 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.000698 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-040580e6-3df3-456d-b47b-13898fea9b65 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.000698 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-040580e6-3df3-456d-b47b-13898fea9b65 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.001642 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-040580e6-3df3-456d-b47b-13898fea9b65 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.003863 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-040580e6-3df3-456d-b47b-13898fea9b65 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.014023 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ee760805-e185-49b8-bd29-0c876db1f4e9 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.239914 Oct 04 20:32:21.015259 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 183/353] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 20:32:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:21.051593 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-33f58d3f-0956-495e-b398-95e76a550c7e tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:21.075841 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-040580e6-3df3-456d-b47b-13898fea9b65 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.109628 Oct 04 20:32:21.077546 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 171/354] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 4 20:32:20 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:21.096370 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-33f58d3f-0956-495e-b398-95e76a550c7e tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.062652 Oct 04 20:32:21.099667 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 184/355] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 4 20:32:21 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:21.102665 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c7d017eb-1a8e-424c-bcde-35f2d2acdcdb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Calling method '.version_select at 0x7f77ef913310>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:21.121978 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e9cd282c-408c-4a50-b8af-b6d92c773147 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:21.126515 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c7d017eb-1a8e-424c-bcde-35f2d2acdcdb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.127916 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c7d017eb-1a8e-424c-bcde-35f2d2acdcdb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.129753 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c7d017eb-1a8e-424c-bcde-35f2d2acdcdb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.185317 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c7d017eb-1a8e-424c-bcde-35f2d2acdcdb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.186820 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c7d017eb-1a8e-424c-bcde-35f2d2acdcdb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.188552 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c7d017eb-1a8e-424c-bcde-35f2d2acdcdb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.267120 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c7d017eb-1a8e-424c-bcde-35f2d2acdcdb tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-h1-852085-12" status: 200 len: 603 microversion: 2.1 time: 0.177123 Oct 04 20:32:21.269343 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 172/356] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 4 20:32:21 2022] GET /compute/v2.1/os-hosts/n-h1-852085-12 => generated 603 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:32:21.284079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c256a0aa-2d46-4d4d-b3ba-1c1ce932da51 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:21.286133 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c256a0aa-2d46-4d4d-b3ba-1c1ce932da51 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:21.306065 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e9cd282c-408c-4a50-b8af-b6d92c773147 tempest-AggregatesAdminTestJSON-708441017 tempest-AggregatesAdminTestJSON-708441017-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.191975 Oct 04 20:32:21.312289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c256a0aa-2d46-4d4d-b3ba-1c1ce932da51 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.316424 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c256a0aa-2d46-4d4d-b3ba-1c1ce932da51 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.317680 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c256a0aa-2d46-4d4d-b3ba-1c1ce932da51 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.320784 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 185/357] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:32:21 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:32:21.321162 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c256a0aa-2d46-4d4d-b3ba-1c1ce932da51 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.322442 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c256a0aa-2d46-4d4d-b3ba-1c1ce932da51 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.323554 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c256a0aa-2d46-4d4d-b3ba-1c1ce932da51 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.332773 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-54754af1-f645-41aa-b3af-b5360325dbd4 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Calling method '.version_select at 0x7f77efdabaf0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:21.382247 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-54754af1-f645-41aa-b3af-b5360325dbd4 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.383839 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-54754af1-f645-41aa-b3af-b5360325dbd4 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.385575 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-54754af1-f645-41aa-b3af-b5360325dbd4 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.441754 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-54754af1-f645-41aa-b3af-b5360325dbd4 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.445343 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-54754af1-f645-41aa-b3af-b5360325dbd4 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.452676 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-54754af1-f645-41aa-b3af-b5360325dbd4 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.597173 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-54754af1-f645-41aa-b3af-b5360325dbd4 tempest-HostsAdminTestJSON-717575710 tempest-HostsAdminTestJSON-717575710-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-h2-852085-12" status: 200 len: 471 microversion: 2.1 time: 0.274308 Oct 04 20:32:21.603985 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 186/358] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 4 20:32:21 2022] GET /compute/v2.1/os-hosts/n-h2-852085-12 => generated 471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:21.622314 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a78bbc9c-7642-47dc-a9fb-799545b196e4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:21.624000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a78bbc9c-7642-47dc-a9fb-799545b196e4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:21.640625 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a78bbc9c-7642-47dc-a9fb-799545b196e4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.642468 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a78bbc9c-7642-47dc-a9fb-799545b196e4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.643706 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a78bbc9c-7642-47dc-a9fb-799545b196e4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.645899 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a78bbc9c-7642-47dc-a9fb-799545b196e4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.647308 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a78bbc9c-7642-47dc-a9fb-799545b196e4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.648606 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a78bbc9c-7642-47dc-a9fb-799545b196e4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.673510 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-a78bbc9c-7642-47dc-a9fb-799545b196e4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] HTTP exception thrown: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a78bbc9c-7642-47dc-a9fb-799545b196e4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Request method failure captured: Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 HTTP/1.1 Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJf7yVTZBn3xKyM2P073GKzwLeGu1hJXdwzlKPNCfC4VMp00Xanle1Bed7wqJiN32pqzujd0oDWnZbBNSLT5Z_sYn-kj0IqCyYatgYKswU8NuUmHcCBYpRhIwZJMsrKW3CtPDqWCUHvdUC0Tm6a7D-kHeEiuSbklF_Mnbe4iwSdDQ4g Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: d0ded24c70b54fc5bb73d54fd1537abb Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminTestJSON-2056268426 Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:32:21.677612 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:32:21.679105 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d0ded24c70b54fc5bb73d54fd1537abb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d0ded24c70b54fc5bb73d54fd1537abb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d0ded24c70b54fc5bb73d54fd1537abb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d0ded24c70b54fc5bb73d54fd1537abb"}]}] Oct 04 20:32:21.679105 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminTestJSON-2056268426 Oct 04 20:32:21.679105 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: d0ded24c70b54fc5bb73d54fd1537abb Oct 04 20:32:21.679105 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2056268426 Oct 04 20:32:21.679105 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminTestJSON-2056268426-project Oct 04 20:32:21.679105 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:21.679105 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:21.679105 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 72398073905c49ee952b40ce1a53fd28 Oct 04 20:32:21.679105 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminTestJSON-2056268426-project Oct 04 20:32:21.679105 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:32:21.679105 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:21.679105 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '0867584d-2285-41b4-b1b9-0af13aa79dc1'} Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:21.680013 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:21.681376 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:21.685386 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a78bbc9c-7642-47dc-a9fb-799545b196e4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Returning 404 to user: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:21.688462 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a78bbc9c-7642-47dc-a9fb-799545b196e4 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 404 len: 111 microversion: 2.1 time: 0.081403 Oct 04 20:32:21.691515 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 187/359] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:32:21 2022] DELETE /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:21.709471 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d3ccb516-b247-428d-905b-1a01c6750a40 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:21.711386 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d3ccb516-b247-428d-905b-1a01c6750a40 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] [instance: 0867584d-2285-41b4-b1b9-0af13aa79dc1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:21.724005 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3ccb516-b247-428d-905b-1a01c6750a40 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.725490 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3ccb516-b247-428d-905b-1a01c6750a40 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.726637 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3ccb516-b247-428d-905b-1a01c6750a40 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.728723 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3ccb516-b247-428d-905b-1a01c6750a40 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.730102 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3ccb516-b247-428d-905b-1a01c6750a40 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.731384 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3ccb516-b247-428d-905b-1a01c6750a40 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.787945 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-d3ccb516-b247-428d-905b-1a01c6750a40 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] HTTP exception thrown: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d3ccb516-b247-428d-905b-1a01c6750a40 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Request method failure captured: Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 HTTP/1.1 Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJf7yVTZBn3xKyM2P073GKzwLeGu1hJXdwzlKPNCfC4VMp00Xanle1Bed7wqJiN32pqzujd0oDWnZbBNSLT5Z_sYn-kj0IqCyYatgYKswU8NuUmHcCBYpRhIwZJMsrKW3CtPDqWCUHvdUC0Tm6a7D-kHeEiuSbklF_Mnbe4iwSdDQ4g Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: d0ded24c70b54fc5bb73d54fd1537abb Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AggregatesAdminTestJSON-2056268426 Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:32:21.794989 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:32:21.797444 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d0ded24c70b54fc5bb73d54fd1537abb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d0ded24c70b54fc5bb73d54fd1537abb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d0ded24c70b54fc5bb73d54fd1537abb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d0ded24c70b54fc5bb73d54fd1537abb"}]}] Oct 04 20:32:21.797444 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AggregatesAdminTestJSON-2056268426 Oct 04 20:32:21.797444 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: d0ded24c70b54fc5bb73d54fd1537abb Oct 04 20:32:21.797444 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2056268426 Oct 04 20:32:21.797444 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AggregatesAdminTestJSON-2056268426-project Oct 04 20:32:21.797444 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:21.797444 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:21.797444 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 72398073905c49ee952b40ce1a53fd28 Oct 04 20:32:21.797444 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AggregatesAdminTestJSON-2056268426-project Oct 04 20:32:21.797444 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:32:21.797444 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:21.797444 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '0867584d-2285-41b4-b1b9-0af13aa79dc1'} Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:21.798687 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. Oct 04 20:32:21.800792 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:21.805763 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d3ccb516-b247-428d-905b-1a01c6750a40 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] Returning 404 to user: Instance 0867584d-2285-41b4-b1b9-0af13aa79dc1 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:21.808644 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d3ccb516-b247-428d-905b-1a01c6750a40 tempest-AggregatesAdminTestJSON-2056268426 tempest-AggregatesAdminTestJSON-2056268426-project] 10.222.0.78 "GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1" status: 404 len: 111 microversion: 2.1 time: 0.107814 Oct 04 20:32:21.810571 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 188/360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:21 2022] GET /compute/v2.1/servers/0867584d-2285-41b4-b1b9-0af13aa79dc1 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:21.816849 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c256a0aa-2d46-4d4d-b3ba-1c1ce932da51 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:21.835879 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c256a0aa-2d46-4d4d-b3ba-1c1ce932da51 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1270 microversion: 2.1 time: 0.563426 Oct 04 20:32:21.838964 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 173/361] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:21 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1270 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:21.990994 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ef357d2c-b2d0-4e2a-aab4-0af44e0a521e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:21.992325 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ef357d2c-b2d0-4e2a-aab4-0af44e0a521e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:22.004411 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ef357d2c-b2d0-4e2a-aab4-0af44e0a521e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:22.005472 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ef357d2c-b2d0-4e2a-aab4-0af44e0a521e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:22.006522 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ef357d2c-b2d0-4e2a-aab4-0af44e0a521e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:22.008063 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ef357d2c-b2d0-4e2a-aab4-0af44e0a521e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:22.008736 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ef357d2c-b2d0-4e2a-aab4-0af44e0a521e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:22.009411 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ef357d2c-b2d0-4e2a-aab4-0af44e0a521e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:22.486782 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ef357d2c-b2d0-4e2a-aab4-0af44e0a521e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:22.492293 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=100 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:22.527204 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ef357d2c-b2d0-4e2a-aab4-0af44e0a521e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1319 microversion: 2.1 time: 0.539996 Oct 04 20:32:22.529403 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 189/362] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:21 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1319 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:22.883460 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-17ff0eb1-5096-4dfb-b9dc-c640288a2a7a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:22.885885 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-17ff0eb1-5096-4dfb-b9dc-c640288a2a7a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:22.913633 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17ff0eb1-5096-4dfb-b9dc-c640288a2a7a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:22.920048 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17ff0eb1-5096-4dfb-b9dc-c640288a2a7a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:22.924654 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17ff0eb1-5096-4dfb-b9dc-c640288a2a7a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:22.927363 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17ff0eb1-5096-4dfb-b9dc-c640288a2a7a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:22.928800 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17ff0eb1-5096-4dfb-b9dc-c640288a2a7a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:22.929896 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17ff0eb1-5096-4dfb-b9dc-c640288a2a7a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:23.345939 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-17ff0eb1-5096-4dfb-b9dc-c640288a2a7a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:23.368402 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-17ff0eb1-5096-4dfb-b9dc-c640288a2a7a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1276 microversion: 2.1 time: 0.495568 Oct 04 20:32:23.370176 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 174/363] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:22 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1276 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:23.602467 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4e9a1600-da6e-412e-a92e-42c179972800 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:23.604091 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4e9a1600-da6e-412e-a92e-42c179972800 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:23.652464 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e9a1600-da6e-412e-a92e-42c179972800 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:23.655355 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e9a1600-da6e-412e-a92e-42c179972800 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:23.659034 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e9a1600-da6e-412e-a92e-42c179972800 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:23.683044 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e9a1600-da6e-412e-a92e-42c179972800 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:23.690722 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e9a1600-da6e-412e-a92e-42c179972800 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:23.694932 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e9a1600-da6e-412e-a92e-42c179972800 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:24.080966 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-49458fbb-b335-4026-b83c-d4f7345dcae0 req-acb7c56b-f955-452c-9f93-f1edf3a8a866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47fee7a-3d2d-4741-a563-feaba1355fd2", "name": "network-vif-plugged", "status": "completed", "tag": "67745228-c055-4896-94e6-ee8141b63c6d"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:24.112731 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-49458fbb-b335-4026-b83c-d4f7345dcae0 req-acb7c56b-f955-452c-9f93-f1edf3a8a866 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:24.113626 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-49458fbb-b335-4026-b83c-d4f7345dcae0 req-acb7c56b-f955-452c-9f93-f1edf3a8a866 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:24.114296 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-49458fbb-b335-4026-b83c-d4f7345dcae0 req-acb7c56b-f955-452c-9f93-f1edf3a8a866 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:24.130828 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-49458fbb-b335-4026-b83c-d4f7345dcae0 req-acb7c56b-f955-452c-9f93-f1edf3a8a866 service nova] Creating event network-vif-plugged:67745228-c055-4896-94e6-ee8141b63c6d for instance c47fee7a-3d2d-4741-a563-feaba1355fd2 on n-h1-852085-12 Oct 04 20:32:24.142174 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-49458fbb-b335-4026-b83c-d4f7345dcae0 req-acb7c56b-f955-452c-9f93-f1edf3a8a866 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067299 Oct 04 20:32:24.144310 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 175/364] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:24.420391 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e1bab78b-4e41-4fd0-897d-6c7130347ed1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:24.427893 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e1bab78b-4e41-4fd0-897d-6c7130347ed1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:24.460103 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e1bab78b-4e41-4fd0-897d-6c7130347ed1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:24.466857 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e1bab78b-4e41-4fd0-897d-6c7130347ed1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:24.470897 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e1bab78b-4e41-4fd0-897d-6c7130347ed1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:24.473940 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e1bab78b-4e41-4fd0-897d-6c7130347ed1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:24.479308 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e1bab78b-4e41-4fd0-897d-6c7130347ed1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:24.480758 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e1bab78b-4e41-4fd0-897d-6c7130347ed1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:24.489790 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=100 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:25.632908 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4e9a1600-da6e-412e-a92e-42c179972800 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:25.664145 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4e9a1600-da6e-412e-a92e-42c179972800 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1319 microversion: 2.1 time: 2.093055 Oct 04 20:32:25.670617 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 190/365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:23 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1319 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:25.732824 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e1bab78b-4e41-4fd0-897d-6c7130347ed1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:25.761326 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e1bab78b-4e41-4fd0-897d-6c7130347ed1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1318 microversion: 2.1 time: 1.352936 Oct 04 20:32:25.776496 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 176/366] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:24 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1318 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:26.726982 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-997f5085-7440-4700-a8bb-b79deab9803a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:26.735301 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-997f5085-7440-4700-a8bb-b79deab9803a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:26.761004 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-997f5085-7440-4700-a8bb-b79deab9803a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:26.762501 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-997f5085-7440-4700-a8bb-b79deab9803a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:26.769259 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-997f5085-7440-4700-a8bb-b79deab9803a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:26.772394 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-997f5085-7440-4700-a8bb-b79deab9803a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:26.773690 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-997f5085-7440-4700-a8bb-b79deab9803a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:26.774905 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-997f5085-7440-4700-a8bb-b79deab9803a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:26.812301 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-91b54a82-76b0-408d-8563-26e7791f6033 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:26.814896 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-91b54a82-76b0-408d-8563-26e7791f6033 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:26.829881 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=6 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:26.859207 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-91b54a82-76b0-408d-8563-26e7791f6033 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:26.881435 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-91b54a82-76b0-408d-8563-26e7791f6033 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:26.885269 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-91b54a82-76b0-408d-8563-26e7791f6033 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:26.898366 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-91b54a82-76b0-408d-8563-26e7791f6033 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:26.907199 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-91b54a82-76b0-408d-8563-26e7791f6033 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:26.907199 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-91b54a82-76b0-408d-8563-26e7791f6033 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:27.648036 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-997f5085-7440-4700-a8bb-b79deab9803a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:27.664648 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:27.672031 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-997f5085-7440-4700-a8bb-b79deab9803a tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1319 microversion: 2.1 time: 0.958596 Oct 04 20:32:27.691506 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-91b54a82-76b0-408d-8563-26e7791f6033 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:27.695453 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 191/367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:26 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1319 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:27.715934 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-91b54a82-76b0-408d-8563-26e7791f6033 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1318 microversion: 2.1 time: 0.912871 Oct 04 20:32:27.730760 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 177/368] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:26 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1318 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:28.740580 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-89d20a40-c001-4243-a36c-d55382faf549 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:28.746416 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-89d20a40-c001-4243-a36c-d55382faf549 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:28.784059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4f3ad73e-3434-4c9b-980a-a0e7da696d56 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:28.801858 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-89d20a40-c001-4243-a36c-d55382faf549 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:28.802660 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-89d20a40-c001-4243-a36c-d55382faf549 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:28.803596 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-89d20a40-c001-4243-a36c-d55382faf549 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:28.809622 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4f3ad73e-3434-4c9b-980a-a0e7da696d56 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:28.813673 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-89d20a40-c001-4243-a36c-d55382faf549 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:28.817273 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-89d20a40-c001-4243-a36c-d55382faf549 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:28.818477 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-89d20a40-c001-4243-a36c-d55382faf549 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:28.859731 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f3ad73e-3434-4c9b-980a-a0e7da696d56 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:28.865329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f3ad73e-3434-4c9b-980a-a0e7da696d56 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:28.865329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f3ad73e-3434-4c9b-980a-a0e7da696d56 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:28.870618 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f3ad73e-3434-4c9b-980a-a0e7da696d56 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:28.870618 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f3ad73e-3434-4c9b-980a-a0e7da696d56 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:28.871949 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f3ad73e-3434-4c9b-980a-a0e7da696d56 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:29.429027 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-89d20a40-c001-4243-a36c-d55382faf549 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:29.446524 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4f3ad73e-3434-4c9b-980a-a0e7da696d56 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:29.476618 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-89d20a40-c001-4243-a36c-d55382faf549 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1468 microversion: 2.1 time: 0.747823 Oct 04 20:32:29.478865 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 192/369] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:28 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1468 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:29.487690 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4f3ad73e-3434-4c9b-980a-a0e7da696d56 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1318 microversion: 2.1 time: 0.710766 Oct 04 20:32:29.513758 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 178/370] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:28 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1318 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:29.538682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3017b764-6bf8-48c2-93c2-f1d09fc436d6 tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:29.550104 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3017b764-6bf8-48c2-93c2-f1d09fc436d6 tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:29.568987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3017b764-6bf8-48c2-93c2-f1d09fc436d6 tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:29.570570 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3017b764-6bf8-48c2-93c2-f1d09fc436d6 tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:29.572334 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3017b764-6bf8-48c2-93c2-f1d09fc436d6 tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:29.575535 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3017b764-6bf8-48c2-93c2-f1d09fc436d6 tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:29.576877 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3017b764-6bf8-48c2-93c2-f1d09fc436d6 tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:29.578054 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3017b764-6bf8-48c2-93c2-f1d09fc436d6 tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:29.753198 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-82992e5e-2bca-43a1-a60f-be0ce94e6607 req-f1b486d6-5f88-494e-8bd3-d95054127425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb8f74d-23b2-4d2b-be76-202a02a5daac", "tag": "7cba16f6-509f-4a94-ab67-0c42d812da0b"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:29.807560 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-82992e5e-2bca-43a1-a60f-be0ce94e6607 req-f1b486d6-5f88-494e-8bd3-d95054127425 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:29.809117 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-82992e5e-2bca-43a1-a60f-be0ce94e6607 req-f1b486d6-5f88-494e-8bd3-d95054127425 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:29.810553 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-82992e5e-2bca-43a1-a60f-be0ce94e6607 req-f1b486d6-5f88-494e-8bd3-d95054127425 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:29.849619 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-82992e5e-2bca-43a1-a60f-be0ce94e6607 req-f1b486d6-5f88-494e-8bd3-d95054127425 service nova] Creating event network-changed:7cba16f6-509f-4a94-ab67-0c42d812da0b for instance 8cb8f74d-23b2-4d2b-be76-202a02a5daac on n-h1-852085-12 Oct 04 20:32:29.861586 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-82992e5e-2bca-43a1-a60f-be0ce94e6607 req-f1b486d6-5f88-494e-8bd3-d95054127425 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115779 Oct 04 20:32:29.863851 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 193/371] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:30.208427 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3017b764-6bf8-48c2-93c2-f1d09fc436d6 tempest-DeleteServersAdminTestJSON-1448924703 tempest-DeleteServersAdminTestJSON-1448924703-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2/action" status: 202 len: 0 microversion: 2.1 time: 0.686604 Oct 04 20:32:30.210361 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 179/372] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:32:29 2022] POST /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:32:30.224786 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:30.226092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:30.239564 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:30.241309 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:30.242385 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:30.244073 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:30.245365 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:30.246420 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:30.319227 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:30.320396 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:30.321431 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:30.323162 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lazy-loading 'fault' on Instance uuid c47fee7a-3d2d-4741-a563-feaba1355fd2 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:32:30.546636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0f215f4b-f5bd-4e37-8750-4d357bf91b2d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:30.554794 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-0f215f4b-f5bd-4e37-8750-4d357bf91b2d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:30.566178 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0f215f4b-f5bd-4e37-8750-4d357bf91b2d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:30.567621 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0f215f4b-f5bd-4e37-8750-4d357bf91b2d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:30.568772 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0f215f4b-f5bd-4e37-8750-4d357bf91b2d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:30.571349 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0f215f4b-f5bd-4e37-8750-4d357bf91b2d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:30.573596 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0f215f4b-f5bd-4e37-8750-4d357bf91b2d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:30.575110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0f215f4b-f5bd-4e37-8750-4d357bf91b2d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:30.659926 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:31.015772 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=10 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:31.050591 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:31.068830 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-26f2904f-6d03-41f5-9b60-01f6ec498168 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1451 microversion: 2.1 time: 0.851523 Oct 04 20:32:31.075742 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 194/373] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:30 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1451 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:31.117305 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-232f4431-3637-4cc3-b070-1613885fad5e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:31.118093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-232f4431-3637-4cc3-b070-1613885fad5e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:31.162951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-232f4431-3637-4cc3-b070-1613885fad5e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:31.163939 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-232f4431-3637-4cc3-b070-1613885fad5e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:31.164748 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-232f4431-3637-4cc3-b070-1613885fad5e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:31.164907 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-0f215f4b-f5bd-4e37-8750-4d357bf91b2d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:31.166296 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-232f4431-3637-4cc3-b070-1613885fad5e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:31.167208 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-232f4431-3637-4cc3-b070-1613885fad5e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:31.168030 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-232f4431-3637-4cc3-b070-1613885fad5e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:31.205870 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0f215f4b-f5bd-4e37-8750-4d357bf91b2d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1318 microversion: 2.1 time: 0.662867 Oct 04 20:32:31.209039 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 180/374] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:30 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:31.285120 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-232f4431-3637-4cc3-b070-1613885fad5e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:32:31.973993 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-232f4431-3637-4cc3-b070-1613885fad5e tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 204 len: 0 microversion: 2.1 time: 0.864001 Oct 04 20:32:31.978923 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 195/375] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:32:31 2022] DELETE /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:32:32.004344 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:32.010015 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:32.044683 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:32.047748 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:32.049059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:32.051213 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:32.057011 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:32.058054 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:32.158878 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:32.159680 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:32.160543 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:32.161671 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lazy-loading 'fault' on Instance uuid c47fee7a-3d2d-4741-a563-feaba1355fd2 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:32:32.256575 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b99c9c91-2a49-4c9d-a897-2f6b8df20485 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:32.258939 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b99c9c91-2a49-4c9d-a897-2f6b8df20485 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:32.304495 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b99c9c91-2a49-4c9d-a897-2f6b8df20485 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:32.308916 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b99c9c91-2a49-4c9d-a897-2f6b8df20485 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:32.310040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b99c9c91-2a49-4c9d-a897-2f6b8df20485 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:32.314819 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b99c9c91-2a49-4c9d-a897-2f6b8df20485 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:32.317093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b99c9c91-2a49-4c9d-a897-2f6b8df20485 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:32.324959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b99c9c91-2a49-4c9d-a897-2f6b8df20485 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:32.568637 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:32.590052 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-97200692-9b5f-4704-a443-c40fe410e090 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1457 microversion: 2.1 time: 0.601788 Oct 04 20:32:32.596749 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 181/376] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:31 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1457 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:32.755350 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b99c9c91-2a49-4c9d-a897-2f6b8df20485 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:32.775819 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b99c9c91-2a49-4c9d-a897-2f6b8df20485 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1318 microversion: 2.1 time: 0.527127 Oct 04 20:32:32.786240 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 196/377] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:32 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:33.633413 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:33.635307 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:33.646718 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:33.648965 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:33.650860 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:33.652596 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:33.665693 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:33.667702 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:33.823629 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:33.825786 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:33.827072 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:33.828252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lazy-loading 'fault' on Instance uuid c47fee7a-3d2d-4741-a563-feaba1355fd2 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:32:33.836732 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0634c253-a8fc-4d4d-8b6c-8fbadd04930c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:33.837953 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0634c253-a8fc-4d4d-8b6c-8fbadd04930c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:33.888157 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0634c253-a8fc-4d4d-8b6c-8fbadd04930c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:33.894208 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0634c253-a8fc-4d4d-8b6c-8fbadd04930c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:33.899590 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0634c253-a8fc-4d4d-8b6c-8fbadd04930c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:33.904202 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0634c253-a8fc-4d4d-8b6c-8fbadd04930c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:33.905863 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0634c253-a8fc-4d4d-8b6c-8fbadd04930c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:33.906951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0634c253-a8fc-4d4d-8b6c-8fbadd04930c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:34.365860 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0634c253-a8fc-4d4d-8b6c-8fbadd04930c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:34.404074 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0634c253-a8fc-4d4d-8b6c-8fbadd04930c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1318 microversion: 2.1 time: 0.568109 Oct 04 20:32:34.419680 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 197/378] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:33 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:34.461267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:34.507608 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-dacc9c96-337c-476c-861e-05cde9009fa2 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1457 microversion: 2.1 time: 0.857590 Oct 04 20:32:34.507608 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 182/379] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:33 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1457 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:35.466128 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-49fa1f18-0e3b-42f2-a813-538881ea8f3d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:35.467435 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-49fa1f18-0e3b-42f2-a813-538881ea8f3d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:35.499692 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49fa1f18-0e3b-42f2-a813-538881ea8f3d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:35.503358 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49fa1f18-0e3b-42f2-a813-538881ea8f3d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:35.508810 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49fa1f18-0e3b-42f2-a813-538881ea8f3d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:35.516961 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49fa1f18-0e3b-42f2-a813-538881ea8f3d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:35.518646 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49fa1f18-0e3b-42f2-a813-538881ea8f3d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:35.520411 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49fa1f18-0e3b-42f2-a813-538881ea8f3d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:35.539531 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:35.560243 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:35.608303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:35.609422 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:35.610233 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:35.617884 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:35.618613 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:35.619395 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:35.783452 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:35.786111 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:35.791559 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:35.796952 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lazy-loading 'fault' on Instance uuid c47fee7a-3d2d-4741-a563-feaba1355fd2 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:32:36.404801 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-49fa1f18-0e3b-42f2-a813-538881ea8f3d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:36.424085 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-49fa1f18-0e3b-42f2-a813-538881ea8f3d tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1318 microversion: 2.1 time: 0.971397 Oct 04 20:32:36.436911 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 198/380] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:35 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1318 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:36.828916 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:36.872451 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-082761d5-c6bb-4a60-bad7-c29098aebba3 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1457 microversion: 2.1 time: 1.340673 Oct 04 20:32:36.873484 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 183/381] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:35 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1457 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:37.482040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8363d1f4-8d12-477f-869b-a8c1b87cfde7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:37.485619 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8363d1f4-8d12-477f-869b-a8c1b87cfde7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:37.501613 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8363d1f4-8d12-477f-869b-a8c1b87cfde7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:37.502704 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8363d1f4-8d12-477f-869b-a8c1b87cfde7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:37.503655 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8363d1f4-8d12-477f-869b-a8c1b87cfde7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:37.512077 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8363d1f4-8d12-477f-869b-a8c1b87cfde7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:37.512077 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8363d1f4-8d12-477f-869b-a8c1b87cfde7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:37.512077 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8363d1f4-8d12-477f-869b-a8c1b87cfde7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:37.887798 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-7fca6754-f4d6-41d0-a187-662111ea47a3 req-cdb183da-2770-4005-9cbb-c3068cc2ee4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47fee7a-3d2d-4741-a563-feaba1355fd2", "name": "network-vif-deleted", "tag": "67745228-c055-4896-94e6-ee8141b63c6d"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:37.930419 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-7fca6754-f4d6-41d0-a187-662111ea47a3 req-cdb183da-2770-4005-9cbb-c3068cc2ee4e service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:37.933050 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-7fca6754-f4d6-41d0-a187-662111ea47a3 req-cdb183da-2770-4005-9cbb-c3068cc2ee4e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:37.937697 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8363d1f4-8d12-477f-869b-a8c1b87cfde7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:37.938818 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-7fca6754-f4d6-41d0-a187-662111ea47a3 req-cdb183da-2770-4005-9cbb-c3068cc2ee4e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:37.959929 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8363d1f4-8d12-477f-869b-a8c1b87cfde7 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1318 microversion: 2.1 time: 0.487714 Oct 04 20:32:37.977942 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 199/382] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:37 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:37.995897 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:37.997518 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:38.008206 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-7fca6754-f4d6-41d0-a187-662111ea47a3 req-cdb183da-2770-4005-9cbb-c3068cc2ee4e service nova] Creating event network-vif-deleted:67745228-c055-4896-94e6-ee8141b63c6d for instance c47fee7a-3d2d-4741-a563-feaba1355fd2 on n-h1-852085-12 Oct 04 20:32:38.011185 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:38.012705 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:38.014013 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:38.015412 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:38.016679 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:38.024592 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:38.027769 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-7fca6754-f4d6-41d0-a187-662111ea47a3 req-cdb183da-2770-4005-9cbb-c3068cc2ee4e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152502 Oct 04 20:32:38.029001 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 184/383] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:32:38.117283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:38.118581 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:38.119795 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:38.120874 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lazy-loading 'fault' on Instance uuid c47fee7a-3d2d-4741-a563-feaba1355fd2 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:32:38.221198 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:38.244170 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-846ac6bc-7149-4440-acde-0906750cde19 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1415 microversion: 2.1 time: 0.262082 Oct 04 20:32:38.246806 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 200/384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:37 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1415 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:39.009739 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2ad22541-84c4-4a2e-ae37-3c29fb1c3113 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:39.011257 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2ad22541-84c4-4a2e-ae37-3c29fb1c3113 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:39.023682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2ad22541-84c4-4a2e-ae37-3c29fb1c3113 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:39.025060 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2ad22541-84c4-4a2e-ae37-3c29fb1c3113 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:39.026163 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2ad22541-84c4-4a2e-ae37-3c29fb1c3113 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:39.027785 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2ad22541-84c4-4a2e-ae37-3c29fb1c3113 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:39.028903 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2ad22541-84c4-4a2e-ae37-3c29fb1c3113 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:39.030396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2ad22541-84c4-4a2e-ae37-3c29fb1c3113 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:39.301863 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:39.307434 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:39.325807 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:39.327376 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:39.329019 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:39.335536 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:39.337075 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:39.340831 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:39.471927 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2ad22541-84c4-4a2e-ae37-3c29fb1c3113 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:39.500961 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2ad22541-84c4-4a2e-ae37-3c29fb1c3113 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1318 microversion: 2.1 time: 0.494472 Oct 04 20:32:39.503408 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:39.504126 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 185/385] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:38 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:39.504322 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:39.505109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:39.505884 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lazy-loading 'fault' on Instance uuid c47fee7a-3d2d-4741-a563-feaba1355fd2 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:32:39.643324 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0986e6de5204c4d86e24184039366e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bcdec8c8d64e97b49281a0e16b0d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:39.654340 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-00635c88-5112-4558-ac36-c4d81601811a req-a5792889-ddf3-4e39-8f65-e55b437e5d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb8f74d-23b2-4d2b-be76-202a02a5daac", "name": "network-vif-plugged", "status": "completed", "tag": "7cba16f6-509f-4a94-ab67-0c42d812da0b"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:39.660978 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-88d03801-589c-4ec9-ae8a-eb7936f16393 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 200 len: 1309 microversion: 2.1 time: 0.371621 Oct 04 20:32:39.663913 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 201/386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:39 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 1309 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:39.721864 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-00635c88-5112-4558-ac36-c4d81601811a req-a5792889-ddf3-4e39-8f65-e55b437e5d84 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:39.722900 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-00635c88-5112-4558-ac36-c4d81601811a req-a5792889-ddf3-4e39-8f65-e55b437e5d84 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:39.723672 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-00635c88-5112-4558-ac36-c4d81601811a req-a5792889-ddf3-4e39-8f65-e55b437e5d84 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:39.750112 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-00635c88-5112-4558-ac36-c4d81601811a req-a5792889-ddf3-4e39-8f65-e55b437e5d84 service nova] Creating event network-vif-plugged:7cba16f6-509f-4a94-ab67-0c42d812da0b for instance 8cb8f74d-23b2-4d2b-be76-202a02a5daac on n-h1-852085-12 Oct 04 20:32:39.760858 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-00635c88-5112-4558-ac36-c4d81601811a req-a5792889-ddf3-4e39-8f65-e55b437e5d84 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118422 Oct 04 20:32:39.761933 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 186/387] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:40.550733 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c69cdd59-1156-4f3f-9167-72a87f80cef8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:40.552420 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c69cdd59-1156-4f3f-9167-72a87f80cef8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:40.563231 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c69cdd59-1156-4f3f-9167-72a87f80cef8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:40.564123 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c69cdd59-1156-4f3f-9167-72a87f80cef8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:40.565140 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c69cdd59-1156-4f3f-9167-72a87f80cef8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.566418 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c69cdd59-1156-4f3f-9167-72a87f80cef8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:40.567339 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c69cdd59-1156-4f3f-9167-72a87f80cef8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:40.568196 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c69cdd59-1156-4f3f-9167-72a87f80cef8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.722869 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2e10df61-c1f8-4b17-89be-6646efb79a13 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:40.729287 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2e10df61-c1f8-4b17-89be-6646efb79a13 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:40.747590 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e10df61-c1f8-4b17-89be-6646efb79a13 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:40.749232 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e10df61-c1f8-4b17-89be-6646efb79a13 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:40.750070 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e10df61-c1f8-4b17-89be-6646efb79a13 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.751427 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e10df61-c1f8-4b17-89be-6646efb79a13 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:40.752521 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e10df61-c1f8-4b17-89be-6646efb79a13 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:40.753725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e10df61-c1f8-4b17-89be-6646efb79a13 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-2e10df61-c1f8-4b17-89be-6646efb79a13 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] HTTP exception thrown: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2e10df61-c1f8-4b17-89be-6646efb79a13 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Request method failure captured: Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 HTTP/1.1 Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJf7KgqHQaon8yx_4NdgYCvKwAuQ5vq_E18Qd9Jbsj6nmOv4l-Ghb-l49U0l3WJqoVm5GGBPPfA0A7xcYdBPUf5PBKr0F1hy5lKhjihI_yfaRIfwAfIFoWiGXksYQd-DOs1E9k5t5gPP_l0p0YBk6q_CyUMyV4MmBXqXt2MisIUz-tc Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 13bcdec8c8d64e97b49281a0e16b0d79 Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:32:40.787323 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:32:40.790116 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_13bcdec8c8d64e97b49281a0e16b0d79", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/13bcdec8c8d64e97b49281a0e16b0d79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/13bcdec8c8d64e97b49281a0e16b0d79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/13bcdec8c8d64e97b49281a0e16b0d79"}]}] Oct 04 20:32:40.790116 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:40.790116 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 13bcdec8c8d64e97b49281a0e16b0d79 Oct 04 20:32:40.790116 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:40.790116 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-DeleteServersAdminTestJSON-2089848328-project Oct 04 20:32:40.790116 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:40.790116 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:40.790116 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: c0986e6de5204c4d86e24184039366e0 Oct 04 20:32:40.790116 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-DeleteServersAdminTestJSON-2089848328-project Oct 04 20:32:40.790116 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:32:40.790116 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.790116 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'c47fee7a-3d2d-4741-a563-feaba1355fd2'} Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:40.792465 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.794967 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.798974 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2e10df61-c1f8-4b17-89be-6646efb79a13 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Returning 404 to user: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:40.798974 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2e10df61-c1f8-4b17-89be-6646efb79a13 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 404 len: 111 microversion: 2.1 time: 0.078722 Oct 04 20:32:40.801024 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 187/388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:40 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:40.811612 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-62212909-f41a-4bb2-a3f7-8a9a1871c5b7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:40.812748 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-62212909-f41a-4bb2-a3f7-8a9a1871c5b7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:40.825456 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62212909-f41a-4bb2-a3f7-8a9a1871c5b7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:40.826358 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62212909-f41a-4bb2-a3f7-8a9a1871c5b7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:40.827189 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62212909-f41a-4bb2-a3f7-8a9a1871c5b7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.828548 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62212909-f41a-4bb2-a3f7-8a9a1871c5b7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:40.829410 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62212909-f41a-4bb2-a3f7-8a9a1871c5b7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:40.830131 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62212909-f41a-4bb2-a3f7-8a9a1871c5b7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.857387 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-62212909-f41a-4bb2-a3f7-8a9a1871c5b7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] HTTP exception thrown: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-62212909-f41a-4bb2-a3f7-8a9a1871c5b7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Request method failure captured: Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 HTTP/1.1 Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJf7KgqHQaon8yx_4NdgYCvKwAuQ5vq_E18Qd9Jbsj6nmOv4l-Ghb-l49U0l3WJqoVm5GGBPPfA0A7xcYdBPUf5PBKr0F1hy5lKhjihI_yfaRIfwAfIFoWiGXksYQd-DOs1E9k5t5gPP_l0p0YBk6q_CyUMyV4MmBXqXt2MisIUz-tc Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 13bcdec8c8d64e97b49281a0e16b0d79 Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:32:40.859872 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:32:40.862768 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_13bcdec8c8d64e97b49281a0e16b0d79", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/13bcdec8c8d64e97b49281a0e16b0d79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/13bcdec8c8d64e97b49281a0e16b0d79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/13bcdec8c8d64e97b49281a0e16b0d79"}]}] Oct 04 20:32:40.862768 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:40.862768 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 13bcdec8c8d64e97b49281a0e16b0d79 Oct 04 20:32:40.862768 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:40.862768 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-DeleteServersAdminTestJSON-2089848328-project Oct 04 20:32:40.862768 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:40.862768 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:40.862768 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: c0986e6de5204c4d86e24184039366e0 Oct 04 20:32:40.862768 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-DeleteServersAdminTestJSON-2089848328-project Oct 04 20:32:40.862768 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:32:40.862768 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.862768 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'c47fee7a-3d2d-4741-a563-feaba1355fd2'} Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:40.864291 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.866433 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.869380 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-62212909-f41a-4bb2-a3f7-8a9a1871c5b7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Returning 404 to user: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:40.869380 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-62212909-f41a-4bb2-a3f7-8a9a1871c5b7 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 404 len: 111 microversion: 2.1 time: 0.059806 Oct 04 20:32:40.872439 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 188/389] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:32:40 2022] DELETE /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:40.878549 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-82654a06-66aa-4f9f-8e49-e7374ad8086c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:40.880045 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-82654a06-66aa-4f9f-8e49-e7374ad8086c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: c47fee7a-3d2d-4741-a563-feaba1355fd2] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:40.890708 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-82654a06-66aa-4f9f-8e49-e7374ad8086c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:40.891334 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-82654a06-66aa-4f9f-8e49-e7374ad8086c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:40.891783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-82654a06-66aa-4f9f-8e49-e7374ad8086c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.892528 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-82654a06-66aa-4f9f-8e49-e7374ad8086c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:40.893053 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-82654a06-66aa-4f9f-8e49-e7374ad8086c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:40.893555 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-82654a06-66aa-4f9f-8e49-e7374ad8086c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.897927 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c69cdd59-1156-4f3f-9167-72a87f80cef8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:40.908879 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c69cdd59-1156-4f3f-9167-72a87f80cef8 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1318 microversion: 2.1 time: 0.366276 Oct 04 20:32:40.914045 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 202/390] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:40 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:40.914321 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-82654a06-66aa-4f9f-8e49-e7374ad8086c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] HTTP exception thrown: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-82654a06-66aa-4f9f-8e49-e7374ad8086c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Request method failure captured: Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 HTTP/1.1 Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJf7KgqHQaon8yx_4NdgYCvKwAuQ5vq_E18Qd9Jbsj6nmOv4l-Ghb-l49U0l3WJqoVm5GGBPPfA0A7xcYdBPUf5PBKr0F1hy5lKhjihI_yfaRIfwAfIFoWiGXksYQd-DOs1E9k5t5gPP_l0p0YBk6q_CyUMyV4MmBXqXt2MisIUz-tc Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 13bcdec8c8d64e97b49281a0e16b0d79 Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:32:40.914944 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:32:40.917964 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_13bcdec8c8d64e97b49281a0e16b0d79", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/13bcdec8c8d64e97b49281a0e16b0d79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/13bcdec8c8d64e97b49281a0e16b0d79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/13bcdec8c8d64e97b49281a0e16b0d79"}]}] Oct 04 20:32:40.917964 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:40.917964 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 13bcdec8c8d64e97b49281a0e16b0d79 Oct 04 20:32:40.917964 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:40.917964 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-DeleteServersAdminTestJSON-2089848328-project Oct 04 20:32:40.917964 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:40.917964 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:40.917964 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: c0986e6de5204c4d86e24184039366e0 Oct 04 20:32:40.917964 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-DeleteServersAdminTestJSON-2089848328-project Oct 04 20:32:40.917964 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:32:40.917964 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.917964 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'c47fee7a-3d2d-4741-a563-feaba1355fd2'} Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:40.919381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. Oct 04 20:32:40.921772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.923860 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-82654a06-66aa-4f9f-8e49-e7374ad8086c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Returning 404 to user: Instance c47fee7a-3d2d-4741-a563-feaba1355fd2 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:40.923860 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-82654a06-66aa-4f9f-8e49-e7374ad8086c tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2" status: 404 len: 111 microversion: 2.1 time: 0.046007 Oct 04 20:32:40.923860 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 189/391] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:40 2022] GET /compute/v2.1/servers/c47fee7a-3d2d-4741-a563-feaba1355fd2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:40.934995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-93726707-2f82-416b-9360-cc525e0c0610 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:40.936311 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-93726707-2f82-416b-9360-cc525e0c0610 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:40.949147 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-93726707-2f82-416b-9360-cc525e0c0610 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:40.950948 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-93726707-2f82-416b-9360-cc525e0c0610 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:40.951705 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-93726707-2f82-416b-9360-cc525e0c0610 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.952873 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-93726707-2f82-416b-9360-cc525e0c0610 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:40.953579 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-93726707-2f82-416b-9360-cc525e0c0610 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:40.954267 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-93726707-2f82-416b-9360-cc525e0c0610 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.976645 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-93726707-2f82-416b-9360-cc525e0c0610 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] HTTP exception thrown: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-93726707-2f82-416b-9360-cc525e0c0610 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Request method failure captured: Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce HTTP/1.1 Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJf7KgqHQaon8yx_4NdgYCvKwAuQ5vq_E18Qd9Jbsj6nmOv4l-Ghb-l49U0l3WJqoVm5GGBPPfA0A7xcYdBPUf5PBKr0F1hy5lKhjihI_yfaRIfwAfIFoWiGXksYQd-DOs1E9k5t5gPP_l0p0YBk6q_CyUMyV4MmBXqXt2MisIUz-tc Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 13bcdec8c8d64e97b49281a0e16b0d79 Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:32:40.980811 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:32:40.983671 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_13bcdec8c8d64e97b49281a0e16b0d79", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/13bcdec8c8d64e97b49281a0e16b0d79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/13bcdec8c8d64e97b49281a0e16b0d79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/13bcdec8c8d64e97b49281a0e16b0d79"}]}] Oct 04 20:32:40.983671 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:40.983671 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 13bcdec8c8d64e97b49281a0e16b0d79 Oct 04 20:32:40.983671 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:40.983671 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-DeleteServersAdminTestJSON-2089848328-project Oct 04 20:32:40.983671 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:40.983671 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:40.983671 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: c0986e6de5204c4d86e24184039366e0 Oct 04 20:32:40.983671 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-DeleteServersAdminTestJSON-2089848328-project Oct 04 20:32:40.983671 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:32:40.983671 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:40.983671 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '660c3eff-854d-4e7c-8247-4a992eda69ce'} Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:40.984878 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:40.987810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:40.990964 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-93726707-2f82-416b-9360-cc525e0c0610 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Returning 404 to user: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:40.990964 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-93726707-2f82-416b-9360-cc525e0c0610 tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "DELETE /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 404 len: 111 microversion: 2.1 time: 0.056755 Oct 04 20:32:40.990964 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 203/392] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:32:40 2022] DELETE /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:41.000359 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0bed82eb-ab5a-4a3c-bc79-079ac65872bf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:41.001514 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-0bed82eb-ab5a-4a3c-bc79-079ac65872bf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] [instance: 660c3eff-854d-4e7c-8247-4a992eda69ce] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:41.013552 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0bed82eb-ab5a-4a3c-bc79-079ac65872bf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:41.014448 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0bed82eb-ab5a-4a3c-bc79-079ac65872bf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:41.015277 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0bed82eb-ab5a-4a3c-bc79-079ac65872bf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:41.016656 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0bed82eb-ab5a-4a3c-bc79-079ac65872bf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:41.017486 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0bed82eb-ab5a-4a3c-bc79-079ac65872bf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:41.018501 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0bed82eb-ab5a-4a3c-bc79-079ac65872bf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:41.046277 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-0bed82eb-ab5a-4a3c-bc79-079ac65872bf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] HTTP exception thrown: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0bed82eb-ab5a-4a3c-bc79-079ac65872bf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Request method failure captured: Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce HTTP/1.1 Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJf7KgqHQaon8yx_4NdgYCvKwAuQ5vq_E18Qd9Jbsj6nmOv4l-Ghb-l49U0l3WJqoVm5GGBPPfA0A7xcYdBPUf5PBKr0F1hy5lKhjihI_yfaRIfwAfIFoWiGXksYQd-DOs1E9k5t5gPP_l0p0YBk6q_CyUMyV4MmBXqXt2MisIUz-tc Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 13bcdec8c8d64e97b49281a0e16b0d79 Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:32:41.049622 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:32:41.057220 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_13bcdec8c8d64e97b49281a0e16b0d79", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/13bcdec8c8d64e97b49281a0e16b0d79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/13bcdec8c8d64e97b49281a0e16b0d79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/13bcdec8c8d64e97b49281a0e16b0d79"}]}] Oct 04 20:32:41.057220 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:41.057220 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 13bcdec8c8d64e97b49281a0e16b0d79 Oct 04 20:32:41.057220 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2089848328 Oct 04 20:32:41.057220 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-DeleteServersAdminTestJSON-2089848328-project Oct 04 20:32:41.057220 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:41.057220 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:41.057220 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: c0986e6de5204c4d86e24184039366e0 Oct 04 20:32:41.057220 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-DeleteServersAdminTestJSON-2089848328-project Oct 04 20:32:41.057220 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:32:41.057220 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:41.057220 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '660c3eff-854d-4e7c-8247-4a992eda69ce'} Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:41.058677 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. Oct 04 20:32:41.063292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:41.065558 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0bed82eb-ab5a-4a3c-bc79-079ac65872bf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] Returning 404 to user: Instance 660c3eff-854d-4e7c-8247-4a992eda69ce could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:41.065558 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0bed82eb-ab5a-4a3c-bc79-079ac65872bf tempest-DeleteServersAdminTestJSON-2089848328 tempest-DeleteServersAdminTestJSON-2089848328-project] 10.222.0.78 "GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce" status: 404 len: 111 microversion: 2.1 time: 0.060835 Oct 04 20:32:41.065558 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 190/393] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:40 2022] GET /compute/v2.1/servers/660c3eff-854d-4e7c-8247-4a992eda69ce => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:42.408477 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-39f566a8-bc7d-4f4a-bf72-ef84d2c384d9 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Calling method '.version_select at 0x7f77efd12ca0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:42.645792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7bbf8bef-c6a3-4b76-b61e-04eaabe5f63b tempest-InstanceUsageAuditLogTestJSON-1109122411 tempest-InstanceUsageAuditLogTestJSON-1109122411-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:42.681670 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7bbf8bef-c6a3-4b76-b61e-04eaabe5f63b tempest-InstanceUsageAuditLogTestJSON-1109122411 tempest-InstanceUsageAuditLogTestJSON-1109122411-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 20:32:41" status: 200 len: 318 microversion: 2.1 time: 1.235734 Oct 04 20:32:42.683715 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 191/394] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:32:41 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2020%3A32%3A41 => generated 318 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:42.697223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e5371101-8fe8-4717-849b-221566e1ea00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:42.700202 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e5371101-8fe8-4717-849b-221566e1ea00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:42.718887 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e5371101-8fe8-4717-849b-221566e1ea00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:42.719633 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e5371101-8fe8-4717-849b-221566e1ea00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:42.720273 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e5371101-8fe8-4717-849b-221566e1ea00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:42.721283 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e5371101-8fe8-4717-849b-221566e1ea00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:42.722028 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e5371101-8fe8-4717-849b-221566e1ea00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:42.722780 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e5371101-8fe8-4717-849b-221566e1ea00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:42.999973 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e5371101-8fe8-4717-849b-221566e1ea00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:43.010793 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e5371101-8fe8-4717-849b-221566e1ea00 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1467 microversion: 2.1 time: 0.325162 Oct 04 20:32:43.011471 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 192/395] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:42 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1467 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:43.021481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-96d09737-b1e3-474a-ba4b-2d41e2f592c6 tempest-InstanceUsageAuditLogTestJSON-1109122411 tempest-InstanceUsageAuditLogTestJSON-1109122411-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:43.038066 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-96d09737-b1e3-474a-ba4b-2d41e2f592c6 tempest-InstanceUsageAuditLogTestJSON-1109122411 tempest-InstanceUsageAuditLogTestJSON-1109122411-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.025143 Oct 04 20:32:43.039016 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 193/396] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 4 20:32:43 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:43.045918 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-53f50526-366f-498e-9a79-2fb54cd39422 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:43.052999 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-53f50526-366f-498e-9a79-2fb54cd39422 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:43.058353 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-53f50526-366f-498e-9a79-2fb54cd39422 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:43.059346 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-53f50526-366f-498e-9a79-2fb54cd39422 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:43.063851 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-53f50526-366f-498e-9a79-2fb54cd39422 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:43.064680 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-53f50526-366f-498e-9a79-2fb54cd39422 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:43.065378 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-53f50526-366f-498e-9a79-2fb54cd39422 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:43.065956 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-53f50526-366f-498e-9a79-2fb54cd39422 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:43.099178 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-53f50526-366f-498e-9a79-2fb54cd39422 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lazy-loading 'flavor' on Instance uuid 8cb8f74d-23b2-4d2b-be76-202a02a5daac {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:32:43.307791 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1,nova_cell1:UPDATE=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:43.507356 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-39f566a8-bc7d-4f4a-bf72-ef84d2c384d9 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/2a266a03ad794c38ade55e55ee8255d7" status: 200 len: 371 microversion: 2.1 time: 2.161702 Oct 04 20:32:43.509456 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 204/397] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:32:41 2022] GET /compute/v2.1/os-quota-sets/2a266a03ad794c38ade55e55ee8255d7 => generated 371 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:43.519227 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-53f50526-366f-498e-9a79-2fb54cd39422 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac/action" status: 202 len: 0 microversion: 2.1 time: 0.477803 Oct 04 20:32:43.520394 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 194/398] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:32:43 2022] POST /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:32:43.533043 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7ae1f401-4431-40e8-9db5-9b2ac40a5bde tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Action: 'update', calling method: .version_select at 0x7f77efa53700>, body: {"quota_set": {"ram": "5120"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:43.550907 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-859907c2-68ac-45b1-94aa-5a915a7be4a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:43.553244 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-859907c2-68ac-45b1-94aa-5a915a7be4a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:43.566350 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-859907c2-68ac-45b1-94aa-5a915a7be4a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:43.567318 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-859907c2-68ac-45b1-94aa-5a915a7be4a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:43.568165 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-859907c2-68ac-45b1-94aa-5a915a7be4a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:43.569497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-859907c2-68ac-45b1-94aa-5a915a7be4a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:43.570354 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-859907c2-68ac-45b1-94aa-5a915a7be4a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:43.572088 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-859907c2-68ac-45b1-94aa-5a915a7be4a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:43.918039 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-859907c2-68ac-45b1-94aa-5a915a7be4a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:43.942500 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-859907c2-68ac-45b1-94aa-5a915a7be4a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1475 microversion: 2.1 time: 0.402263 Oct 04 20:32:43.943667 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 195/399] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:43 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1475 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:44.840821 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-512caf41-6a68-48a6-b191-df5b36fec995 tempest-FlavorMetadataValidation-2033687434 tempest-FlavorMetadataValidation-2033687434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1397886979", "id": 254630106, "os-flavor-access:is_public": "True"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:44.850641 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:44.961396 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-512caf41-6a68-48a6-b191-df5b36fec995 tempest-FlavorMetadataValidation-2033687434 tempest-FlavorMetadataValidation-2033687434-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 1.015648 Oct 04 20:32:44.963760 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 196/400] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:32:43 2022] POST /compute/v2.1/flavors => generated 468 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:44.989876 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4b35eb84-6b63-4eb6-bcde-22321a98a9fa tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:44.991867 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4b35eb84-6b63-4eb6-bcde-22321a98a9fa tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:45.004587 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4b35eb84-6b63-4eb6-bcde-22321a98a9fa tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:45.005791 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4b35eb84-6b63-4eb6-bcde-22321a98a9fa tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:45.007277 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4b35eb84-6b63-4eb6-bcde-22321a98a9fa tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:45.009956 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4b35eb84-6b63-4eb6-bcde-22321a98a9fa tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:45.012177 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4b35eb84-6b63-4eb6-bcde-22321a98a9fa tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:45.013300 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4b35eb84-6b63-4eb6-bcde-22321a98a9fa tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:45.175494 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7ae1f401-4431-40e8-9db5-9b2ac40a5bde tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:45.178686 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7ae1f401-4431-40e8-9db5-9b2ac40a5bde tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:45.183835 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7ae1f401-4431-40e8-9db5-9b2ac40a5bde tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:45.186761 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7ae1f401-4431-40e8-9db5-9b2ac40a5bde tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:45.190036 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7ae1f401-4431-40e8-9db5-9b2ac40a5bde tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:45.192641 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7ae1f401-4431-40e8-9db5-9b2ac40a5bde tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:45.306226 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4b35eb84-6b63-4eb6-bcde-22321a98a9fa tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:45.336961 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4b35eb84-6b63-4eb6-bcde-22321a98a9fa tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1458 microversion: 2.1 time: 0.356420 Oct 04 20:32:45.338431 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 197/401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:44 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1458 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:45.359412 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5d39bfd3-5171-45bc-b2a2-536a83eb6cbe tempest-FlavorMetadataValidation-2033687434 tempest-FlavorMetadataValidation-2033687434-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:45.500821 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7ae1f401-4431-40e8-9db5-9b2ac40a5bde tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/2a266a03ad794c38ade55e55ee8255d7" status: 200 len: 328 microversion: 2.1 time: 1.976490 Oct 04 20:32:45.504695 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 205/402] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:32:43 2022] PUT /compute/v2.1/os-quota-sets/2a266a03ad794c38ade55e55ee8255d7 => generated 328 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:45.515083 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c12fb416-b6e1-403b-9aa6-ebdcf87a96bf tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:45.516920 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c12fb416-b6e1-403b-9aa6-ebdcf87a96bf tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:45.536486 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c12fb416-b6e1-403b-9aa6-ebdcf87a96bf tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:45.538232 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c12fb416-b6e1-403b-9aa6-ebdcf87a96bf tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:45.539381 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c12fb416-b6e1-403b-9aa6-ebdcf87a96bf tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:45.541437 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c12fb416-b6e1-403b-9aa6-ebdcf87a96bf tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:45.542577 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c12fb416-b6e1-403b-9aa6-ebdcf87a96bf tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:45.543916 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c12fb416-b6e1-403b-9aa6-ebdcf87a96bf tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:45.856974 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5d39bfd3-5171-45bc-b2a2-536a83eb6cbe tempest-FlavorMetadataValidation-2033687434 tempest-FlavorMetadataValidation-2033687434-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/254630106/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.506843 Oct 04 20:32:45.857794 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 198/403] 10.222.0.78 () {62 vars in 1262 bytes} [Tue Oct 4 20:32:45 2022] POST /compute/v2.1/flavors/254630106/os-extra_specs => generated 62 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:46.195635 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:46.210892 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c12fb416-b6e1-403b-9aa6-ebdcf87a96bf tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1611 microversion: 2.1 time: 0.703062 Oct 04 20:32:46.211438 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 206/404] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:45 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1611 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:46.220064 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fdefdb3c-08d8-4ae3-9093-916fb2dc512b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:46.246963 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-995d6d98-bf68-401d-9dcc-e2dffaa47a90 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Action: 'create', calling method: .version_select at 0x7f77ef749d30>, body: {"keypair": {"name": "tempest-keypair-966378152", "type": "ssh", "user_id": "b042acd64e254b5b9e4b333b29070d5a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsxDPl1gd6/njA2IQTF3RkgozKd2mF/KvccFY1PVutAsa6xdqQ6myebgMVcTrNgh7q5JYBSJ9t/LdsEmsb+8wsxq7tl4wIrv+BQJwIlTbxZY5NDTWFKKYCKJUySpS4k9g=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:46.407646 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-995d6d98-bf68-401d-9dcc-e2dffaa47a90 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Getting quotas for project 4ac8ac881eb442c1bdaa098f0eb41f4f. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:46.420047 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-995d6d98-bf68-401d-9dcc-e2dffaa47a90 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Getting quotas for user 73c41babb0f44012b3c4628351070fad and project 4ac8ac881eb442c1bdaa098f0eb41f4f. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:46.449504 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fdefdb3c-08d8-4ae3-9093-916fb2dc512b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-quota-sets/2a266a03ad794c38ade55e55ee8255d7" status: 202 len: 0 microversion: 2.1 time: 0.236065 Oct 04 20:32:46.450824 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 207/405] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:32:46 2022] DELETE /compute/v2.1/os-quota-sets/2a266a03ad794c38ade55e55ee8255d7 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:32:46.460207 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e1d01aae-cdac-4a0b-a8f3-a939ea649a3d tempest-FlavorMetadataValidation-2033687434 tempest-FlavorMetadataValidation-2033687434-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:46.490976 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:46.589760 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-995d6d98-bf68-401d-9dcc-e2dffaa47a90 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.723274 Oct 04 20:32:46.589760 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 199/406] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 4 20:32:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 727 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:32:46.599858 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ff1cb699-9f0a-4997-ab35-c1f5078b80da tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:46.610577 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff1cb699-9f0a-4997-ab35-c1f5078b80da tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:46.612289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff1cb699-9f0a-4997-ab35-c1f5078b80da tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:46.613725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff1cb699-9f0a-4997-ab35-c1f5078b80da tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:46.615504 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff1cb699-9f0a-4997-ab35-c1f5078b80da tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:46.616846 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff1cb699-9f0a-4997-ab35-c1f5078b80da tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:46.617773 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff1cb699-9f0a-4997-ab35-c1f5078b80da tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:46.633055 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e1d01aae-cdac-4a0b-a8f3-a939ea649a3d tempest-FlavorMetadataValidation-2033687434 tempest-FlavorMetadataValidation-2033687434-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/254630106" status: 202 len: 0 microversion: 2.86 time: 0.179806 Oct 04 20:32:46.634006 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 208/407] 10.222.0.78 () {60 vars in 1199 bytes} [Tue Oct 4 20:32:46 2022] DELETE /compute/v2.1/flavors/254630106 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:32:46.645975 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-52fa81c8-7f1a-4044-91bd-5c944199f9c5 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Calling method '.version_select at 0x7f77efab1c10>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:46.675185 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ff1cb699-9f0a-4997-ab35-c1f5078b80da tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.086027 Oct 04 20:32:46.681444 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 200/408] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 4 20:32:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:46.686669 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-98a51697-af6b-485f-81dd-6cc31263c11d tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Action: 'create', calling method: .version_select at 0x7f77ef86c310>, body: {"keypair": {"name": "tempest-keypair-1195426451", "type": "ssh", "user_id": "b042acd64e254b5b9e4b333b29070d5a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPo6NWMCD31C6ujPshFW7F+vkkI+rhmdoOu5wdJXGlamZPgwrj1IjqJugP6o8qjufFJFObq5iP9/vpBpLCGrCmjB+2hk4Ogk6rnY+7ciLG7I1stgVRYBs1X8wsI2MelDgQ=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:46.729927 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-98a51697-af6b-485f-81dd-6cc31263c11d tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Getting quotas for project 4ac8ac881eb442c1bdaa098f0eb41f4f. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:46.743004 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-98a51697-af6b-485f-81dd-6cc31263c11d tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Getting quotas for user 73c41babb0f44012b3c4628351070fad and project 4ac8ac881eb442c1bdaa098f0eb41f4f. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:46.904960 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-98a51697-af6b-485f-81dd-6cc31263c11d tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.225726 Oct 04 20:32:46.916000 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 201/409] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 4 20:32:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 229 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:32:46.935713 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4fec7371-3fbf-4b91-8e79-fcfb24873233 tempest-FlavorMetadataValidation-2033687434 tempest-FlavorMetadataValidation-2033687434-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:46.991878 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4fec7371-3fbf-4b91-8e79-fcfb24873233 tempest-FlavorMetadataValidation-2033687434 tempest-FlavorMetadataValidation-2033687434-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.080679 Oct 04 20:32:46.994213 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 202/410] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 4 20:32:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:32:47.005065 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852085-12", "block_migration": true, "disk_over_commit": false}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:47.012202 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:47.028060 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:47.029829 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:47.034225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:47.034225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:47.034225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:47.035465 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:47.356784 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-52fa81c8-7f1a-4044-91bd-5c944199f9c5 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/2a266a03ad794c38ade55e55ee8255d7" status: 200 len: 371 microversion: 2.1 time: 0.720322 Oct 04 20:32:47.358375 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 209/411] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:32:46 2022] GET /compute/v2.1/os-quota-sets/2a266a03ad794c38ade55e55ee8255d7 => generated 371 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:47.378435 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-92b20826-83ab-493f-a4af-25016cf0dcb7 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Calling method '.version_select at 0x7f77efa70ee0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:47.411467 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-92b20826-83ab-493f-a4af-25016cf0dcb7 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-966378152?user_id=b042acd64e254b5b9e4b333b29070d5a" status: 200 len: 511 microversion: 2.10 time: 0.050660 Oct 04 20:32:47.418036 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 210/412] 10.222.0.78 () {60 vars in 1337 bytes} [Tue Oct 4 20:32:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-966378152?user_id=b042acd64e254b5b9e4b333b29070d5a => generated 511 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:47.447679 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9b829579-4c8d-4396-9bce-bb1e9b066140 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Action: 'create', calling method: .version_select at 0x7f77efa70670>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1782426720", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJTWmrzn925swG/X0EZE4R9ZWAphUkgI5yrrw2RnOt45LU9dk1S5geabMx3V4KFgHMBz5buj2OK/mtgpm76PVDnXZnzGvv8OCg4knSjnEkSYHouN/2eRB59ZJGw6j0ZEg=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:47.496453 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-9b829579-4c8d-4396-9bce-bb1e9b066140 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Getting quotas for project 4ac8ac881eb442c1bdaa098f0eb41f4f. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:47.505462 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-9b829579-4c8d-4396-9bce-bb1e9b066140 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Getting quotas for user 73c41babb0f44012b3c4628351070fad and project 4ac8ac881eb442c1bdaa098f0eb41f4f. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-db3df81e-89ac-4290-8aba-0bb10d6e8988) Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:32:47.622384 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:47.625043 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:32:47.627391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-db3df81e-89ac-4290-8aba-0bb10d6e8988) Oct 04 20:32:47.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Request method failure captured: Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac/action HTTP/1.1 Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 98 Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJgoI5IDDy8J9_VZASuoTykioW0FJkRS_zipjO-iG6zviIxj7fsKiOlnmiNqMElyVuOKp7rLaqMQFPKXd8JXvugMWrW2ERwp9f10BIdob_iCdl_pyeRIz5swyyakwKuZz3ZFTWfTWayvDLD2MX55XAlgesrm8-wNBWoGLr_Fo0DCUjY Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 8208e592a1494535b5d215fedbc63704 Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-LiveMigrationNegativeTest-1087114981 Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:32:47.631549 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:32:47.640301 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8208e592a1494535b5d215fedbc63704", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8208e592a1494535b5d215fedbc63704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8208e592a1494535b5d215fedbc63704"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8208e592a1494535b5d215fedbc63704"}]}] Oct 04 20:32:47.640301 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-LiveMigrationNegativeTest-1087114981 Oct 04 20:32:47.640301 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 8208e592a1494535b5d215fedbc63704 Oct 04 20:32:47.640301 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1087114981 Oct 04 20:32:47.640301 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-LiveMigrationNegativeTest-1087114981-project-admin Oct 04 20:32:47.640301 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:47.640301 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:47.640301 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: a839bd7f69904d51a0fa4f325911c43d Oct 04 20:32:47.640301 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-LiveMigrationNegativeTest-1087114981-project-admin Oct 04 20:32:47.640301 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:32:47.640301 n-d-852085-12 devstack@n-api.service[123539]: {"os-migrateLive": {"host": "n-h2-852085-12", "block_migration": true, "disk_over_commit": false}} Oct 04 20:32:47.640301 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '8cb8f74d-23b2-4d2b-be76-202a02a5daac', 'body': {'os-migrateLive': {'host': 'n-h2-852085-12', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:32:47.641563 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:47.643814 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:32:47.645973 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-db3df81e-89ac-4290-8aba-0bb10d6e8988) Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:47.648527 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:47.651913 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:47.656984 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:32:47.656984 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:47.656984 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f3e83f44-7e63-45a4-9911-beb1068ced30 tempest-LiveMigrationNegativeTest-1087114981 tempest-LiveMigrationNegativeTest-1087114981-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac/action" status: 500 len: 214 microversion: 2.1 time: 0.636050 Oct 04 20:32:47.656984 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 203/413] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:32:46 2022] POST /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac/action => generated 214 bytes in 648 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:32:47.659353 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cafe4629-8682-4084-b155-14c056b95484 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:47.660223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cafe4629-8682-4084-b155-14c056b95484 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:47.660627 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9b829579-4c8d-4396-9bce-bb1e9b066140 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.222872 Oct 04 20:32:47.671930 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 211/414] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 4 20:32:47 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 237 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 20:32:47.683962 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8169e6d0-8e67-40dc-9be7-138f1a4590ed tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Calling method '.version_select at 0x7f77efd12820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:47.692476 n-d-852085-12 devstack@n-api.service[123540]: WARNING oslo_db.sqlalchemy.utils [None req-8169e6d0-8e67-40dc-9be7-138f1a4590ed tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:32:47.693218 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cafe4629-8682-4084-b155-14c056b95484 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:47.700028 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cafe4629-8682-4084-b155-14c056b95484 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:47.700028 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cafe4629-8682-4084-b155-14c056b95484 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:47.700028 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cafe4629-8682-4084-b155-14c056b95484 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:47.700028 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cafe4629-8682-4084-b155-14c056b95484 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:47.700631 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cafe4629-8682-4084-b155-14c056b95484 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:47.708297 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8169e6d0-8e67-40dc-9be7-138f1a4590ed tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] 10.222.0.78 "GET /compute/v2.1/os-keypairs?user_id=b042acd64e254b5b9e4b333b29070d5a" status: 200 len: 725 microversion: 2.10 time: 0.032515 Oct 04 20:32:47.718721 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 212/415] 10.222.0.78 () {60 vars in 1259 bytes} [Tue Oct 4 20:32:47 2022] GET /compute/v2.1/os-keypairs?user_id=b042acd64e254b5b9e4b333b29070d5a => generated 725 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:47.730909 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-325ecd4d-fd4b-4335-9eb2-703f70580288 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Calling method '.version_select at 0x7f77efa70ca0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:47.782665 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cafe4629-8682-4084-b155-14c056b95484 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:32:47.929669 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-325ecd4d-fd4b-4335-9eb2-703f70580288 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1782426720" status: 204 len: 0 microversion: 2.10 time: 0.205646 Oct 04 20:32:47.930719 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 213/416] 10.222.0.78 () {60 vars in 1325 bytes} [Tue Oct 4 20:32:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1782426720 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 20:32:47.945859 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-925b0917-3be6-4c34-a694-f2f80928519e tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Calling method '.version_select at 0x7f77efa70dc0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:48.091822 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-925b0917-3be6-4c34-a694-f2f80928519e tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1195426451?user_id=b042acd64e254b5b9e4b333b29070d5a" status: 204 len: 0 microversion: 2.10 time: 0.153127 Oct 04 20:32:48.093039 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 214/417] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 4 20:32:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1195426451?user_id=b042acd64e254b5b9e4b333b29070d5a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 20:32:48.107855 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-43f6691b-f30d-43a4-8043-a4df940fa524 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] Calling method '.version_select at 0x7f77efe5faf0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:48.281396 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-43f6691b-f30d-43a4-8043-a4df940fa524 tempest-KeyPairsV210TestJSON-425802702 tempest-KeyPairsV210TestJSON-425802702-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-966378152?user_id=b042acd64e254b5b9e4b333b29070d5a" status: 204 len: 0 microversion: 2.10 time: 0.179891 Oct 04 20:32:48.282674 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 215/418] 10.222.0.78 () {60 vars in 1340 bytes} [Tue Oct 4 20:32:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-966378152?user_id=b042acd64e254b5b9e4b333b29070d5a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 20:32:48.394914 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cafe4629-8682-4084-b155-14c056b95484 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 204 len: 0 microversion: 2.1 time: 0.743454 Oct 04 20:32:48.396079 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 204/419] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:32:47 2022] DELETE /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 0 bytes in 748 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:32:48.414155 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e8837590-d1c4-4ad8-8547-7f84a1979a63 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:48.415348 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e8837590-d1c4-4ad8-8547-7f84a1979a63 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:48.430298 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e8837590-d1c4-4ad8-8547-7f84a1979a63 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:48.431595 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e8837590-d1c4-4ad8-8547-7f84a1979a63 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:48.432436 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e8837590-d1c4-4ad8-8547-7f84a1979a63 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:48.433617 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e8837590-d1c4-4ad8-8547-7f84a1979a63 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:48.434416 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e8837590-d1c4-4ad8-8547-7f84a1979a63 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:48.435186 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e8837590-d1c4-4ad8-8547-7f84a1979a63 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:48.460378 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-28a7f7ec-1cd0-434d-9ec1-a78317f93001 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Calling method '.version_select at 0x7f77ef913280>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:48.797530 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e8837590-d1c4-4ad8-8547-7f84a1979a63 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:48.816409 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e8837590-d1c4-4ad8-8547-7f84a1979a63 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1464 microversion: 2.1 time: 0.412518 Oct 04 20:32:48.831808 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 216/420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:48 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1464 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:50.172541 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-35506b13-1f96-414f-848b-b1e7368382c9 tempest-AZAdminNegativeTestJSON-1803488389 tempest-AZAdminNegativeTestJSON-1803488389-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:50.177541 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-35506b13-1f96-414f-848b-b1e7368382c9 tempest-AZAdminNegativeTestJSON-1803488389 tempest-AZAdminNegativeTestJSON-1803488389-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '93adfef1844741e383b6935778c2daca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ae2334a3254012948437ddf5316073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-35506b13-1f96-414f-848b-b1e7368382c9 tempest-AZAdminNegativeTestJSON-1803488389 tempest-AZAdminNegativeTestJSON-1803488389-project] Request method failure captured: Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJhr4hegfcF7Mvheh4-XSF8-Cvkq6ZKPJwi4KATqud7mW5XfjlkSWFjrryH1eyIUANLDu2jZ_csd4kWceYZUzJ2g6B7upub8mQRuLbbKuynD2Ie_Eed3DJBnfqeRD5nf-mIC7g4DHEcrlEIgFeymlxMepbiTrXVSNCwgBhBnQ3nCWns Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 73ae2334a3254012948437ddf5316073 Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1803488389 Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:32:50.185943 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:32:50.189063 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_73ae2334a3254012948437ddf5316073", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ae2334a3254012948437ddf5316073"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ae2334a3254012948437ddf5316073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/73ae2334a3254012948437ddf5316073"}]}] Oct 04 20:32:50.189063 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AZAdminNegativeTestJSON-1803488389 Oct 04 20:32:50.189063 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 73ae2334a3254012948437ddf5316073 Oct 04 20:32:50.189063 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1803488389 Oct 04 20:32:50.189063 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AZAdminNegativeTestJSON-1803488389-project Oct 04 20:32:50.189063 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:32:50.189063 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:32:50.189063 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 93adfef1844741e383b6935778c2daca Oct 04 20:32:50.189063 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AZAdminNegativeTestJSON-1803488389-project Oct 04 20:32:50.189063 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:32:50.189063 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 20:32:50.189063 n-d-852085-12 devstack@n-api.service[123540]: action_args: {} Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:50.190606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 20:32:50.193184 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:32:50.200872 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-35506b13-1f96-414f-848b-b1e7368382c9 tempest-AZAdminNegativeTestJSON-1803488389 tempest-AZAdminNegativeTestJSON-1803488389-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:50.203251 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-35506b13-1f96-414f-848b-b1e7368382c9 tempest-AZAdminNegativeTestJSON-1803488389 tempest-AZAdminNegativeTestJSON-1803488389-project] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.369642 Oct 04 20:32:50.208679 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 217/421] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 4 20:32:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1376 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:50.227483 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9b04cbc8-649e-48f1-ae20-83b70583dce1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:50.238739 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9b04cbc8-649e-48f1-ae20-83b70583dce1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:50.288995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9b04cbc8-649e-48f1-ae20-83b70583dce1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:50.289713 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9b04cbc8-649e-48f1-ae20-83b70583dce1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:50.290437 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9b04cbc8-649e-48f1-ae20-83b70583dce1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:50.295028 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9b04cbc8-649e-48f1-ae20-83b70583dce1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:50.296108 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9b04cbc8-649e-48f1-ae20-83b70583dce1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:50.296969 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9b04cbc8-649e-48f1-ae20-83b70583dce1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:50.825001 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-28a7f7ec-1cd0-434d-9ec1-a78317f93001 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/92914d55af6f49398edc52da69b55cd8/defaults" status: 200 len: 371 microversion: 2.1 time: 2.372168 Oct 04 20:32:50.842632 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 205/422] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:32:48 2022] GET /compute/v2.1/os-quota-sets/92914d55af6f49398edc52da69b55cd8/defaults => generated 371 bytes in 2391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:32:50.934875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9b04cbc8-649e-48f1-ae20-83b70583dce1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:50.969909 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9b04cbc8-649e-48f1-ae20-83b70583dce1 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1464 microversion: 2.1 time: 0.756988 Oct 04 20:32:50.971044 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 218/423] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:50 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1464 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:52.017293 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6a9c154f-cd6a-4fba-8538-f14236a1505e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:52.020079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6a9c154f-cd6a-4fba-8538-f14236a1505e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:52.051053 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a9c154f-cd6a-4fba-8538-f14236a1505e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:52.051053 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a9c154f-cd6a-4fba-8538-f14236a1505e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:52.051770 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a9c154f-cd6a-4fba-8538-f14236a1505e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:52.052658 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a9c154f-cd6a-4fba-8538-f14236a1505e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:52.053479 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a9c154f-cd6a-4fba-8538-f14236a1505e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:52.054241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a9c154f-cd6a-4fba-8538-f14236a1505e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:52.596317 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6a9c154f-cd6a-4fba-8538-f14236a1505e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:52.632762 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6a9c154f-cd6a-4fba-8538-f14236a1505e tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1464 microversion: 2.1 time: 0.621913 Oct 04 20:32:52.653765 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 206/424] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:52 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1464 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:52.878983 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-bb5587a4-ffcb-424a-96c4-d30f62a57c0f req-55a0e8fd-f620-4d5d-a78c-e50651555f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb8f74d-23b2-4d2b-be76-202a02a5daac", "name": "network-vif-deleted", "tag": "7cba16f6-509f-4a94-ab67-0c42d812da0b"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:52.959566 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-bb5587a4-ffcb-424a-96c4-d30f62a57c0f req-55a0e8fd-f620-4d5d-a78c-e50651555f47 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:52.961291 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-bb5587a4-ffcb-424a-96c4-d30f62a57c0f req-55a0e8fd-f620-4d5d-a78c-e50651555f47 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:52.961879 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-bb5587a4-ffcb-424a-96c4-d30f62a57c0f req-55a0e8fd-f620-4d5d-a78c-e50651555f47 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:53.005996 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-bb5587a4-ffcb-424a-96c4-d30f62a57c0f req-55a0e8fd-f620-4d5d-a78c-e50651555f47 service nova] Creating event network-vif-deleted:7cba16f6-509f-4a94-ab67-0c42d812da0b for instance 8cb8f74d-23b2-4d2b-be76-202a02a5daac on n-h1-852085-12 Oct 04 20:32:53.030673 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-bb5587a4-ffcb-424a-96c4-d30f62a57c0f req-55a0e8fd-f620-4d5d-a78c-e50651555f47 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155663 Oct 04 20:32:53.034481 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 219/425] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:32:53.437836 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-071b7fe0-2a5d-4da5-90a6-0d2f85c8ebdb tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Action: 'update', calling method: .version_select at 0x7f77efbc1ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:53.694098 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:53.695383 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:53.709651 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:53.710524 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:53.711355 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:53.713176 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:53.714020 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:53.714791 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:53.779962 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:53.780593 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:53.781608 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:53.784558 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lazy-loading 'fault' on Instance uuid 8cb8f74d-23b2-4d2b-be76-202a02a5daac {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:32:54.055873 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:54.139317 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bef4da1d-fd88-4bf6-9aef-d0391261ba89 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 200 len: 1308 microversion: 2.1 time: 0.456840 Oct 04 20:32:54.156403 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 220/426] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:53 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:54.613055 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-071b7fe0-2a5d-4da5-90a6-0d2f85c8ebdb tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:54.613055 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-071b7fe0-2a5d-4da5-90a6-0d2f85c8ebdb tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:54.613055 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-071b7fe0-2a5d-4da5-90a6-0d2f85c8ebdb tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:54.614677 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-071b7fe0-2a5d-4da5-90a6-0d2f85c8ebdb tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:54.628497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-071b7fe0-2a5d-4da5-90a6-0d2f85c8ebdb tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:54.629588 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-071b7fe0-2a5d-4da5-90a6-0d2f85c8ebdb tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:54.939533 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-071b7fe0-2a5d-4da5-90a6-0d2f85c8ebdb tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/56a57934eecd4bf48d329faaa39cbd4d" status: 200 len: 328 microversion: 2.1 time: 1.501356 Oct 04 20:32:54.953450 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 207/427] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:32:53 2022] PUT /compute/v2.1/os-quota-sets/56a57934eecd4bf48d329faaa39cbd4d => generated 328 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:32:54.983579 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a3f2e99e-eb2b-4e62-a891-ef66836812d8 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Calling method '.version_select at 0x7f77efab10d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:55.189203 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d377ddb2-9909-4589-a14e-af5d0341d680 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:55.190047 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d377ddb2-9909-4589-a14e-af5d0341d680 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 8cb8f74d-23b2-4d2b-be76-202a02a5daac] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:55.198240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d377ddb2-9909-4589-a14e-af5d0341d680 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:55.198973 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d377ddb2-9909-4589-a14e-af5d0341d680 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:55.199571 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d377ddb2-9909-4589-a14e-af5d0341d680 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:55.200540 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d377ddb2-9909-4589-a14e-af5d0341d680 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:55.201171 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d377ddb2-9909-4589-a14e-af5d0341d680 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:55.201707 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d377ddb2-9909-4589-a14e-af5d0341d680 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:55.220933 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:55.223407 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-d377ddb2-9909-4589-a14e-af5d0341d680 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] HTTP exception thrown: Instance 8cb8f74d-23b2-4d2b-be76-202a02a5daac could not be found. Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d377ddb2-9909-4589-a14e-af5d0341d680 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Request method failure captured: Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac HTTP/1.1 Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJglsRzLQs9H0qOAf5kXJOZ8-yjm0t_QFZy8J2DdHHM7Ds1Mq6OF1y_ZMwf5G84B60tisCckx8SabkIlDrokTKZ56IXoA-gqQtqkBp4BQKqUSn0APG3KTHC2qX4tsMEUJlQ5cB9vu6gzIKzsb9IJVBLGon2KESptlqoTrpIRr-zmc6g Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: e756f3ec49694205b5dccf3408cee098 Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-LiveMigrationNegativeTest-650952009 Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:32:55.226837 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:32:55.238160 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e756f3ec49694205b5dccf3408cee098", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e756f3ec49694205b5dccf3408cee098"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e756f3ec49694205b5dccf3408cee098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e756f3ec49694205b5dccf3408cee098"}]}] Oct 04 20:32:55.238160 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-LiveMigrationNegativeTest-650952009 Oct 04 20:32:55.238160 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: e756f3ec49694205b5dccf3408cee098 Oct 04 20:32:55.238160 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-650952009 Oct 04 20:32:55.238160 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-LiveMigrationNegativeTest-650952009-project Oct 04 20:32:55.238160 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:32:55.238160 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:32:55.238160 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 4b8c35b4791b41fea4edf6b6f1ef6de1 Oct 04 20:32:55.238160 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-LiveMigrationNegativeTest-650952009-project Oct 04 20:32:55.238160 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:32:55.238160 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 8cb8f74d-23b2-4d2b-be76-202a02a5daac could not be found. Oct 04 20:32:55.238160 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '8cb8f74d-23b2-4d2b-be76-202a02a5daac'} Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb8f74d-23b2-4d2b-be76-202a02a5daac could not be found. Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:55.239744 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb8f74d-23b2-4d2b-be76-202a02a5daac could not be found. Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb8f74d-23b2-4d2b-be76-202a02a5daac could not be found. Oct 04 20:32:55.242283 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:32:55.245545 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d377ddb2-9909-4589-a14e-af5d0341d680 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Returning 404 to user: Instance 8cb8f74d-23b2-4d2b-be76-202a02a5daac could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:55.245545 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d377ddb2-9909-4589-a14e-af5d0341d680 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac" status: 404 len: 111 microversion: 2.1 time: 0.045823 Oct 04 20:32:55.245545 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 208/428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:55 2022] GET /compute/v2.1/servers/8cb8f74d-23b2-4d2b-be76-202a02a5daac => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:32:55.247702 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dcb7157b-9a01-45f4-bd9a-c7c4718c297a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:55.248616 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-dcb7157b-9a01-45f4-bd9a-c7c4718c297a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:55.261386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dcb7157b-9a01-45f4-bd9a-c7c4718c297a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:55.264156 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dcb7157b-9a01-45f4-bd9a-c7c4718c297a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:55.264156 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dcb7157b-9a01-45f4-bd9a-c7c4718c297a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:55.264541 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dcb7157b-9a01-45f4-bd9a-c7c4718c297a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:55.265791 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dcb7157b-9a01-45f4-bd9a-c7c4718c297a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:55.266586 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dcb7157b-9a01-45f4-bd9a-c7c4718c297a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:55.330142 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-dcb7157b-9a01-45f4-bd9a-c7c4718c297a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:32:55.964419 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-dcb7157b-9a01-45f4-bd9a-c7c4718c297a tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "DELETE /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 204 len: 0 microversion: 2.1 time: 0.724225 Oct 04 20:32:55.967569 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 209/429] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:32:55 2022] DELETE /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:32:55.991707 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3bcf492a-08ff-46b2-ad55-e0055f432615 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:55.995049 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3bcf492a-08ff-46b2-ad55-e0055f432615 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:56.011313 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3bcf492a-08ff-46b2-ad55-e0055f432615 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:56.012872 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3bcf492a-08ff-46b2-ad55-e0055f432615 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:56.014577 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3bcf492a-08ff-46b2-ad55-e0055f432615 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:56.016366 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3bcf492a-08ff-46b2-ad55-e0055f432615 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:56.017771 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3bcf492a-08ff-46b2-ad55-e0055f432615 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:56.018865 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3bcf492a-08ff-46b2-ad55-e0055f432615 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:56.668251 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3bcf492a-08ff-46b2-ad55-e0055f432615 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:56.698589 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3bcf492a-08ff-46b2-ad55-e0055f432615 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1474 microversion: 2.1 time: 0.721036 Oct 04 20:32:56.701958 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 210/430] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:55 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1474 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:57.202483 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a3f2e99e-eb2b-4e62-a891-ef66836812d8 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:57.205681 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a3f2e99e-eb2b-4e62-a891-ef66836812d8 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:57.207988 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a3f2e99e-eb2b-4e62-a891-ef66836812d8 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:57.211129 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a3f2e99e-eb2b-4e62-a891-ef66836812d8 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:57.213405 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a3f2e99e-eb2b-4e62-a891-ef66836812d8 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:57.217343 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a3f2e99e-eb2b-4e62-a891-ef66836812d8 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:57.270951 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a3f2e99e-eb2b-4e62-a891-ef66836812d8 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/56a57934eecd4bf48d329faaa39cbd4d/detail" status: 200 len: 916 microversion: 2.1 time: 2.313712 Oct 04 20:32:57.274974 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 221/431] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:32:54 2022] GET /compute/v2.1/os-quota-sets/56a57934eecd4bf48d329faaa39cbd4d/detail => generated 916 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:57.756552 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b67b13a4-9358-40c5-afcd-e677349c41c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:57.759605 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b67b13a4-9358-40c5-afcd-e677349c41c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:57.791951 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b67b13a4-9358-40c5-afcd-e677349c41c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:57.799472 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b67b13a4-9358-40c5-afcd-e677349c41c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:57.800827 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b67b13a4-9358-40c5-afcd-e677349c41c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:57.810100 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b67b13a4-9358-40c5-afcd-e677349c41c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:57.817496 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b67b13a4-9358-40c5-afcd-e677349c41c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:57.840121 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b67b13a4-9358-40c5-afcd-e677349c41c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:58.241732 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b67b13a4-9358-40c5-afcd-e677349c41c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:58.270574 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b67b13a4-9358-40c5-afcd-e677349c41c6 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1474 microversion: 2.1 time: 0.530420 Oct 04 20:32:58.278804 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 211/432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:57 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1474 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:59.335346 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-62e26dae-13a5-4058-a70e-f637389032a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:59.338738 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-62e26dae-13a5-4058-a70e-f637389032a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:59.355159 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62e26dae-13a5-4058-a70e-f637389032a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:59.356172 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62e26dae-13a5-4058-a70e-f637389032a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:59.357828 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62e26dae-13a5-4058-a70e-f637389032a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:59.360748 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62e26dae-13a5-4058-a70e-f637389032a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:59.361632 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62e26dae-13a5-4058-a70e-f637389032a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:59.362686 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62e26dae-13a5-4058-a70e-f637389032a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:59.873683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-62e26dae-13a5-4058-a70e-f637389032a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:59.945238 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-62e26dae-13a5-4058-a70e-f637389032a9 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1474 microversion: 2.1 time: 0.620293 Oct 04 20:32:59.950429 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 222/433] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:59 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1474 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:00.219069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-cb88a104-a24d-4445-86ee-09e330dbbfd0 req-fba873b7-01c7-4a5c-b21c-bd14201bc0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "657c60d3-dfa6-4665-aa9c-66cf28399f64", "name": "network-vif-deleted", "tag": "92bc6db0-cee2-4ded-8108-fb4d85ea7465"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:00.251904 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-cb88a104-a24d-4445-86ee-09e330dbbfd0 req-fba873b7-01c7-4a5c-b21c-bd14201bc0f0 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:00.263606 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-cb88a104-a24d-4445-86ee-09e330dbbfd0 req-fba873b7-01c7-4a5c-b21c-bd14201bc0f0 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:00.263606 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-cb88a104-a24d-4445-86ee-09e330dbbfd0 req-fba873b7-01c7-4a5c-b21c-bd14201bc0f0 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:00.348300 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-cb88a104-a24d-4445-86ee-09e330dbbfd0 req-fba873b7-01c7-4a5c-b21c-bd14201bc0f0 service nova] Creating event network-vif-deleted:92bc6db0-cee2-4ded-8108-fb4d85ea7465 for instance 657c60d3-dfa6-4665-aa9c-66cf28399f64 on n-h2-852085-12 Oct 04 20:33:00.368253 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-cb88a104-a24d-4445-86ee-09e330dbbfd0 req-fba873b7-01c7-4a5c-b21c-bd14201bc0f0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157210 Oct 04 20:33:00.372433 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 212/434] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:33:01.002242 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:01.005264 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:01.021376 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:01.022686 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:01.024132 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:01.026683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:01.030986 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:01.032925 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:01.140526 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef641af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:01.181468 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:01.187518 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:01.188475 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:01.190939 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lazy-loading 'fault' on Instance uuid 657c60d3-dfa6-4665-aa9c-66cf28399f64 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:33:01.334023 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8c35b4791b41fea4edf6b6f1ef6de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e756f3ec49694205b5dccf3408cee098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:01.387283 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f1d02f96-b0c1-4035-bd84-1efe48d78a4c tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 200 len: 1308 microversion: 2.1 time: 0.396051 Oct 04 20:33:01.393372 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 223/435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:00 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 1308 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:02.947672 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3ca27c2c-9148-4624-aa97-c127aa1b9a4e tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Action: 'create', calling method: .version_select at 0x7f77efab1430>, body: {"pool": null} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:03.283716 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:03.283716 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:03.283716 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:03.291842 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:03.297360 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:03.304492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:03.533621 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=88,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:03.568511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:03.571760 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:03.573445 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:03.578668 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:03.581613 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:03.593470 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:03.985699 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ae5a4ce2-4be8-45cb-b19d-eac93821301f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/56a57934eecd4bf48d329faaa39cbd4d?user_id=8fe5737629e64e84a2c46f636cde0997" status: 200 len: 328 microversion: 2.1 time: 2.857402 Oct 04 20:33:03.995421 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 213/436] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Oct 4 20:33:01 2022] PUT /compute/v2.1/os-quota-sets/56a57934eecd4bf48d329faaa39cbd4d?user_id=8fe5737629e64e84a2c46f636cde0997 => generated 328 bytes in 2869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:04.016210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-30dea2f2-3585-4a8b-b1c4-cc144ad72cc0 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:04.018170 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-30dea2f2-3585-4a8b-b1c4-cc144ad72cc0 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] [instance: 657c60d3-dfa6-4665-aa9c-66cf28399f64] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:04.040401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-30dea2f2-3585-4a8b-b1c4-cc144ad72cc0 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:04.041889 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-30dea2f2-3585-4a8b-b1c4-cc144ad72cc0 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:04.044069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-30dea2f2-3585-4a8b-b1c4-cc144ad72cc0 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:04.046101 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-30dea2f2-3585-4a8b-b1c4-cc144ad72cc0 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:04.047462 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-30dea2f2-3585-4a8b-b1c4-cc144ad72cc0 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:04.048972 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-30dea2f2-3585-4a8b-b1c4-cc144ad72cc0 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:04.085667 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-30dea2f2-3585-4a8b-b1c4-cc144ad72cc0 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] HTTP exception thrown: Instance 657c60d3-dfa6-4665-aa9c-66cf28399f64 could not be found. Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-30dea2f2-3585-4a8b-b1c4-cc144ad72cc0 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Request method failure captured: Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 HTTP/1.1 Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJglsRzLQs9H0qOAf5kXJOZ8-yjm0t_QFZy8J2DdHHM7Ds1Mq6OF1y_ZMwf5G84B60tisCckx8SabkIlDrokTKZ56IXoA-gqQtqkBp4BQKqUSn0APG3KTHC2qX4tsMEUJlQ5cB9vu6gzIKzsb9IJVBLGon2KESptlqoTrpIRr-zmc6g Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: e756f3ec49694205b5dccf3408cee098 Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-LiveMigrationNegativeTest-650952009 Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:33:04.091253 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:33:04.093919 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e756f3ec49694205b5dccf3408cee098", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e756f3ec49694205b5dccf3408cee098"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e756f3ec49694205b5dccf3408cee098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e756f3ec49694205b5dccf3408cee098"}]}] Oct 04 20:33:04.093919 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-LiveMigrationNegativeTest-650952009 Oct 04 20:33:04.093919 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: e756f3ec49694205b5dccf3408cee098 Oct 04 20:33:04.093919 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-650952009 Oct 04 20:33:04.093919 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-LiveMigrationNegativeTest-650952009-project Oct 04 20:33:04.093919 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:33:04.093919 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:33:04.093919 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 4b8c35b4791b41fea4edf6b6f1ef6de1 Oct 04 20:33:04.093919 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-LiveMigrationNegativeTest-650952009-project Oct 04 20:33:04.093919 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:33:04.093919 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 657c60d3-dfa6-4665-aa9c-66cf28399f64 could not be found. Oct 04 20:33:04.093919 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '657c60d3-dfa6-4665-aa9c-66cf28399f64'} Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 657c60d3-dfa6-4665-aa9c-66cf28399f64 could not be found. Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:04.095409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 657c60d3-dfa6-4665-aa9c-66cf28399f64 could not be found. Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 657c60d3-dfa6-4665-aa9c-66cf28399f64 could not be found. Oct 04 20:33:04.102383 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:33:04.116556 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-30dea2f2-3585-4a8b-b1c4-cc144ad72cc0 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] Returning 404 to user: Instance 657c60d3-dfa6-4665-aa9c-66cf28399f64 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:04.116556 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-30dea2f2-3585-4a8b-b1c4-cc144ad72cc0 tempest-LiveMigrationNegativeTest-650952009 tempest-LiveMigrationNegativeTest-650952009-project] 10.222.0.78 "GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64" status: 404 len: 111 microversion: 2.1 time: 0.100142 Oct 04 20:33:04.116556 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 214/437] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:03 2022] GET /compute/v2.1/servers/657c60d3-dfa6-4665-aa9c-66cf28399f64 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:04.125325 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a8e06dea-09f0-44aa-86c3-921282f9ba12 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Calling method '.version_select at 0x7f77ef6410d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:05.708269 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a8e06dea-09f0-44aa-86c3-921282f9ba12 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/56a57934eecd4bf48d329faaa39cbd4d?user_id=8fe5737629e64e84a2c46f636cde0997" status: 200 len: 370 microversion: 2.1 time: 1.599844 Oct 04 20:33:05.714103 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 215/438] 10.222.0.78 () {58 vars in 1323 bytes} [Tue Oct 4 20:33:04 2022] GET /compute/v2.1/os-quota-sets/56a57934eecd4bf48d329faaa39cbd4d?user_id=8fe5737629e64e84a2c46f636cde0997 => generated 370 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:06.967511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-23c8d062-19a1-4ea1-b5d5-f3c4311798ba tempest-FlavorsV261TestJSON-1746544830 tempest-FlavorsV261TestJSON-1746544830-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1899228556", "id": 1226614007, "os-flavor-access:is_public": "True"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:07.198164 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=18 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:07.208964 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-23c8d062-19a1-4ea1-b5d5-f3c4311798ba tempest-FlavorsV261TestJSON-1746544830 tempest-FlavorsV261TestJSON-1746544830-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 1.491849 Oct 04 20:33:07.236887 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 216/439] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:33:05 2022] POST /compute/v2.1/flavors => generated 468 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:07.251086 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:07.772793 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3ca27c2c-9148-4624-aa97-c127aa1b9a4e tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.107439 Oct 04 20:33:07.787186 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 224/440] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 4 20:33:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:07.799927 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c0ac54f6-6023-4a1b-8e85-5a27f411525f tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Calling method '.version_select at 0x7f77efe5fd30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:08.601454 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c0ac54f6-6023-4a1b-8e85-5a27f411525f tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/87822378-81d8-47c1-959b-85da18aeb15f" status: 200 len: 141 microversion: 2.1 time: 0.803734 Oct 04 20:33:08.601454 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 225/441] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:33:07 2022] GET /compute/v2.1/os-floating-ips/87822378-81d8-47c1-959b-85da18aeb15f => generated 141 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:08.621757 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-84311317-7d1e-4da2-80a4-9ceca673a6e2 tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Calling method '.version_select at 0x7f77efa6a1f0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:09.137870 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0b130877-3bca-4db2-afcf-f0e8243c7501 tempest-FlavorsV261TestJSON-1193324030 tempest-FlavorsV261TestJSON-1193324030-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:09.191582 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0b130877-3bca-4db2-afcf-f0e8243c7501 tempest-FlavorsV261TestJSON-1193324030 tempest-FlavorsV261TestJSON-1193324030-project] 10.222.0.78 "GET /compute/v2.1/flavors/1226614007" status: 200 len: 468 microversion: 2.61 time: 1.944424 Oct 04 20:33:09.219779 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 217/442] 10.222.0.78 () {60 vars in 1199 bytes} [Tue Oct 4 20:33:07 2022] GET /compute/v2.1/flavors/1226614007 => generated 468 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:09.231582 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f8c56bd0-98d4-4df4-8b24-520e09fb40a8 tempest-FlavorsV261TestJSON-1746544830 tempest-FlavorsV261TestJSON-1746544830-project-admin] Action: 'update', calling method: .version_select at 0x7f77f5029670>, body: {"flavor": {"description": "new"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:09.321873 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-84311317-7d1e-4da2-80a4-9ceca673a6e2 tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.709192 Oct 04 20:33:09.332746 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 226/443] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 4 20:33:08 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:33:09.352340 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ada5c69d-18e7-4fb7-8716-1c4c9f022f8a tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Calling method '.version_select at 0x7f77efab1700>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:09.555703 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f8c56bd0-98d4-4df4-8b24-520e09fb40a8 tempest-FlavorsV261TestJSON-1746544830 tempest-FlavorsV261TestJSON-1746544830-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/1226614007" status: 200 len: 469 microversion: 2.61 time: 0.333532 Oct 04 20:33:09.560251 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 218/444] 10.222.0.78 () {62 vars in 1219 bytes} [Tue Oct 4 20:33:09 2022] PUT /compute/v2.1/flavors/1226614007 => generated 469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:09.634396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4fa94da1-532f-41d8-b236-118b5b204480 tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Calling method '.version_select at 0x7f77ef7b1940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:11.167818 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:11.377829 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=39 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:11.719381 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ada5c69d-18e7-4fb7-8716-1c4c9f022f8a tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/92914d55af6f49398edc52da69b55cd8/defaults" status: 200 len: 371 microversion: 2.1 time: 2.384351 Oct 04 20:33:11.722060 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 227/445] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:33:09 2022] GET /compute/v2.1/os-quota-sets/92914d55af6f49398edc52da69b55cd8/defaults => generated 371 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:11.747904 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-596bc798-3423-4159-b28f-f3a5d5f4c5ab tempest-FlavorsV261TestJSON-1193324030 tempest-FlavorsV261TestJSON-1193324030-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:11.822908 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-596bc798-3423-4159-b28f-f3a5d5f4c5ab tempest-FlavorsV261TestJSON-1193324030 tempest-FlavorsV261TestJSON-1193324030-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.094367 Oct 04 20:33:11.824789 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 228/446] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 4 20:33:11 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:33:11.849491 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-154878eb-0468-4751-83a9-f0ea224b8e49 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Action: 'update', calling method: .version_select at 0x7f77efa6a280>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:12.714784 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4fa94da1-532f-41d8-b236-118b5b204480 tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/87822378-81d8-47c1-959b-85da18aeb15f" status: 202 len: 0 microversion: 2.1 time: 3.152158 Oct 04 20:33:12.718838 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 219/447] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:33:09 2022] DELETE /compute/v2.1/os-floating-ips/87822378-81d8-47c1-959b-85da18aeb15f => generated 0 bytes in 3157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:12.744389 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-923bf58e-650a-4d8d-a53d-c670f9cfcb1b tempest-FlavorsV261TestJSON-1193324030 tempest-FlavorsV261TestJSON-1193324030-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:12.833329 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-923bf58e-650a-4d8d-a53d-c670f9cfcb1b tempest-FlavorsV261TestJSON-1193324030 tempest-FlavorsV261TestJSON-1193324030-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.103922 Oct 04 20:33:12.834310 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 220/448] 10.222.0.78 () {60 vars in 1166 bytes} [Tue Oct 4 20:33:12 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:33:12.857923 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-469647fe-0ed6-427f-b683-8051d8847f3d tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Action: 'create', calling method: .version_select at 0x7f77ef6bd040>, body: {"pool": null} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:13.643092 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=9 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:13.977801 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-154878eb-0468-4751-83a9-f0ea224b8e49 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:13.978748 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-154878eb-0468-4751-83a9-f0ea224b8e49 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:13.984730 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-154878eb-0468-4751-83a9-f0ea224b8e49 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:13.986349 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-154878eb-0468-4751-83a9-f0ea224b8e49 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:13.987934 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-154878eb-0468-4751-83a9-f0ea224b8e49 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:13.992264 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-154878eb-0468-4751-83a9-f0ea224b8e49 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:14.063298 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:15.698046 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=40 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:16.368915 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-154878eb-0468-4751-83a9-f0ea224b8e49 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/92914d55af6f49398edc52da69b55cd8" status: 200 len: 329 microversion: 2.1 time: 4.537789 Oct 04 20:33:16.371962 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 229/449] 10.222.0.78 () {60 vars in 1263 bytes} [Tue Oct 4 20:33:11 2022] PUT /compute/v2.1/os-quota-sets/92914d55af6f49398edc52da69b55cd8 => generated 329 bytes in 4543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:16.384188 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-25f576e0-cea2-4abd-b998-740c4d8cc0e8 tempest-FlavorsV261TestJSON-1746544830 tempest-FlavorsV261TestJSON-1746544830-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:16.554039 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-25f576e0-cea2-4abd-b998-740c4d8cc0e8 tempest-FlavorsV261TestJSON-1746544830 tempest-FlavorsV261TestJSON-1746544830-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1226614007" status: 202 len: 0 microversion: 2.61 time: 0.179722 Oct 04 20:33:16.555736 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 230/450] 10.222.0.78 () {60 vars in 1202 bytes} [Tue Oct 4 20:33:16 2022] DELETE /compute/v2.1/flavors/1226614007 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:33:17.338453 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a297e399-5cf6-4598-847b-45cf23bbc27b tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Calling method '.version_select at 0x7f77efd31e50>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:17.338453 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a297e399-5cf6-4598-847b-45cf23bbc27b tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:17.338453 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a297e399-5cf6-4598-847b-45cf23bbc27b tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:17.338453 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a297e399-5cf6-4598-847b-45cf23bbc27b tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:17.383468 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a297e399-5cf6-4598-847b-45cf23bbc27b tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:17.384456 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a297e399-5cf6-4598-847b-45cf23bbc27b tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:17.385062 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a297e399-5cf6-4598-847b-45cf23bbc27b tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:17.423359 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a297e399-5cf6-4598-847b-45cf23bbc27b tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:17.424724 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a297e399-5cf6-4598-847b-45cf23bbc27b tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:17.426141 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a297e399-5cf6-4598-847b-45cf23bbc27b tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:17.442520 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a297e399-5cf6-4598-847b-45cf23bbc27b tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.884906 Oct 04 20:33:17.453352 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 231/451] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:16 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:17.748841 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-39717176-6cb8-4ea9-8cfe-3faf8e08f828 tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1742822830", "ram": 512, "vcpus": 1, "disk": 10, "id": 771151923, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:17.865984 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-39717176-6cb8-4ea9-8cfe-3faf8e08f828 tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.415970 Oct 04 20:33:17.873655 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 232/452] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:17 2022] POST /compute/v2.1/flavors => generated 413 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:17.903400 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b1054d78-87e2-4fb0-a7bb-d29ccab3009a tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Action: 'update', calling method: .version_select at 0x7f77efa708b0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:17.994610 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-469647fe-0ed6-427f-b683-8051d8847f3d tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.157905 Oct 04 20:33:17.995763 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 221/453] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 4 20:33:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:18.049172 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-87b2e7eb-f329-4114-8ba5-449e6f89bcc5 tempest-FlavorsV261TestJSON-1746544830 tempest-FlavorsV261TestJSON-1746544830-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:18.172396 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-87b2e7eb-f329-4114-8ba5-449e6f89bcc5 tempest-FlavorsV261TestJSON-1746544830 tempest-FlavorsV261TestJSON-1746544830-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6234 microversion: 2.61 time: 0.159481 Oct 04 20:33:18.174345 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 222/454] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 4 20:33:17 2022] GET /compute/v2.1/flavors/detail => generated 6234 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:33:18.183613 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a2540cb1-e5e1-4769-9ac9-ea2f398eb778 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Calling method '.version_select at 0x7f77ef6bdc10>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:18.187498 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a2540cb1-e5e1-4769-9ac9-ea2f398eb778 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:18.200011 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a2540cb1-e5e1-4769-9ac9-ea2f398eb778 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:18.204854 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a2540cb1-e5e1-4769-9ac9-ea2f398eb778 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:18.241035 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a2540cb1-e5e1-4769-9ac9-ea2f398eb778 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:18.242473 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a2540cb1-e5e1-4769-9ac9-ea2f398eb778 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:18.243650 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a2540cb1-e5e1-4769-9ac9-ea2f398eb778 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:18.273601 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a2540cb1-e5e1-4769-9ac9-ea2f398eb778 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:18.274502 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a2540cb1-e5e1-4769-9ac9-ea2f398eb778 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:18.283277 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a2540cb1-e5e1-4769-9ac9-ea2f398eb778 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:18.288822 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a2540cb1-e5e1-4769-9ac9-ea2f398eb778 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/n-h1-852085-12/servers" status: 200 len: 105 microversion: 2.1 time: 0.112352 Oct 04 20:33:18.290684 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 223/455] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Oct 4 20:33:18 2022] GET /compute/v2.1/os-hypervisors/n-h1-852085-12/servers => generated 105 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:18.306998 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6ad672e2-ff26-492b-8641-357df31574ad tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:18.493069 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6ad672e2-ff26-492b-8641-357df31574ad tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/771151923/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.196769 Oct 04 20:33:18.496600 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 224/456] 10.222.0.78 () {60 vars in 1221 bytes} [Tue Oct 4 20:33:18 2022] POST /compute/v2.1/flavors/771151923/os-extra_specs => generated 66 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:18.502554 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b1054d78-87e2-4fb0-a7bb-d29ccab3009a tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:18.504458 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b1054d78-87e2-4fb0-a7bb-d29ccab3009a tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:18.507693 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b1054d78-87e2-4fb0-a7bb-d29ccab3009a tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:18.510091 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b1054d78-87e2-4fb0-a7bb-d29ccab3009a tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:18.511202 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bc061136-b009-43a2-9f58-44a0449bde4e tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Calling method '.version_select at 0x7f77ef70b280>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:18.515495 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b1054d78-87e2-4fb0-a7bb-d29ccab3009a tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:18.517371 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b1054d78-87e2-4fb0-a7bb-d29ccab3009a tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:20.362980 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=23,nova_api:DELETE=3,nova_api:UPDATE=8 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:20.372296 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bc061136-b009-43a2-9f58-44a0449bde4e tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/b7fa4ff3-fe88-44dd-86aa-de17a289a36f" status: 202 len: 0 microversion: 2.1 time: 1.873756 Oct 04 20:33:20.374227 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 225/457] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:33:18 2022] DELETE /compute/v2.1/os-floating-ips/b7fa4ff3-fe88-44dd-86aa-de17a289a36f => generated 0 bytes in 1877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:20.385023 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ab439b5a-25ed-41e0-be28-311469e8a022 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Calling method '.version_select at 0x7f77ef641040>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:20.390063 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ab439b5a-25ed-41e0-be28-311469e8a022 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:20.391712 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ab439b5a-25ed-41e0-be28-311469e8a022 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:20.392762 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ab439b5a-25ed-41e0-be28-311469e8a022 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:20.421747 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ab439b5a-25ed-41e0-be28-311469e8a022 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:20.423081 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ab439b5a-25ed-41e0-be28-311469e8a022 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:20.423949 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ab439b5a-25ed-41e0-be28-311469e8a022 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:20.452898 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ab439b5a-25ed-41e0-be28-311469e8a022 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:20.453797 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ab439b5a-25ed-41e0-be28-311469e8a022 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:20.454551 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ab439b5a-25ed-41e0-be28-311469e8a022 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:20.480264 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ab439b5a-25ed-41e0-be28-311469e8a022 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.090714 Oct 04 20:33:20.480264 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 226/458] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:20 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:21.503346 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a8c4653a-1f9f-4971-b36b-5cc524dcda57 tempest-FlavorsExtraSpecsTestJSON-1346259244 tempest-FlavorsExtraSpecsTestJSON-1346259244-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:21.544537 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a8c4653a-1f9f-4971-b36b-5cc524dcda57 tempest-FlavorsExtraSpecsTestJSON-1346259244 tempest-FlavorsExtraSpecsTestJSON-1346259244-project] 10.222.0.78 "GET /compute/v2.1/flavors/771151923/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 1.066009 Oct 04 20:33:21.547314 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 227/459] 10.222.0.78 () {58 vars in 1200 bytes} [Tue Oct 4 20:33:20 2022] GET /compute/v2.1/flavors/771151923/os-extra_specs => generated 66 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:21.563664 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-08b89a09-197a-4c9a-8acd-153851400cea tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Calling method '.version_select at 0x7f77ef6188b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:21.636293 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b1054d78-87e2-4fb0-a7bb-d29ccab3009a tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/92914d55af6f49398edc52da69b55cd8" status: 200 len: 329 microversion: 2.1 time: 3.757455 Oct 04 20:33:21.640271 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 233/460] 10.222.0.78 () {60 vars in 1263 bytes} [Tue Oct 4 20:33:17 2022] PUT /compute/v2.1/os-quota-sets/92914d55af6f49398edc52da69b55cd8 => generated 329 bytes in 3763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:21.672165 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-af2d1a85-8666-42dd-81ce-661598a5aef6 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Calling method '.version_select at 0x7f77efa6ac10>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:21.680177 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-af2d1a85-8666-42dd-81ce-661598a5aef6 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:21.681699 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-af2d1a85-8666-42dd-81ce-661598a5aef6 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:21.684963 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-af2d1a85-8666-42dd-81ce-661598a5aef6 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:21.767795 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-08b89a09-197a-4c9a-8acd-153851400cea tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b7fa4ff3-fe88-44dd-86aa-de17a289a36f could not be found", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:33:21.769159 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-08b89a09-197a-4c9a-8acd-153851400cea tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] HTTP exception thrown: Floating IP not found for ID b7fa4ff3-fe88-44dd-86aa-de17a289a36f Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-08b89a09-197a-4c9a-8acd-153851400cea tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Request method failure captured: Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-floating-ips/b7fa4ff3-fe88-44dd-86aa-de17a289a36f HTTP/1.1 Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJh9wLQoNdwDoazS3ZltDcN1WhJ4MCuoqE1vXdKErhaGPkoYn2HvY4W9vvhoRgcvFgvIp4rl8jaK_rUjIAJ36w8yTUZ2WA3SBZtbdi2vObrqGH1u7oxCZRbL2PQx7d-V-KPO8w_xp3IdiZ8iXf_nviVC5cSaLJMrGpUviBNKIit_mm8 Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: d46af312da444babba7e71a9891196b0 Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-FloatingIPsTestJSON-17236728 Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:33:21.773414 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d46af312da444babba7e71a9891196b0", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d46af312da444babba7e71a9891196b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d46af312da444babba7e71a9891196b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d46af312da444babba7e71a9891196b0"}]}] Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-FloatingIPsTestJSON-17236728 Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: d46af312da444babba7e71a9891196b0 Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-FloatingIPsTestJSON-17236728 Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-FloatingIPsTestJSON-17236728-project Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 189426fe824e454384a818a7d8fdb8ff Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-FloatingIPsTestJSON-17236728-project Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: exception: Floating IP not found for ID b7fa4ff3-fe88-44dd-86aa-de17a289a36f Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'b7fa4ff3-fe88-44dd-86aa-de17a289a36f'} Oct 04 20:33:21.776448 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:33:21.778343 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b7fa4ff3-fe88-44dd-86aa-de17a289a36f could not be found Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9d15448-ab8c-4cc1-b0ea-d18702987431'] Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b7fa4ff3-fe88-44dd-86aa-de17a289a36f. Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:21.780847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b7fa4ff3-fe88-44dd-86aa-de17a289a36f Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:21.785169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:21.794335 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b7fa4ff3-fe88-44dd-86aa-de17a289a36f Oct 04 20:33:21.794335 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:33:21.796172 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-08b89a09-197a-4c9a-8acd-153851400cea tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Returning 404 to user: Floating IP not found for ID b7fa4ff3-fe88-44dd-86aa-de17a289a36f {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:21.798294 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-08b89a09-197a-4c9a-8acd-153851400cea tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/b7fa4ff3-fe88-44dd-86aa-de17a289a36f" status: 404 len: 111 microversion: 2.1 time: 0.248747 Oct 04 20:33:21.800682 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 228/461] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:33:21 2022] GET /compute/v2.1/os-floating-ips/b7fa4ff3-fe88-44dd-86aa-de17a289a36f => generated 111 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:21.812593 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-af2d1a85-8666-42dd-81ce-661598a5aef6 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:21.815968 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-af2d1a85-8666-42dd-81ce-661598a5aef6 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:21.820093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-af2d1a85-8666-42dd-81ce-661598a5aef6 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:21.830358 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5ada552c-cbc5-4e20-a739-6d64ae564ede tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:21.847768 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-af2d1a85-8666-42dd-81ce-661598a5aef6 tempest-HypervisorAdminUnderV252Test-582352521 tempest-HypervisorAdminUnderV252Test-582352521-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/n-h1-852085-12/search" status: 200 len: 105 microversion: 2.1 time: 0.205464 Oct 04 20:33:21.849787 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 234/462] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Oct 4 20:33:21 2022] GET /compute/v2.1/os-hypervisors/n-h1-852085-12/search => generated 105 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:21.870033 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2d057055-ba07-4359-bb9c-0eac5d48299f tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Calling method '.version_select at 0x7f77ef9d4e50>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:21.915759 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5ada552c-cbc5-4e20-a739-6d64ae564ede tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/771151923/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.105794 Oct 04 20:33:21.917891 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 229/463] 10.222.0.78 () {60 vars in 1221 bytes} [Tue Oct 4 20:33:21 2022] POST /compute/v2.1/flavors/771151923/os-extra_specs => generated 66 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:21.934064 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-276d6fcf-4a92-468a-9feb-658831d2b09c tempest-FlavorsExtraSpecsTestJSON-1346259244 tempest-FlavorsExtraSpecsTestJSON-1346259244-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:21.953190 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-276d6fcf-4a92-468a-9feb-658831d2b09c tempest-FlavorsExtraSpecsTestJSON-1346259244 tempest-FlavorsExtraSpecsTestJSON-1346259244-project] 10.222.0.78 "GET /compute/v2.1/flavors/771151923/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.026600 Oct 04 20:33:21.954574 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 230/464] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:33:21 2022] GET /compute/v2.1/flavors/771151923/os-extra_specs/hw:numa_nodes => generated 22 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:33:21.973103 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-18d87249-09e2-40c6-868d-efa22097f8af tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:22.014513 n-d-852085-12 devstack@n-api.service[123540]: DEBUG neutronclient.v2_0.client [None req-2d057055-ba07-4359-bb9c-0eac5d48299f tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b7fa4ff3-fe88-44dd-86aa-de17a289a36f could not be found", "detail": ""}} {{(pid=123540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:33:22.015747 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-2d057055-ba07-4359-bb9c-0eac5d48299f tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] HTTP exception thrown: Floating IP not found for ID b7fa4ff3-fe88-44dd-86aa-de17a289a36f Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2d057055-ba07-4359-bb9c-0eac5d48299f tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Request method failure captured: Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/os-floating-ips/b7fa4ff3-fe88-44dd-86aa-de17a289a36f HTTP/1.1 Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJh9wLQoNdwDoazS3ZltDcN1WhJ4MCuoqE1vXdKErhaGPkoYn2HvY4W9vvhoRgcvFgvIp4rl8jaK_rUjIAJ36w8yTUZ2WA3SBZtbdi2vObrqGH1u7oxCZRbL2PQx7d-V-KPO8w_xp3IdiZ8iXf_nviVC5cSaLJMrGpUviBNKIit_mm8 Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: d46af312da444babba7e71a9891196b0 Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FloatingIPsTestJSON-17236728 Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:33:22.020482 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d46af312da444babba7e71a9891196b0", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d46af312da444babba7e71a9891196b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d46af312da444babba7e71a9891196b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d46af312da444babba7e71a9891196b0"}]}] Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FloatingIPsTestJSON-17236728 Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: d46af312da444babba7e71a9891196b0 Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FloatingIPsTestJSON-17236728 Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FloatingIPsTestJSON-17236728-project Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 189426fe824e454384a818a7d8fdb8ff Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FloatingIPsTestJSON-17236728-project Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: exception: Floating IP not found for ID b7fa4ff3-fe88-44dd-86aa-de17a289a36f Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'b7fa4ff3-fe88-44dd-86aa-de17a289a36f'} Oct 04 20:33:22.027896 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:33:22.029910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b7fa4ff3-fe88-44dd-86aa-de17a289a36f could not be found Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da9591ae-7520-4a0c-b8e5-eb62a9ea6dc3'] Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b7fa4ff3-fe88-44dd-86aa-de17a289a36f. Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:22.033765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b7fa4ff3-fe88-44dd-86aa-de17a289a36f Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:22.040228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:22.045059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b7fa4ff3-fe88-44dd-86aa-de17a289a36f Oct 04 20:33:22.045059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:22.045059 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2d057055-ba07-4359-bb9c-0eac5d48299f tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] Returning 404 to user: Floating IP not found for ID b7fa4ff3-fe88-44dd-86aa-de17a289a36f {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:22.045059 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2d057055-ba07-4359-bb9c-0eac5d48299f tempest-FloatingIPsTestJSON-17236728 tempest-FloatingIPsTestJSON-17236728-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/b7fa4ff3-fe88-44dd-86aa-de17a289a36f" status: 404 len: 111 microversion: 2.1 time: 0.171909 Oct 04 20:33:22.045059 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 235/465] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:33:21 2022] DELETE /compute/v2.1/os-floating-ips/b7fa4ff3-fe88-44dd-86aa-de17a289a36f => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:22.061970 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-18d87249-09e2-40c6-868d-efa22097f8af tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/771151923/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.097496 Oct 04 20:33:22.065476 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 231/466] 10.222.0.78 () {60 vars in 1221 bytes} [Tue Oct 4 20:33:21 2022] POST /compute/v2.1/flavors/771151923/os-extra_specs => generated 66 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:33:22.092609 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-afe82284-26ce-45fc-9d49-39f61016a7d7 tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:22.128286 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-afe82284-26ce-45fc-9d49-39f61016a7d7 tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/771151923/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048021 Oct 04 20:33:22.130694 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 236/467] 10.222.0.78 () {58 vars in 1200 bytes} [Tue Oct 4 20:33:22 2022] GET /compute/v2.1/flavors/771151923/os-extra_specs => generated 66 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:22.147570 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9f2a0f81-30d4-4cf6-a562-f6c0d56325eb tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:22.384859 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9f2a0f81-30d4-4cf6-a562-f6c0d56325eb tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/771151923/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.239571 Oct 04 20:33:22.386052 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 232/468] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:33:22 2022] PUT /compute/v2.1/flavors/771151923/os-extra_specs/hw:numa_nodes => generated 22 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:22.403213 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7000c3ae-f030-46e4-9582-41e1a371bc00 tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:22.428700 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7000c3ae-f030-46e4-9582-41e1a371bc00 tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/771151923/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030996 Oct 04 20:33:22.432564 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 237/469] 10.222.0.78 () {58 vars in 1200 bytes} [Tue Oct 4 20:33:22 2022] GET /compute/v2.1/flavors/771151923/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:33:22.452813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7337f309-7d43-468d-a88f-548f19f9300b tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:22.508615 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:SAVEPOINT=9,nova_api:RELEASE=9 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:22.648952 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7337f309-7d43-468d-a88f-548f19f9300b tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/771151923/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.207310 Oct 04 20:33:22.661104 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 233/470] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:33:22 2022] DELETE /compute/v2.1/flavors/771151923/os-extra_specs/hw:numa_nodes => generated 0 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:33:22.665670 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b6d2c023-b744-4e7b-b215-620b80908f1a tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:22.850587 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b6d2c023-b744-4e7b-b215-620b80908f1a tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/771151923/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.192661 Oct 04 20:33:22.858793 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 238/471] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:33:22 2022] DELETE /compute/v2.1/flavors/771151923/os-extra_specs/hw:cpu_policy => generated 0 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 20:33:22.870726 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-72ad738a-85f0-44b3-b6ba-d426893b9914 tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:22.902927 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-72ad738a-85f0-44b3-b6ba-d426893b9914 tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/771151923/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.041914 Oct 04 20:33:22.905104 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 234/472] 10.222.0.78 () {58 vars in 1200 bytes} [Tue Oct 4 20:33:22 2022] GET /compute/v2.1/flavors/771151923/os-extra_specs => generated 19 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:33:22.937260 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-58e09793-1fc4-4e5f-8459-3b26152a7528 tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:23.102915 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-58e09793-1fc4-4e5f-8459-3b26152a7528 tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/771151923" status: 202 len: 0 microversion: 2.1 time: 0.170210 Oct 04 20:33:23.106273 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 239/473] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:33:22 2022] DELETE /compute/v2.1/flavors/771151923 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:33:23.121643 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4cb79c1e-a9b0-4fa9-8da9-85cebfb84ae5 tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:23.174842 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4cb79c1e-a9b0-4fa9-8da9-85cebfb84ae5 tempest-FlavorsExtraSpecsTestJSON-2123006840 tempest-FlavorsExtraSpecsTestJSON-2123006840-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061087 Oct 04 20:33:23.189540 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 235/474] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:25.812790 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-287449236", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:26.016984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:33:27.233432 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:33:27.235390 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:33:27.237043 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:33:27.238396 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:33:27.244941 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:33:27.294517 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:27.299653 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:27.301906 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:27.305362 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:27.309911 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:27.314435 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:27.424131 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Getting quotas for project 74eef3bf938c491d8a2f5192ba598c19. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:27.452697 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Getting quotas for user 4360a08eed56405b99333776285fef3a and project 74eef3bf938c491d8a2f5192ba598c19. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:27.515215 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Going to run 1 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:33:27.520025 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:33:27.896609 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-046f92fa-0fb4-4374-aabb-6093e8cc4d13 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.237660 Oct 04 20:33:27.923293 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4e8d2d81-d1fa-4430-b97b-ce551df378c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:27.924434 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4e8d2d81-d1fa-4430-b97b-ce551df378c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:27.925294 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 240/475] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:33:28.272303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4e8d2d81-d1fa-4430-b97b-ce551df378c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:28.303294 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4e8d2d81-d1fa-4430-b97b-ce551df378c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1212 microversion: 2.1 time: 0.388893 Oct 04 20:33:28.306932 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 236/476] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:27 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1212 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:29.365868 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f477da10-9d24-454f-be3a-d329dcdab61f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:29.370024 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f477da10-9d24-454f-be3a-d329dcdab61f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:29.542324 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f477da10-9d24-454f-be3a-d329dcdab61f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:29.560424 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f477da10-9d24-454f-be3a-d329dcdab61f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1212 microversion: 2.1 time: 0.218375 Oct 04 20:33:29.561476 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 241/477] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:29 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1212 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:30.618054 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-790c4f4c-b36a-4b80-b3e0-5a546d8ab18e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:30.624923 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-790c4f4c-b36a-4b80-b3e0-5a546d8ab18e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:30.668386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=12 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:30.973549 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-790c4f4c-b36a-4b80-b3e0-5a546d8ab18e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:31.000714 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-790c4f4c-b36a-4b80-b3e0-5a546d8ab18e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1212 microversion: 2.1 time: 0.395940 Oct 04 20:33:31.003033 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 237/478] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:30 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1212 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:32.053619 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c38e2120-e95c-40f3-b9c7-17ce7b12c967 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:32.065028 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c38e2120-e95c-40f3-b9c7-17ce7b12c967 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:32.389136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c38e2120-e95c-40f3-b9c7-17ce7b12c967 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:32.389136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c38e2120-e95c-40f3-b9c7-17ce7b12c967 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:32.389136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c38e2120-e95c-40f3-b9c7-17ce7b12c967 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:32.389136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c38e2120-e95c-40f3-b9c7-17ce7b12c967 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:32.391576 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c38e2120-e95c-40f3-b9c7-17ce7b12c967 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:32.391576 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c38e2120-e95c-40f3-b9c7-17ce7b12c967 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:32.391576 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c38e2120-e95c-40f3-b9c7-17ce7b12c967 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:32.393556 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c38e2120-e95c-40f3-b9c7-17ce7b12c967 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1208 microversion: 2.1 time: 0.348560 Oct 04 20:33:32.394982 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 242/479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:32 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1208 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:33.440767 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-33206720-dae5-4489-abea-5587ee0e51d3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.441863 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-33206720-dae5-4489-abea-5587ee0e51d3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:33.478754 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-33206720-dae5-4489-abea-5587ee0e51d3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:33.479845 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-33206720-dae5-4489-abea-5587ee0e51d3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:33.480628 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-33206720-dae5-4489-abea-5587ee0e51d3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:33.486302 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-33206720-dae5-4489-abea-5587ee0e51d3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:33.488103 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-33206720-dae5-4489-abea-5587ee0e51d3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:33.489053 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-33206720-dae5-4489-abea-5587ee0e51d3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:35.166685 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-33206720-dae5-4489-abea-5587ee0e51d3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:35.193857 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-33206720-dae5-4489-abea-5587ee0e51d3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1264 microversion: 2.1 time: 1.761020 Oct 04 20:33:35.228306 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 238/480] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:33 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1264 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:36.250000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f7dcb172-3cdb-469f-93b9-40341ded6f60 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:36.254527 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f7dcb172-3cdb-469f-93b9-40341ded6f60 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:36.307599 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f7dcb172-3cdb-469f-93b9-40341ded6f60 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:36.311605 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f7dcb172-3cdb-469f-93b9-40341ded6f60 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:36.316837 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f7dcb172-3cdb-469f-93b9-40341ded6f60 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:36.322972 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f7dcb172-3cdb-469f-93b9-40341ded6f60 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:36.329676 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f7dcb172-3cdb-469f-93b9-40341ded6f60 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:36.333697 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f7dcb172-3cdb-469f-93b9-40341ded6f60 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:36.702703 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f7dcb172-3cdb-469f-93b9-40341ded6f60 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:36.726792 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f7dcb172-3cdb-469f-93b9-40341ded6f60 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1270 microversion: 2.1 time: 0.486352 Oct 04 20:33:36.728685 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 243/481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:36 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1270 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:37.657389 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1619952164", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:37.779453 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1b00cb40-fb9c-4c43-a91f-c0156a48c1b1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:37.782465 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1b00cb40-fb9c-4c43-a91f-c0156a48c1b1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:37.824492 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:37.829367 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b00cb40-fb9c-4c43-a91f-c0156a48c1b1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:37.830472 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b00cb40-fb9c-4c43-a91f-c0156a48c1b1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:37.833152 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:33:37.834489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b00cb40-fb9c-4c43-a91f-c0156a48c1b1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:37.837717 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b00cb40-fb9c-4c43-a91f-c0156a48c1b1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:37.838940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b00cb40-fb9c-4c43-a91f-c0156a48c1b1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:37.840468 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b00cb40-fb9c-4c43-a91f-c0156a48c1b1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:38.088567 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1b00cb40-fb9c-4c43-a91f-c0156a48c1b1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:38.109752 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1b00cb40-fb9c-4c43-a91f-c0156a48c1b1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1270 microversion: 2.1 time: 0.339652 Oct 04 20:33:38.113774 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 244/482] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:37 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1270 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:38.855929 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:33:38.858595 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:33:38.859896 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:33:38.861122 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:33:38.863290 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:33:38.902002 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:38.903285 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:38.904601 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:38.907059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:38.909639 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:38.910994 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:38.963003 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1b00cb40-fb9c-4c43-a91f-c0156a48c1b1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:38.966531 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1b00cb40-fb9c-4c43-a91f-c0156a48c1b1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003292 Oct 04 20:33:38.969063 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 245/483] 10.222.0.78 () {56 vars in 886 bytes} [Tue Oct 4 20:33:38 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 04 20:33:38.969888 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:38.980646 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:39.015009 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:33:39.022116 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:33:39.168583 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a573c75f-b4a1-41ec-9ab2-8a4f5cc22d4c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:39.176091 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a573c75f-b4a1-41ec-9ab2-8a4f5cc22d4c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:39.206995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a573c75f-b4a1-41ec-9ab2-8a4f5cc22d4c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:39.208175 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a573c75f-b4a1-41ec-9ab2-8a4f5cc22d4c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:39.209262 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a573c75f-b4a1-41ec-9ab2-8a4f5cc22d4c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:39.211283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a573c75f-b4a1-41ec-9ab2-8a4f5cc22d4c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:39.213586 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a573c75f-b4a1-41ec-9ab2-8a4f5cc22d4c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:39.214975 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a573c75f-b4a1-41ec-9ab2-8a4f5cc22d4c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:39.344389 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6a16e454-e371-43b9-a430-3d3cd76d8a05 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.889545 Oct 04 20:33:39.345621 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 239/484] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:33:39.362289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8eb04d06-db8b-4f09-a619-1c47778ff8f6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:39.366547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8eb04d06-db8b-4f09-a619-1c47778ff8f6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:39.549668 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=76 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:39.904050 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8eb04d06-db8b-4f09-a619-1c47778ff8f6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:39.931931 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8eb04d06-db8b-4f09-a619-1c47778ff8f6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1217 microversion: 2.1 time: 0.576639 Oct 04 20:33:39.933695 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 240/485] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:39 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1217 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:40.318035 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a573c75f-b4a1-41ec-9ab2-8a4f5cc22d4c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:40.344317 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a573c75f-b4a1-41ec-9ab2-8a4f5cc22d4c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1312 microversion: 2.1 time: 1.185707 Oct 04 20:33:40.354408 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 246/486] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:39 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1312 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:40.985537 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6c05d7de-3961-41e6-b782-a643e82233cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:40.989480 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6c05d7de-3961-41e6-b782-a643e82233cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:41.242754 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6c05d7de-3961-41e6-b782-a643e82233cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:41.268100 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6c05d7de-3961-41e6-b782-a643e82233cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1217 microversion: 2.1 time: 0.295126 Oct 04 20:33:41.276855 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 241/487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:40 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1217 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:41.399126 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2312ce40-a297-4fff-93bc-a5732feab27a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:41.404906 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2312ce40-a297-4fff-93bc-a5732feab27a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:41.450696 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2312ce40-a297-4fff-93bc-a5732feab27a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:41.452988 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2312ce40-a297-4fff-93bc-a5732feab27a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:41.453820 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2312ce40-a297-4fff-93bc-a5732feab27a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:41.467676 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2312ce40-a297-4fff-93bc-a5732feab27a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:41.468617 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2312ce40-a297-4fff-93bc-a5732feab27a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:41.469395 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2312ce40-a297-4fff-93bc-a5732feab27a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.126401 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-2312ce40-a297-4fff-93bc-a5732feab27a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:42.133061 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=45 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:42.162464 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2312ce40-a297-4fff-93bc-a5732feab27a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1312 microversion: 2.1 time: 0.773548 Oct 04 20:33:42.168754 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 247/488] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:41 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1312 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:42.330274 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-323637b5-4879-41c5-8bc0-b0f1fa676e80 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:42.331592 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-323637b5-4879-41c5-8bc0-b0f1fa676e80 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:42.401511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-323637b5-4879-41c5-8bc0-b0f1fa676e80 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:42.401511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-323637b5-4879-41c5-8bc0-b0f1fa676e80 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:42.401511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-323637b5-4879-41c5-8bc0-b0f1fa676e80 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.401511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-323637b5-4879-41c5-8bc0-b0f1fa676e80 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:42.407991 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-323637b5-4879-41c5-8bc0-b0f1fa676e80 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:42.415175 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-323637b5-4879-41c5-8bc0-b0f1fa676e80 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.595320 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-323637b5-4879-41c5-8bc0-b0f1fa676e80 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:42.631797 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-323637b5-4879-41c5-8bc0-b0f1fa676e80 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1221 microversion: 2.1 time: 0.292647 Oct 04 20:33:42.632884 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 242/489] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:42 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1221 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:42.753270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-4eeba3cf-1603-44ce-acdf-c61fce80d60f req-5fe2d9fd-7fd9-4641-af70-095cb558093c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb3a6b7-921f-41d4-a55e-0686a4dc7189", "tag": "26cc88b4-8d45-445d-8a36-b340685405f4"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:42.794064 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-4eeba3cf-1603-44ce-acdf-c61fce80d60f req-5fe2d9fd-7fd9-4641-af70-095cb558093c service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:42.797144 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-4eeba3cf-1603-44ce-acdf-c61fce80d60f req-5fe2d9fd-7fd9-4641-af70-095cb558093c service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:42.801805 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-4eeba3cf-1603-44ce-acdf-c61fce80d60f req-5fe2d9fd-7fd9-4641-af70-095cb558093c service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.832636 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-4eeba3cf-1603-44ce-acdf-c61fce80d60f req-5fe2d9fd-7fd9-4641-af70-095cb558093c service nova] Creating event network-changed:26cc88b4-8d45-445d-8a36-b340685405f4 for instance bdb3a6b7-921f-41d4-a55e-0686a4dc7189 on n-h1-852085-12 Oct 04 20:33:42.844543 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-4eeba3cf-1603-44ce-acdf-c61fce80d60f req-5fe2d9fd-7fd9-4641-af70-095cb558093c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103145 Oct 04 20:33:42.845966 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 248/490] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:43.209832 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5c0af6a8-29f2-4bc4-8264-5bbd47402d36 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:43.212451 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-5c0af6a8-29f2-4bc4-8264-5bbd47402d36 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:43.233624 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5c0af6a8-29f2-4bc4-8264-5bbd47402d36 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:43.239027 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5c0af6a8-29f2-4bc4-8264-5bbd47402d36 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:43.243489 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5c0af6a8-29f2-4bc4-8264-5bbd47402d36 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:43.252187 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5c0af6a8-29f2-4bc4-8264-5bbd47402d36 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:43.253547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5c0af6a8-29f2-4bc4-8264-5bbd47402d36 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:43.254729 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5c0af6a8-29f2-4bc4-8264-5bbd47402d36 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:43.700047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1758f44c-9459-4e68-8c3b-7fb21550a0d1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:43.702600 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1758f44c-9459-4e68-8c3b-7fb21550a0d1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:43.732109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1758f44c-9459-4e68-8c3b-7fb21550a0d1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:43.733573 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1758f44c-9459-4e68-8c3b-7fb21550a0d1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:43.738128 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1758f44c-9459-4e68-8c3b-7fb21550a0d1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:43.740057 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1758f44c-9459-4e68-8c3b-7fb21550a0d1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:43.747045 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1758f44c-9459-4e68-8c3b-7fb21550a0d1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:43.748113 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1758f44c-9459-4e68-8c3b-7fb21550a0d1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:44.086791 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1758f44c-9459-4e68-8c3b-7fb21550a0d1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:44.122839 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1758f44c-9459-4e68-8c3b-7fb21550a0d1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1269 microversion: 2.1 time: 0.441945 Oct 04 20:33:44.145884 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 249/491] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:43 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1269 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:44.237367 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5c0af6a8-29f2-4bc4-8264-5bbd47402d36 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:44.265066 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5c0af6a8-29f2-4bc4-8264-5bbd47402d36 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1312 microversion: 2.1 time: 1.062934 Oct 04 20:33:44.283178 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 243/492] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:43 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1312 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:45.182498 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-671f8da3-e96c-4337-a7ec-c23b0f92f673 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:45.183842 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-671f8da3-e96c-4337-a7ec-c23b0f92f673 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:45.211452 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-671f8da3-e96c-4337-a7ec-c23b0f92f673 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:45.212489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-671f8da3-e96c-4337-a7ec-c23b0f92f673 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:45.213296 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-671f8da3-e96c-4337-a7ec-c23b0f92f673 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:45.217395 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-671f8da3-e96c-4337-a7ec-c23b0f92f673 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:45.222197 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-671f8da3-e96c-4337-a7ec-c23b0f92f673 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:45.223403 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-671f8da3-e96c-4337-a7ec-c23b0f92f673 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:45.318005 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-97b6ea5c-7c0a-48ea-a125-664d6538c959 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:45.324404 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-97b6ea5c-7c0a-48ea-a125-664d6538c959 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:45.354200 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97b6ea5c-7c0a-48ea-a125-664d6538c959 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:45.355986 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97b6ea5c-7c0a-48ea-a125-664d6538c959 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:45.358473 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97b6ea5c-7c0a-48ea-a125-664d6538c959 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:45.361217 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97b6ea5c-7c0a-48ea-a125-664d6538c959 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:45.362869 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97b6ea5c-7c0a-48ea-a125-664d6538c959 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:45.364557 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97b6ea5c-7c0a-48ea-a125-664d6538c959 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:45.758281 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-671f8da3-e96c-4337-a7ec-c23b0f92f673 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:45.783184 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-671f8da3-e96c-4337-a7ec-c23b0f92f673 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1269 microversion: 2.1 time: 0.610760 Oct 04 20:33:45.795393 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 250/493] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:45 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1269 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:46.117730 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-97b6ea5c-7c0a-48ea-a125-664d6538c959 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:46.169464 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-97b6ea5c-7c0a-48ea-a125-664d6538c959 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1312 microversion: 2.1 time: 0.858708 Oct 04 20:33:46.174022 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 244/494] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:45 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1312 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:46.853750 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4e5ffa14-7220-4659-aad7-f1ef23053061 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:46.857274 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4e5ffa14-7220-4659-aad7-f1ef23053061 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:46.873001 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e5ffa14-7220-4659-aad7-f1ef23053061 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:46.874317 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e5ffa14-7220-4659-aad7-f1ef23053061 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:46.876335 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e5ffa14-7220-4659-aad7-f1ef23053061 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:46.877771 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e5ffa14-7220-4659-aad7-f1ef23053061 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:46.878303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e5ffa14-7220-4659-aad7-f1ef23053061 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:46.879021 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e5ffa14-7220-4659-aad7-f1ef23053061 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:47.103814 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4e5ffa14-7220-4659-aad7-f1ef23053061 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:47.137524 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4e5ffa14-7220-4659-aad7-f1ef23053061 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1275 microversion: 2.1 time: 0.291220 Oct 04 20:33:47.151707 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 245/495] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:46 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1275 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:47.218712 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a299e195-19a9-466b-bacd-4c4c078e2046 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:47.220233 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a299e195-19a9-466b-bacd-4c4c078e2046 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:47.233786 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a299e195-19a9-466b-bacd-4c4c078e2046 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:47.235190 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a299e195-19a9-466b-bacd-4c4c078e2046 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:47.235988 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a299e195-19a9-466b-bacd-4c4c078e2046 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:47.237714 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a299e195-19a9-466b-bacd-4c4c078e2046 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:47.239179 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a299e195-19a9-466b-bacd-4c4c078e2046 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:47.240319 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a299e195-19a9-466b-bacd-4c4c078e2046 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:47.766095 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a299e195-19a9-466b-bacd-4c4c078e2046 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:47.803594 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a299e195-19a9-466b-bacd-4c4c078e2046 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1312 microversion: 2.1 time: 0.592222 Oct 04 20:33:47.828846 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 246/496] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:47 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1312 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:48.163062 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-660e505c-326c-4be4-8b78-a1ec12aa9187 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-917664175", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "5a968067-4034-47ae-963a-b80f9544a870"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:48.183069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1c8b336f-e0c1-4c60-be64-73acf4c0653a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:48.189830 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-1c8b336f-e0c1-4c60-be64-73acf4c0653a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:48.234711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c8b336f-e0c1-4c60-be64-73acf4c0653a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:48.236462 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c8b336f-e0c1-4c60-be64-73acf4c0653a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:48.237288 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c8b336f-e0c1-4c60-be64-73acf4c0653a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:48.238827 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c8b336f-e0c1-4c60-be64-73acf4c0653a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:48.239731 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c8b336f-e0c1-4c60-be64-73acf4c0653a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:48.240729 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c8b336f-e0c1-4c60-be64-73acf4c0653a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:48.376498 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-660e505c-326c-4be4-8b78-a1ec12aa9187 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] validate_networks() for [('5a968067-4034-47ae-963a-b80f9544a870', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:33:48.534431 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-1c8b336f-e0c1-4c60-be64-73acf4c0653a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:48.562113 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1c8b336f-e0c1-4c60-be64-73acf4c0653a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1275 microversion: 2.1 time: 0.388616 Oct 04 20:33:48.585086 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 247/497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:48 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1275 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:48.867880 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-41495798-4113-4e19-8c73-4d848222c295 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:48.870212 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-41495798-4113-4e19-8c73-4d848222c295 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:48.889350 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-41495798-4113-4e19-8c73-4d848222c295 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:48.892160 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-41495798-4113-4e19-8c73-4d848222c295 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:48.894507 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-41495798-4113-4e19-8c73-4d848222c295 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:48.896465 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-41495798-4113-4e19-8c73-4d848222c295 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:48.898572 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-41495798-4113-4e19-8c73-4d848222c295 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:48.899936 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-41495798-4113-4e19-8c73-4d848222c295 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:48.956787 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-660e505c-326c-4be4-8b78-a1ec12aa9187 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fc955696-a075-4e0f-8e0b-147aba61af5a) Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:33:49.238927 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:49.242029 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:33:49.246035 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:33:49.253015 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:33:49.254721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fc955696-a075-4e0f-8e0b-147aba61af5a) Oct 04 20:33:49.254721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:49.254721 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-660e505c-326c-4be4-8b78-a1ec12aa9187 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:33:49.254721 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-660e505c-326c-4be4-8b78-a1ec12aa9187 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Request method failure captured: Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 215 Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJiOcGPqUAbnkDjAg_GhinWcah-rx0Vl-q-M0tIygmaRKI62opXYulC1e7x1_4avsIhRzdEky_hF7SXdT5V4zlgd-pOekF9orc8vR9Ot2udgiIVUc6d4uobcXJ5bhvMcO7w3nPEgIDk0ONj7Z0MTGS9QX6SE3ASdFMLDpSRKpLvyINA Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: cf616fd82dd34c7d92f4d8e9e80f89f4 Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1439487668 Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:33:49.266427 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:33:49.268058 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cf616fd82dd34c7d92f4d8e9e80f89f4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf616fd82dd34c7d92f4d8e9e80f89f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf616fd82dd34c7d92f4d8e9e80f89f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cf616fd82dd34c7d92f4d8e9e80f89f4"}]}] Oct 04 20:33:49.268058 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1439487668 Oct 04 20:33:49.268058 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: cf616fd82dd34c7d92f4d8e9e80f89f4 Oct 04 20:33:49.268058 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1439487668 Oct 04 20:33:49.268058 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-LiveAutoBlockMigrationV225Test-1439487668-project Oct 04 20:33:49.268058 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:33:49.268058 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:33:49.268058 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 6a310d2bd16e4d52841042364253a86b Oct 04 20:33:49.268058 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1439487668-project Oct 04 20:33:49.268058 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:33:49.268058 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-917664175", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "5a968067-4034-47ae-963a-b80f9544a870"}]}} Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-917664175', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '5a968067-4034-47ae-963a-b80f9544a870'}]}}} Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:33:49.268840 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:49.270063 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:33:49.271101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:33:49.273996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fc955696-a075-4e0f-8e0b-147aba61af5a) Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:49.275750 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:49.278601 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:49.278601 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:49.278601 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:33:49.278601 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:49.278601 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:49.278601 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-660e505c-326c-4be4-8b78-a1ec12aa9187 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:33:49.278601 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:49.278601 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-660e505c-326c-4be4-8b78-a1ec12aa9187 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 2.457026 Oct 04 20:33:49.281839 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 251/498] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:33:46 2022] POST /compute/v2.1/servers => generated 214 bytes in 2468 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 04 20:33:49.333030 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-41495798-4113-4e19-8c73-4d848222c295 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:49.369317 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-41495798-4113-4e19-8c73-4d848222c295 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1312 microversion: 2.1 time: 0.508282 Oct 04 20:33:49.376501 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 248/499] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:48 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1312 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:49.829723 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-662289370", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:49.937476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8c2770c6-39b6-44af-8849-26e33169cb2b tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Calling method '.version_select at 0x7f77efa70940>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:49.953548 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c2770c6-39b6-44af-8849-26e33169cb2b tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:49.954223 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c2770c6-39b6-44af-8849-26e33169cb2b tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:49.955099 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c2770c6-39b6-44af-8849-26e33169cb2b tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:49.986692 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:33:50.045030 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c2770c6-39b6-44af-8849-26e33169cb2b tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.048903 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c2770c6-39b6-44af-8849-26e33169cb2b tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.050180 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c2770c6-39b6-44af-8849-26e33169cb2b tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:50.088180 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c2770c6-39b6-44af-8849-26e33169cb2b tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.089124 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c2770c6-39b6-44af-8849-26e33169cb2b tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.089900 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c2770c6-39b6-44af-8849-26e33169cb2b tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:50.104632 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8c2770c6-39b6-44af-8849-26e33169cb2b tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.822010 Oct 04 20:33:50.107167 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 252/500] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 4 20:33:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:50.139651 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f9828cac-821f-426e-a099-49350aff1492 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:50.141618 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f9828cac-821f-426e-a099-49350aff1492 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:50.159513 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f9828cac-821f-426e-a099-49350aff1492 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.161195 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f9828cac-821f-426e-a099-49350aff1492 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.162324 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f9828cac-821f-426e-a099-49350aff1492 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:50.164186 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f9828cac-821f-426e-a099-49350aff1492 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.165351 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f9828cac-821f-426e-a099-49350aff1492 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.166368 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f9828cac-821f-426e-a099-49350aff1492 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:50.680519 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:33:50.681272 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:33:50.682298 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:33:50.686902 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:33:50.690894 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:33:50.722703 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f9828cac-821f-426e-a099-49350aff1492 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:50.735556 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.736841 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.738263 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:50.740226 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.741458 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.742705 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:50.747191 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f9828cac-821f-426e-a099-49350aff1492 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1317 microversion: 2.1 time: 0.619665 Oct 04 20:33:50.751869 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 253/501] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:50 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:50.761886 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-34689d69-eeae-4aa7-b675-2eaa06a744a7 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-898751297", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "5a968067-4034-47ae-963a-b80f9544a870"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:50.805353 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Getting quotas for project 7e024c248dfa402e9aa19677dd749c9f. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:50.823885 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Getting quotas for user 7caebe70d8da45aebdeeae629801512c and project 7e024c248dfa402e9aa19677dd749c9f. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:50.855005 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:33:50.861256 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:33:50.919967 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-34689d69-eeae-4aa7-b675-2eaa06a744a7 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] validate_networks() for [('5a968067-4034-47ae-963a-b80f9544a870', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:33:51.227076 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-56d3c327-a12e-4f30-a8d1-ffea0e0ac040 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.847778 Oct 04 20:33:51.236277 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 249/502] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:33:51.302920 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2b62dab8-1074-484d-8e87-1f7d045632c6 tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Calling method '.version_select at 0x7f77ef79faf0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:51.302920 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b62dab8-1074-484d-8e87-1f7d045632c6 tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:51.302920 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b62dab8-1074-484d-8e87-1f7d045632c6 tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:51.302920 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b62dab8-1074-484d-8e87-1f7d045632c6 tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:51.388516 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b62dab8-1074-484d-8e87-1f7d045632c6 tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:51.403567 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b62dab8-1074-484d-8e87-1f7d045632c6 tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:51.404815 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b62dab8-1074-484d-8e87-1f7d045632c6 tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:51.437913 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2b62dab8-1074-484d-8e87-1f7d045632c6 tempest-HypervisorAdminV228Test-1099547737 tempest-HypervisorAdminV228Test-1099547737-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.199659 Oct 04 20:33:51.446035 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 250/503] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 4 20:33:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:51.464675 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cfe2e1da-d177-4113-b19e-3bf25364452e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:51.465668 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cfe2e1da-d177-4113-b19e-3bf25364452e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:51.492534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cfe2e1da-d177-4113-b19e-3bf25364452e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:51.493307 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cfe2e1da-d177-4113-b19e-3bf25364452e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:51.496996 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cfe2e1da-d177-4113-b19e-3bf25364452e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:51.498426 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cfe2e1da-d177-4113-b19e-3bf25364452e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:51.499319 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cfe2e1da-d177-4113-b19e-3bf25364452e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:51.500098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cfe2e1da-d177-4113-b19e-3bf25364452e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:51.943547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-cfe2e1da-d177-4113-b19e-3bf25364452e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:51.987991 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cfe2e1da-d177-4113-b19e-3bf25364452e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1312 microversion: 2.1 time: 0.539006 Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-34689d69-eeae-4aa7-b675-2eaa06a744a7 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-270d845b-45e5-46f0-9168-4cbe4de7ff29) Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:33:52.001752 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:52.004551 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:33:52.006697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:33:52.012581 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:33:52.014205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-270d845b-45e5-46f0-9168-4cbe4de7ff29) Oct 04 20:33:52.014205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:52.014205 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-34689d69-eeae-4aa7-b675-2eaa06a744a7 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:33:52.014205 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-34689d69-eeae-4aa7-b675-2eaa06a744a7 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Request method failure captured: Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 215 Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJiOcGPqUAbnkDjAg_GhinWcah-rx0Vl-q-M0tIygmaRKI62opXYulC1e7x1_4avsIhRzdEky_hF7SXdT5V4zlgd-pOekF9orc8vR9Ot2udgiIVUc6d4uobcXJ5bhvMcO7w3nPEgIDk0ONj7Z0MTGS9QX6SE3ASdFMLDpSRKpLvyINA Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: cf616fd82dd34c7d92f4d8e9e80f89f4 Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1439487668 Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:33:52.047713 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:33:52.050485 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cf616fd82dd34c7d92f4d8e9e80f89f4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf616fd82dd34c7d92f4d8e9e80f89f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf616fd82dd34c7d92f4d8e9e80f89f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cf616fd82dd34c7d92f4d8e9e80f89f4"}]}] Oct 04 20:33:52.050485 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1439487668 Oct 04 20:33:52.050485 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: cf616fd82dd34c7d92f4d8e9e80f89f4 Oct 04 20:33:52.050485 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1439487668 Oct 04 20:33:52.050485 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-LiveAutoBlockMigrationV225Test-1439487668-project Oct 04 20:33:52.050485 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:33:52.050485 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:33:52.050485 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 6a310d2bd16e4d52841042364253a86b Oct 04 20:33:52.050485 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1439487668-project Oct 04 20:33:52.050485 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:33:52.050485 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-898751297", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "5a968067-4034-47ae-963a-b80f9544a870"}]}} Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-898751297', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '5a968067-4034-47ae-963a-b80f9544a870'}]}}} Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:33:52.051849 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:52.055022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:33:52.057179 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:33:52.059422 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-270d845b-45e5-46f0-9168-4cbe4de7ff29) Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:52.071682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:52.075211 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:52.075211 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:52.075211 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:33:52.075211 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:52.075211 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:33:52.075211 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-34689d69-eeae-4aa7-b675-2eaa06a744a7 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:33:52.075211 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:52.075211 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-34689d69-eeae-4aa7-b675-2eaa06a744a7 tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 1.310877 Oct 04 20:33:52.076547 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 251/504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:51 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1312 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:52.088884 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 254/505] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:33:50 2022] POST /compute/v2.1/servers => generated 214 bytes in 1335 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 04 20:33:52.117719 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e7564731-63d7-4304-b923-ad469d47cc35 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:52.120683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e7564731-63d7-4304-b923-ad469d47cc35 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:52.269959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e7564731-63d7-4304-b923-ad469d47cc35 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:52.306322 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e7564731-63d7-4304-b923-ad469d47cc35 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1221 microversion: 2.1 time: 0.211835 Oct 04 20:33:52.309052 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 255/506] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:52 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1221 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:52.337180 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0c609bd1-2d8f-43ba-a377-983af6a6070a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:52.338612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0c609bd1-2d8f-43ba-a377-983af6a6070a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:52.378835 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0c609bd1-2d8f-43ba-a377-983af6a6070a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:52.381427 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0c609bd1-2d8f-43ba-a377-983af6a6070a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:52.387859 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0c609bd1-2d8f-43ba-a377-983af6a6070a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:52.390365 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0c609bd1-2d8f-43ba-a377-983af6a6070a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:52.392027 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0c609bd1-2d8f-43ba-a377-983af6a6070a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:52.393768 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0c609bd1-2d8f-43ba-a377-983af6a6070a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:53.089616 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0c609bd1-2d8f-43ba-a377-983af6a6070a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:53.136681 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0c609bd1-2d8f-43ba-a377-983af6a6070a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1317 microversion: 2.1 time: 0.824706 Oct 04 20:33:53.159180 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 256/507] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:52 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1317 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:53.194653 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d36ffe1d-6f4d-445b-91d2-155fbed4232b tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Action: 'create', calling method: .version_select at 0x7f77efa703a0>, body: {"keypair": {"name": "tempest-keypair-1058594534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSTZPkItRcx6tDqfoipq4p2DSRjVh9FKBXCFxEMsNfVVAfeMJfVIXhC/3EEtPDPWzjq9jiYL/W0sCuJzLb8S3MZHDpCMWoIWajYICGpe9iX7T3UNXh56D3chqA+Lk1SWg=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:53.198219 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-caad737b-230f-4b4d-8a54-fc0ab7625a97 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef618c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:53.235871 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=80,nova_api:UPDATE=6,nova_api:DELETE=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:53.259240 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-d36ffe1d-6f4d-445b-91d2-155fbed4232b tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Getting quotas for project cf616fd82dd34c7d92f4d8e9e80f89f4. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:53.291169 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-d36ffe1d-6f4d-445b-91d2-155fbed4232b tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Getting quotas for user 6a310d2bd16e4d52841042364253a86b and project cf616fd82dd34c7d92f4d8e9e80f89f4. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:53.463997 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d36ffe1d-6f4d-445b-91d2-155fbed4232b tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.314102 Oct 04 20:33:53.465160 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 257/508] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 4 20:33:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 317 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:33:53.497893 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1bbd2857-049a-4930-976d-fb5b8413d4ea tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:53.499084 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1bbd2857-049a-4930-976d-fb5b8413d4ea tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:53.553133 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1bbd2857-049a-4930-976d-fb5b8413d4ea tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:53.553133 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1bbd2857-049a-4930-976d-fb5b8413d4ea tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:53.553133 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1bbd2857-049a-4930-976d-fb5b8413d4ea tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:53.556503 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1bbd2857-049a-4930-976d-fb5b8413d4ea tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:53.557405 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1bbd2857-049a-4930-976d-fb5b8413d4ea tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:53.562430 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1bbd2857-049a-4930-976d-fb5b8413d4ea tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:53.636999 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-caad737b-230f-4b4d-8a54-fc0ab7625a97 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:53.637852 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-caad737b-230f-4b4d-8a54-fc0ab7625a97 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:53.654852 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-caad737b-230f-4b4d-8a54-fc0ab7625a97 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:53.669451 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-caad737b-230f-4b4d-8a54-fc0ab7625a97 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:53.670485 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-caad737b-230f-4b4d-8a54-fc0ab7625a97 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:53.671667 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-caad737b-230f-4b4d-8a54-fc0ab7625a97 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:54.041575 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-caad737b-230f-4b4d-8a54-fc0ab7625a97 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/918e21966ac14f409e5c6c6e45e50df4" status: 200 len: 148 microversion: 2.57 time: 1.972671 Oct 04 20:33:54.054050 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 252/509] 10.222.0.78 () {62 vars in 1303 bytes} [Tue Oct 4 20:33:52 2022] PUT /compute/v2.1/os-quota-sets/918e21966ac14f409e5c6c6e45e50df4 => generated 148 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:54.068721 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-70e80e0e-f585-4cc3-a4f7-c01405ef5bad tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:54.072275 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-70e80e0e-f585-4cc3-a4f7-c01405ef5bad tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:54.455092 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-70e80e0e-f585-4cc3-a4f7-c01405ef5bad tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:54.517499 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-70e80e0e-f585-4cc3-a4f7-c01405ef5bad tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1221 microversion: 2.1 time: 0.452648 Oct 04 20:33:54.522029 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 253/510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:54 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1221 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:54.556868 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2dd0f1eb-623d-4138-975b-e112af05f5f1 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Calling method '.version_select at 0x7f77ef66e700>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:54.669026 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1bbd2857-049a-4930-976d-fb5b8413d4ea tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:54.699803 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1bbd2857-049a-4930-976d-fb5b8413d4ea tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1312 microversion: 2.1 time: 1.232308 Oct 04 20:33:54.712880 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 258/511] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:53 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1312 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:54.752629 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-92e5db62-c010-4070-b1b3-a7493c0cad1d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:54.760729 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-92e5db62-c010-4070-b1b3-a7493c0cad1d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:54.797128 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92e5db62-c010-4070-b1b3-a7493c0cad1d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:54.805226 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92e5db62-c010-4070-b1b3-a7493c0cad1d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:54.806010 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92e5db62-c010-4070-b1b3-a7493c0cad1d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:54.809091 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92e5db62-c010-4070-b1b3-a7493c0cad1d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:54.810506 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92e5db62-c010-4070-b1b3-a7493c0cad1d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:54.815745 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92e5db62-c010-4070-b1b3-a7493c0cad1d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:55.391834 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-92e5db62-c010-4070-b1b3-a7493c0cad1d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:55.417326 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-92e5db62-c010-4070-b1b3-a7493c0cad1d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1317 microversion: 2.1 time: 0.695633 Oct 04 20:33:55.420570 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 259/512] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:54 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1317 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:55.461793 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-4c766950-e2f7-4647-907d-71042e588001 req-29e3752e-3609-4bf1-9949-882b444ac63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c29121-e094-4132-8ef4-b4c28da9df8a", "tag": "978b2a22-cd30-468a-af9b-1b86275c1460"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:55.517989 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-4c766950-e2f7-4647-907d-71042e588001 req-29e3752e-3609-4bf1-9949-882b444ac63a service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:55.519482 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-4c766950-e2f7-4647-907d-71042e588001 req-29e3752e-3609-4bf1-9949-882b444ac63a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:55.524158 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-4c766950-e2f7-4647-907d-71042e588001 req-29e3752e-3609-4bf1-9949-882b444ac63a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:55.574461 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-4c766950-e2f7-4647-907d-71042e588001 req-29e3752e-3609-4bf1-9949-882b444ac63a service nova] Creating event network-changed:978b2a22-cd30-468a-af9b-1b86275c1460 for instance 50c29121-e094-4132-8ef4-b4c28da9df8a on n-h2-852085-12 Oct 04 20:33:55.599752 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-4c766950-e2f7-4647-907d-71042e588001 req-29e3752e-3609-4bf1-9949-882b444ac63a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175606 Oct 04 20:33:55.601640 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 260/513] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:55.620417 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2dd0f1eb-623d-4138-975b-e112af05f5f1 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:55.623368 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2dd0f1eb-623d-4138-975b-e112af05f5f1 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:55.624997 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2dd0f1eb-623d-4138-975b-e112af05f5f1 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:55.627251 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2dd0f1eb-623d-4138-975b-e112af05f5f1 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:55.627770 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f83dcaa2-2e48-4290-9793-8e785332f22a tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:55.629029 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f83dcaa2-2e48-4290-9793-8e785332f22a tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:55.633347 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2dd0f1eb-623d-4138-975b-e112af05f5f1 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:55.634807 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2dd0f1eb-623d-4138-975b-e112af05f5f1 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:55.658267 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f83dcaa2-2e48-4290-9793-8e785332f22a tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:55.659898 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f83dcaa2-2e48-4290-9793-8e785332f22a tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:55.661141 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f83dcaa2-2e48-4290-9793-8e785332f22a tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:55.663669 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f83dcaa2-2e48-4290-9793-8e785332f22a tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:55.665778 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f83dcaa2-2e48-4290-9793-8e785332f22a tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:55.667325 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f83dcaa2-2e48-4290-9793-8e785332f22a tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:55.744855 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:55.753555 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2dd0f1eb-623d-4138-975b-e112af05f5f1 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/918e21966ac14f409e5c6c6e45e50df4/detail" status: 200 len: 463 microversion: 2.57 time: 1.224893 Oct 04 20:33:55.769697 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 254/514] 10.222.0.78 () {60 vars in 1304 bytes} [Tue Oct 4 20:33:54 2022] GET /compute/v2.1/os-quota-sets/918e21966ac14f409e5c6c6e45e50df4/detail => generated 463 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:55.787656 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-42320beb-f3a5-47ae-a8c2-19d3ba0b3838 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:55.791414 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-42320beb-f3a5-47ae-a8c2-19d3ba0b3838 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:55.819800 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-42320beb-f3a5-47ae-a8c2-19d3ba0b3838 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:55.822902 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-42320beb-f3a5-47ae-a8c2-19d3ba0b3838 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:55.824326 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-42320beb-f3a5-47ae-a8c2-19d3ba0b3838 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:55.826537 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-42320beb-f3a5-47ae-a8c2-19d3ba0b3838 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:55.827780 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-42320beb-f3a5-47ae-a8c2-19d3ba0b3838 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:55.828840 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-42320beb-f3a5-47ae-a8c2-19d3ba0b3838 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:56.082242 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f83dcaa2-2e48-4290-9793-8e785332f22a tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:56.126494 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f83dcaa2-2e48-4290-9793-8e785332f22a tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1217 microversion: 2.1 time: 0.518013 Oct 04 20:33:56.127630 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 261/515] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:55 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1217 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:56.468616 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f908ced1-bda3-4e3e-8de9-bdc0d8a51ea7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:56.469790 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f908ced1-bda3-4e3e-8de9-bdc0d8a51ea7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:56.514030 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f908ced1-bda3-4e3e-8de9-bdc0d8a51ea7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:56.520579 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f908ced1-bda3-4e3e-8de9-bdc0d8a51ea7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:56.525994 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f908ced1-bda3-4e3e-8de9-bdc0d8a51ea7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:56.529310 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f908ced1-bda3-4e3e-8de9-bdc0d8a51ea7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:56.530924 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f908ced1-bda3-4e3e-8de9-bdc0d8a51ea7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:56.532298 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f908ced1-bda3-4e3e-8de9-bdc0d8a51ea7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:56.605151 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-42320beb-f3a5-47ae-a8c2-19d3ba0b3838 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:56.691694 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-42320beb-f3a5-47ae-a8c2-19d3ba0b3838 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1312 microversion: 2.1 time: 0.905279 Oct 04 20:33:56.704176 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 255/516] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:55 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1312 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:56.759523 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef614d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:57.248584 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f908ced1-bda3-4e3e-8de9-bdc0d8a51ea7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:57.290135 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f908ced1-bda3-4e3e-8de9-bdc0d8a51ea7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1317 microversion: 2.1 time: 0.829579 Oct 04 20:33:57.309514 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 262/517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:56 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1317 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:57.337399 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-09eba32d-6691-4910-a83b-3706aa0fa12b req-d679dce5-4abe-42cc-9c7a-cc5ffc27f215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb3a6b7-921f-41d4-a55e-0686a4dc7189", "name": "network-vif-plugged", "status": "completed", "tag": "26cc88b4-8d45-445d-8a36-b340685405f4"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:57.370754 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-09eba32d-6691-4910-a83b-3706aa0fa12b req-d679dce5-4abe-42cc-9c7a-cc5ffc27f215 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.372272 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-09eba32d-6691-4910-a83b-3706aa0fa12b req-d679dce5-4abe-42cc-9c7a-cc5ffc27f215 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.373536 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-09eba32d-6691-4910-a83b-3706aa0fa12b req-d679dce5-4abe-42cc-9c7a-cc5ffc27f215 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.434217 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-09eba32d-6691-4910-a83b-3706aa0fa12b req-d679dce5-4abe-42cc-9c7a-cc5ffc27f215 service nova] Creating event network-vif-plugged:26cc88b4-8d45-445d-8a36-b340685405f4 for instance bdb3a6b7-921f-41d4-a55e-0686a4dc7189 on n-h1-852085-12 Oct 04 20:33:57.451656 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-09eba32d-6691-4910-a83b-3706aa0fa12b req-d679dce5-4abe-42cc-9c7a-cc5ffc27f215 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125175 Oct 04 20:33:57.452979 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 263/518] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:57.475187 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-516ac427-6011-494e-b175-7487eb5ff56b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:57.479585 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-516ac427-6011-494e-b175-7487eb5ff56b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:57.498654 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-516ac427-6011-494e-b175-7487eb5ff56b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.501062 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-516ac427-6011-494e-b175-7487eb5ff56b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.515708 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-516ac427-6011-494e-b175-7487eb5ff56b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.518603 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-516ac427-6011-494e-b175-7487eb5ff56b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.521928 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-516ac427-6011-494e-b175-7487eb5ff56b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.523224 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-516ac427-6011-494e-b175-7487eb5ff56b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.687787 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.690756 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.700818 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.704477 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.711987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.714586 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.787993 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-516ac427-6011-494e-b175-7487eb5ff56b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:57.814265 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-516ac427-6011-494e-b175-7487eb5ff56b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1273 microversion: 2.1 time: 0.358409 Oct 04 20:33:57.815921 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 264/519] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:57 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1273 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:57.882061 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c7e000ec-bc80-4878-888a-fa7db5c970a8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:57.891615 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c7e000ec-bc80-4878-888a-fa7db5c970a8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:57.907756 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.908794 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.909547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.912579 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.914798 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.918007 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.920305 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c7e000ec-bc80-4878-888a-fa7db5c970a8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.924354 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c7e000ec-bc80-4878-888a-fa7db5c970a8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.925809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c7e000ec-bc80-4878-888a-fa7db5c970a8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.930551 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c7e000ec-bc80-4878-888a-fa7db5c970a8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.936597 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c7e000ec-bc80-4878-888a-fa7db5c970a8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.936597 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c7e000ec-bc80-4878-888a-fa7db5c970a8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:58.053648 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=39 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:58.290541 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-73482519-658a-407b-b0ae-2e7d145ec51c tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/918e21966ac14f409e5c6c6e45e50df4?user_id=6b6dc84b26264f21a51252eb86d099a0" status: 200 len: 148 microversion: 2.57 time: 1.584148 Oct 04 20:33:58.295617 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 256/520] 10.222.0.78 () {62 vars in 1384 bytes} [Tue Oct 4 20:33:56 2022] PUT /compute/v2.1/os-quota-sets/918e21966ac14f409e5c6c6e45e50df4?user_id=6b6dc84b26264f21a51252eb86d099a0 => generated 148 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:58.327784 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f1273c0a-b406-4c1c-a659-7e88506fb634 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Calling method '.version_select at 0x7f77ef7b1160>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:58.532342 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c7e000ec-bc80-4878-888a-fa7db5c970a8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:58.557045 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c7e000ec-bc80-4878-888a-fa7db5c970a8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1312 microversion: 2.1 time: 0.691141 Oct 04 20:33:58.558112 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 265/521] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:57 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1312 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:58.625091 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8cf65b53-42f0-47c0-b863-6fcdc892a965 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:58.627507 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8cf65b53-42f0-47c0-b863-6fcdc892a965 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:58.678187 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8cf65b53-42f0-47c0-b863-6fcdc892a965 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:58.681041 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8cf65b53-42f0-47c0-b863-6fcdc892a965 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:58.685068 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8cf65b53-42f0-47c0-b863-6fcdc892a965 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:58.686955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8cf65b53-42f0-47c0-b863-6fcdc892a965 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:58.691336 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8cf65b53-42f0-47c0-b863-6fcdc892a965 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:58.692566 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8cf65b53-42f0-47c0-b863-6fcdc892a965 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:59.157406 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f1273c0a-b406-4c1c-a659-7e88506fb634 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/918e21966ac14f409e5c6c6e45e50df4?user_id=6b6dc84b26264f21a51252eb86d099a0" status: 200 len: 190 microversion: 2.57 time: 0.843682 Oct 04 20:33:59.160074 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 257/522] 10.222.0.78 () {60 vars in 1364 bytes} [Tue Oct 4 20:33:58 2022] GET /compute/v2.1/os-quota-sets/918e21966ac14f409e5c6c6e45e50df4?user_id=6b6dc84b26264f21a51252eb86d099a0 => generated 190 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:33:59.278647 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8cf65b53-42f0-47c0-b863-6fcdc892a965 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:59.315967 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8cf65b53-42f0-47c0-b863-6fcdc892a965 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1317 microversion: 2.1 time: 0.711954 Oct 04 20:33:59.317744 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 266/523] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:58 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1317 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:59.336982 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c98a1a89-8b5a-48a5-8fd2-7c8b651003aa tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:59.338228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c98a1a89-8b5a-48a5-8fd2-7c8b651003aa tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:59.399783 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c98a1a89-8b5a-48a5-8fd2-7c8b651003aa tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:59.400810 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c98a1a89-8b5a-48a5-8fd2-7c8b651003aa tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:59.401581 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c98a1a89-8b5a-48a5-8fd2-7c8b651003aa tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:59.405364 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c98a1a89-8b5a-48a5-8fd2-7c8b651003aa tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:59.406373 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c98a1a89-8b5a-48a5-8fd2-7c8b651003aa tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:59.413945 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c98a1a89-8b5a-48a5-8fd2-7c8b651003aa tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.165197 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Calling method '.version_select at 0x7f77ef5f8550>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:00.195011 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.204964 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.211157 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.310870 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.315919 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.321924 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.434250 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.437142 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.437142 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.477072 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.478036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.478819 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.547210 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c98a1a89-8b5a-48a5-8fd2-7c8b651003aa tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:00.581267 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c98a1a89-8b5a-48a5-8fd2-7c8b651003aa tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1281 microversion: 2.1 time: 1.260805 Oct 04 20:34:00.596834 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.597928 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.598585 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.609600 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 267/524] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:59 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1281 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:00.629223 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bee05496-afbd-437c-b723-ba3660c8c185 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1840 microversion: 2.53 time: 1.452330 Oct 04 20:34:00.637404 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e19944ab-d78d-4033-b45c-ff9d9c9cbf65 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:00.637871 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e19944ab-d78d-4033-b45c-ff9d9c9cbf65 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:00.655489 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 258/525] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Oct 4 20:33:59 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1840 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:00.668404 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e19944ab-d78d-4033-b45c-ff9d9c9cbf65 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.669819 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e19944ab-d78d-4033-b45c-ff9d9c9cbf65 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.671056 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e19944ab-d78d-4033-b45c-ff9d9c9cbf65 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.672236 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-602b102e-adef-485e-8473-a0b76d58d622 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:00.673792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e19944ab-d78d-4033-b45c-ff9d9c9cbf65 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.675062 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-602b102e-adef-485e-8473-a0b76d58d622 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:00.686727 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e19944ab-d78d-4033-b45c-ff9d9c9cbf65 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.689566 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e19944ab-d78d-4033-b45c-ff9d9c9cbf65 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.696558 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-602b102e-adef-485e-8473-a0b76d58d622 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.698305 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-602b102e-adef-485e-8473-a0b76d58d622 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.699490 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-602b102e-adef-485e-8473-a0b76d58d622 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.701561 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-602b102e-adef-485e-8473-a0b76d58d622 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.702927 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-602b102e-adef-485e-8473-a0b76d58d622 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.704245 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-602b102e-adef-485e-8473-a0b76d58d622 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.052253 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-602b102e-adef-485e-8473-a0b76d58d622 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:02.076886 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-602b102e-adef-485e-8473-a0b76d58d622 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1317 microversion: 2.1 time: 1.415639 Oct 04 20:34:02.078512 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 259/526] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:00 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1317 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:02.089911 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Calling method '.version_select at 0x7f77ef749f70>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:02.097850 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.100609 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.102606 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.117546 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e19944ab-d78d-4033-b45c-ff9d9c9cbf65 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:02.133125 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e19944ab-d78d-4033-b45c-ff9d9c9cbf65 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1462 microversion: 2.1 time: 1.521568 Oct 04 20:34:02.134240 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 268/527] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:00 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1462 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:02.155063 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.155406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-38d92506-df70-49be-9f5c-4138044e6071 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:02.155406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-38d92506-df70-49be-9f5c-4138044e6071 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:02.155707 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.155707 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.161566 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-38d92506-df70-49be-9f5c-4138044e6071 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.163788 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-38d92506-df70-49be-9f5c-4138044e6071 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.164988 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-38d92506-df70-49be-9f5c-4138044e6071 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.165613 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=100 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:02.167077 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-38d92506-df70-49be-9f5c-4138044e6071 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.168809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-38d92506-df70-49be-9f5c-4138044e6071 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.170079 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-38d92506-df70-49be-9f5c-4138044e6071 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.226540 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.227700 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.228575 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.254422 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.255929 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.257177 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.311597 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.313255 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.315567 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.343705 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2f1fb319-1570-44f0-8117-5b38e20648c6 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 530 microversion: 2.53 time: 0.257049 Oct 04 20:34:02.346673 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 260/528] 10.222.0.78 () {60 vars in 1222 bytes} [Tue Oct 4 20:34:02 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 530 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:02.446221 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-38d92506-df70-49be-9f5c-4138044e6071 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:02.478186 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-38d92506-df70-49be-9f5c-4138044e6071 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1279 microversion: 2.1 time: 0.341009 Oct 04 20:34:02.483617 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 269/529] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:02 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1279 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:02.510163 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9a990802-fe9d-4e98-ba1a-9e9d6a312183 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Calling method '.version_select at 0x7f77ef9d4e50>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:02.522235 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9a990802-fe9d-4e98-ba1a-9e9d6a312183 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.523688 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9a990802-fe9d-4e98-ba1a-9e9d6a312183 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.529631 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9a990802-fe9d-4e98-ba1a-9e9d6a312183 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.603048 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9a990802-fe9d-4e98-ba1a-9e9d6a312183 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.604580 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9a990802-fe9d-4e98-ba1a-9e9d6a312183 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.605725 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9a990802-fe9d-4e98-ba1a-9e9d6a312183 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.617224 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=100 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:02.621805 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9a990802-fe9d-4e98-ba1a-9e9d6a312183 tempest-HypervisorAdminV253TestBase-412968109 tempest-HypervisorAdminV253TestBase-412968109-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/b1c34a6c-91bc-49c5-a37e-abb8cb176c96" status: 200 len: 794 microversion: 2.53 time: 0.135972 Oct 04 20:34:02.623436 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 270/530] 10.222.0.78 () {60 vars in 1298 bytes} [Tue Oct 4 20:34:02 2022] GET /compute/v2.1/os-hypervisors/b1c34a6c-91bc-49c5-a37e-abb8cb176c96 => generated 794 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:03.126046 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-92c5d775-6ab7-48df-b441-233f47417eac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:03.127032 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-92c5d775-6ab7-48df-b441-233f47417eac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:03.158948 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92c5d775-6ab7-48df-b441-233f47417eac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:03.159779 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92c5d775-6ab7-48df-b441-233f47417eac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:03.160492 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92c5d775-6ab7-48df-b441-233f47417eac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:03.162243 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92c5d775-6ab7-48df-b441-233f47417eac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:03.163117 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92c5d775-6ab7-48df-b441-233f47417eac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:03.172213 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92c5d775-6ab7-48df-b441-233f47417eac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:03.309974 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:03.345270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d0b49ca4-6e50-4e11-9df0-b3dcb620ea21 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:03.348644 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d0b49ca4-6e50-4e11-9df0-b3dcb620ea21 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:03.365884 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0b49ca4-6e50-4e11-9df0-b3dcb620ea21 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:03.366847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0b49ca4-6e50-4e11-9df0-b3dcb620ea21 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:03.368236 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0b49ca4-6e50-4e11-9df0-b3dcb620ea21 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:03.370693 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0b49ca4-6e50-4e11-9df0-b3dcb620ea21 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:03.373382 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0b49ca4-6e50-4e11-9df0-b3dcb620ea21 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:03.375341 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0b49ca4-6e50-4e11-9df0-b3dcb620ea21 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:05.139000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-92c5d775-6ab7-48df-b441-233f47417eac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:05.166049 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-92c5d775-6ab7-48df-b441-233f47417eac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1317 microversion: 2.1 time: 2.048194 Oct 04 20:34:05.179999 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 271/531] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:03 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1317 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:05.211269 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-79cb068a-ed4b-4785-9046-a42057326120 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:05.212965 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-79cb068a-ed4b-4785-9046-a42057326120 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:05.225701 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-79cb068a-ed4b-4785-9046-a42057326120 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:05.232444 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-79cb068a-ed4b-4785-9046-a42057326120 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:05.232444 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-79cb068a-ed4b-4785-9046-a42057326120 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:05.232444 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-79cb068a-ed4b-4785-9046-a42057326120 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:05.232444 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-79cb068a-ed4b-4785-9046-a42057326120 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:05.233524 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-79cb068a-ed4b-4785-9046-a42057326120 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:05.574238 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-79cb068a-ed4b-4785-9046-a42057326120 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:05.622387 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-79cb068a-ed4b-4785-9046-a42057326120 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1279 microversion: 2.1 time: 0.421708 Oct 04 20:34:05.649917 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 272/532] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:05 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1279 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:05.689769 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-d1f5b6e5-a238-4c35-ac6e-c5078bcc3de2 req-c7b55e2d-95bb-4f77-bd2a-6ed552b40d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c29121-e094-4132-8ef4-b4c28da9df8a", "name": "network-vif-plugged", "status": "completed", "tag": "978b2a22-cd30-468a-af9b-1b86275c1460"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:05.740580 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-d1f5b6e5-a238-4c35-ac6e-c5078bcc3de2 req-c7b55e2d-95bb-4f77-bd2a-6ed552b40d63 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:05.741567 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-d1f5b6e5-a238-4c35-ac6e-c5078bcc3de2 req-c7b55e2d-95bb-4f77-bd2a-6ed552b40d63 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:05.748882 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-d1f5b6e5-a238-4c35-ac6e-c5078bcc3de2 req-c7b55e2d-95bb-4f77-bd2a-6ed552b40d63 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:05.814568 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-d1f5b6e5-a238-4c35-ac6e-c5078bcc3de2 req-c7b55e2d-95bb-4f77-bd2a-6ed552b40d63 service nova] Creating event network-vif-plugged:978b2a22-cd30-468a-af9b-1b86275c1460 for instance 50c29121-e094-4132-8ef4-b4c28da9df8a on n-h2-852085-12 Oct 04 20:34:05.836185 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-d1f5b6e5-a238-4c35-ac6e-c5078bcc3de2 req-c7b55e2d-95bb-4f77-bd2a-6ed552b40d63 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173346 Oct 04 20:34:05.840590 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 273/533] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:06.222847 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2fc61d76-d6db-4d5b-ad63-ac4a08793635 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:06.230857 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2fc61d76-d6db-4d5b-ad63-ac4a08793635 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:06.262126 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2fc61d76-d6db-4d5b-ad63-ac4a08793635 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.266297 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2fc61d76-d6db-4d5b-ad63-ac4a08793635 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.271620 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2fc61d76-d6db-4d5b-ad63-ac4a08793635 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.274371 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2fc61d76-d6db-4d5b-ad63-ac4a08793635 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.277967 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2fc61d76-d6db-4d5b-ad63-ac4a08793635 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.281320 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2fc61d76-d6db-4d5b-ad63-ac4a08793635 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.435270 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d0b49ca4-6e50-4e11-9df0-b3dcb620ea21 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1615 microversion: 2.1 time: 4.083147 Oct 04 20:34:06.436359 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 261/534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:02 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1615 bytes in 4087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:06.473817 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:06.474530 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:06.488965 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.490670 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.491649 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.493027 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.493825 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.494513 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fba71188-eb88-4e2f-993e-57e3cfb0b930) Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:34:07.269700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:07.272154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:34:07.274288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:34:07.276590 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:34:07.276590 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:34:07.276590 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:34:07.276590 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:34:07.276590 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:34:07.276590 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:34:07.276590 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:34:07.276590 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:34:07.276590 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:34:07.276590 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:34:07.276590 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fba71188-eb88-4e2f-993e-57e3cfb0b930) Oct 04 20:34:07.276590 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:07.289949 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:07.289949 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Request method failure captured: Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189/action HTTP/1.1 Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 15 Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJiToJYI4MASBN3dVdiVSjJtqQQXHEIdNXKsar7Xqdo4a4L5ZJGqyoYIfqTCIEhEWacD1Ek7WmusfBBeX_McaNVQxK4iPeCreBVpBgDAOK0RXR_36nno6EfyrlCNjifGKJCqmTTxd93E9PS1_2OlCJHA-TyBmPr6g5X_iymTr1vEw9w Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 7c51aa34a4434d0a931063ba18400be8 Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-MigrationsAdminTest-609424741 Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:34:07.290719 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c51aa34a4434d0a931063ba18400be8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c51aa34a4434d0a931063ba18400be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c51aa34a4434d0a931063ba18400be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c51aa34a4434d0a931063ba18400be8"}]}] Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-MigrationsAdminTest-609424741 Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 7c51aa34a4434d0a931063ba18400be8 Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-MigrationsAdminTest-609424741 Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-MigrationsAdminTest-609424741-project-admin Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 2e3ada01045e4d4b9295b266315e2cd1 Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-MigrationsAdminTest-609424741-project-admin Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: {"migrate": {}} Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:34:07.293044 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'bdb3a6b7-921f-41d4-a55e-0686a4dc7189', 'body': {'migrate': {}}} Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:34:07.294448 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:34:07.296640 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:34:07.298496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fba71188-eb88-4e2f-993e-57e3cfb0b930) Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:34:07.306122 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:07.320402 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:07.323868 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cd2febe5-e986-4366-a49e-c51998fd189d tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189/action" status: 500 len: 214 microversion: 2.1 time: 0.837194 Oct 04 20:34:07.323868 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 262/535] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:06 2022] POST /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189/action => generated 214 bytes in 847 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:34:07.331514 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2e4d8cfd-7898-4e39-b86e-a1efe03143a2 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.332905 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2e4d8cfd-7898-4e39-b86e-a1efe03143a2 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:07.349657 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e4d8cfd-7898-4e39-b86e-a1efe03143a2 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.350529 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e4d8cfd-7898-4e39-b86e-a1efe03143a2 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.351693 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e4d8cfd-7898-4e39-b86e-a1efe03143a2 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.354851 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e4d8cfd-7898-4e39-b86e-a1efe03143a2 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.355755 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e4d8cfd-7898-4e39-b86e-a1efe03143a2 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.356585 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e4d8cfd-7898-4e39-b86e-a1efe03143a2 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.383351 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-2fc61d76-d6db-4d5b-ad63-ac4a08793635 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:07.427202 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2fc61d76-d6db-4d5b-ad63-ac4a08793635 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1317 microversion: 2.1 time: 1.215281 Oct 04 20:34:07.436149 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 274/536] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:06 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1317 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:07.469268 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-17f03418-b6de-4c9d-ad92-07f72e9152ad tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Calling method '.version_select at 0x7f77ef9de700>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.485488 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-17f03418-b6de-4c9d-ad92-07f72e9152ad tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.493565 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-17f03418-b6de-4c9d-ad92-07f72e9152ad tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.493565 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-17f03418-b6de-4c9d-ad92-07f72e9152ad tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.562870 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-17f03418-b6de-4c9d-ad92-07f72e9152ad tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 18 microversion: 2.1 time: 0.123168 Oct 04 20:34:07.565328 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 275/537] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/os-migrations => generated 18 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:34:08.006672 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=11 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:08.242765 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-735321884", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:08.484640 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:08.606716 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2e4d8cfd-7898-4e39-b86e-a1efe03143a2 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:08.623337 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2e4d8cfd-7898-4e39-b86e-a1efe03143a2 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1321 microversion: 2.1 time: 1.302769 Oct 04 20:34:08.623968 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 263/538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1321 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:08.643059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-de610071-ba81-4db8-ae38-de0c53d9c464 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:08.643059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-de610071-ba81-4db8-ae38-de0c53d9c464 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:08.649256 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-de610071-ba81-4db8-ae38-de0c53d9c464 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.650001 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-de610071-ba81-4db8-ae38-de0c53d9c464 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.651084 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-de610071-ba81-4db8-ae38-de0c53d9c464 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.652440 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-de610071-ba81-4db8-ae38-de0c53d9c464 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.653422 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-de610071-ba81-4db8-ae38-de0c53d9c464 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.654620 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-de610071-ba81-4db8-ae38-de0c53d9c464 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:09.148143 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=9 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:09.671241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-de610071-ba81-4db8-ae38-de0c53d9c464 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:09.697730 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-de610071-ba81-4db8-ae38-de0c53d9c464 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1466 microversion: 2.1 time: 1.069531 Oct 04 20:34:09.697730 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 264/539] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:08 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1466 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:09.820794 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:09.821597 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:09.822513 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:09.823309 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:09.823982 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:09.852736 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:09.854595 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:09.855832 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:09.857807 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:09.858643 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:09.859759 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:09.900497 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Getting quotas for project 74eef3bf938c491d8a2f5192ba598c19. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:09.910273 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Getting quotas for user 4360a08eed56405b99333776285fef3a and project 74eef3bf938c491d8a2f5192ba598c19. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:09.935666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Going to run 1 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:09.941273 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:10.152753 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ff0507e4-953b-4051-8606-2a0a7a625c98 tempest-SecurityGroupsTestAdminJSON-1055982081 tempest-SecurityGroupsTestAdminJSON-1055982081-project] Action: 'create', calling method: .version_select at 0x7f77ef614670>, body: {"security_group": {"name": "tempest-securitygroup-853613868", "description": "tempest-description-557153205"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:10.209250 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e2998c8a-b047-49f0-921a-b829a17cf2e3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.994082 Oct 04 20:34:10.210278 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 276/540] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:34:10.230941 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e6f06693-1338-408d-83b8-647a586ab24f tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1906676691", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "5a968067-4034-47ae-963a-b80f9544a870"}], "security_groups": [{"name": "tempest-securitygroup--1817379424"}], "key_name": "tempest-keypair-1058594534", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:10.759299 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-e6f06693-1338-408d-83b8-647a586ab24f tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] validate_networks() for [('5a968067-4034-47ae-963a-b80f9544a870', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-e6f06693-1338-408d-83b8-647a586ab24f tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72703a5a-27b1-4998-8de2-05bdcb2eb3a5) Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:34:12.260996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:12.263778 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:34:12.265972 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:34:12.269503 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72703a5a-27b1-4998-8de2-05bdcb2eb3a5) Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-e6f06693-1338-408d-83b8-647a586ab24f tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e6f06693-1338-408d-83b8-647a586ab24f tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Request method failure captured: Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 471 Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJiOcGPqUAbnkDjAg_GhinWcah-rx0Vl-q-M0tIygmaRKI62opXYulC1e7x1_4avsIhRzdEky_hF7SXdT5V4zlgd-pOekF9orc8vR9Ot2udgiIVUc6d4uobcXJ5bhvMcO7w3nPEgIDk0ONj7Z0MTGS9QX6SE3ASdFMLDpSRKpLvyINA Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: cf616fd82dd34c7d92f4d8e9e80f89f4 Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1439487668 Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:34:12.294352 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:34:12.298417 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cf616fd82dd34c7d92f4d8e9e80f89f4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf616fd82dd34c7d92f4d8e9e80f89f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf616fd82dd34c7d92f4d8e9e80f89f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cf616fd82dd34c7d92f4d8e9e80f89f4"}]}] Oct 04 20:34:12.298417 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1439487668 Oct 04 20:34:12.298417 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: cf616fd82dd34c7d92f4d8e9e80f89f4 Oct 04 20:34:12.298417 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1439487668 Oct 04 20:34:12.298417 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-LiveAutoBlockMigrationV225Test-1439487668-project Oct 04 20:34:12.298417 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:34:12.298417 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:34:12.298417 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 6a310d2bd16e4d52841042364253a86b Oct 04 20:34:12.298417 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1439487668-project Oct 04 20:34:12.298417 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1906676691", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "5a968067-4034-47ae-963a-b80f9544a870"}], "security_groups": [{"name": "tempest-securitygroup--1817379424"}], "key_name": "tempest-keypair-1058594534", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-1906676691', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '5a968067-4034-47ae-963a-b80f9544a870'}], 'security_groups': [{'name': 'tempest-securitygroup--1817379424'}], 'key_name': 'tempest-keypair-1058594534', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:12.300689 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:34:12.302224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:34:12.306519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:34:12.310683 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72703a5a-27b1-4998-8de2-05bdcb2eb3a5) Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:34:12.314548 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e6f06693-1338-408d-83b8-647a586ab24f tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:12.318947 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:12.322249 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e6f06693-1338-408d-83b8-647a586ab24f tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 2.055785 Oct 04 20:34:12.322249 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 277/541] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:34:10 2022] POST /compute/v2.1/servers => generated 214 bytes in 2058 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 04 20:34:12.322249 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b5c11d8d-dee8-4032-bd0a-bff9a137a5b8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:12.322249 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b5c11d8d-dee8-4032-bd0a-bff9a137a5b8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:12.322249 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b5c11d8d-dee8-4032-bd0a-bff9a137a5b8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:12.323406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b5c11d8d-dee8-4032-bd0a-bff9a137a5b8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:12.323406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b5c11d8d-dee8-4032-bd0a-bff9a137a5b8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:12.323406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b5c11d8d-dee8-4032-bd0a-bff9a137a5b8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:12.323406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b5c11d8d-dee8-4032-bd0a-bff9a137a5b8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:12.328030 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b5c11d8d-dee8-4032-bd0a-bff9a137a5b8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.094599 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ff0507e4-953b-4051-8606-2a0a7a625c98 tempest-SecurityGroupsTestAdminJSON-1055982081 tempest-SecurityGroupsTestAdminJSON-1055982081-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 3.395663 Oct 04 20:34:13.095957 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 265/542] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:34:09 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 3398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:13.160762 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b5c11d8d-dee8-4032-bd0a-bff9a137a5b8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:13.194600 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b5c11d8d-dee8-4032-bd0a-bff9a137a5b8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1321 microversion: 2.1 time: 0.924062 Oct 04 20:34:13.201401 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 278/543] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:12 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1321 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:13.224989 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ca468181-d8c3-4dca-bd4b-9c8089060220 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:13.226307 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ca468181-d8c3-4dca-bd4b-9c8089060220 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:13.261127 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca468181-d8c3-4dca-bd4b-9c8089060220 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.273401 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca468181-d8c3-4dca-bd4b-9c8089060220 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.273401 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca468181-d8c3-4dca-bd4b-9c8089060220 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.273401 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca468181-d8c3-4dca-bd4b-9c8089060220 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.273401 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca468181-d8c3-4dca-bd4b-9c8089060220 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.278551 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca468181-d8c3-4dca-bd4b-9c8089060220 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.666351 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ca468181-d8c3-4dca-bd4b-9c8089060220 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:13.713890 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ca468181-d8c3-4dca-bd4b-9c8089060220 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 200 len: 1208 microversion: 2.1 time: 0.510177 Oct 04 20:34:13.732002 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 279/544] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:13 2022] GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 1208 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:13.762312 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-7b333bcd-8f90-4e8a-baee-2d65d01d719a req-4fb1ce3a-8513-457e-88e6-a02d262a750b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9bfdee0-1a5d-4f35-b3be-ea3017b41442", "tag": "4f6676f8-f93e-43e5-81f8-b66d1444428a"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:13.805470 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-7b333bcd-8f90-4e8a-baee-2d65d01d719a req-4fb1ce3a-8513-457e-88e6-a02d262a750b service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.806333 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-7b333bcd-8f90-4e8a-baee-2d65d01d719a req-4fb1ce3a-8513-457e-88e6-a02d262a750b service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.807178 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-7b333bcd-8f90-4e8a-baee-2d65d01d719a req-4fb1ce3a-8513-457e-88e6-a02d262a750b service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.855224 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-7b333bcd-8f90-4e8a-baee-2d65d01d719a req-4fb1ce3a-8513-457e-88e6-a02d262a750b service nova] Creating event network-changed:4f6676f8-f93e-43e5-81f8-b66d1444428a for instance b9bfdee0-1a5d-4f35-b3be-ea3017b41442 on n-h1-852085-12 Oct 04 20:34:13.872681 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-7b333bcd-8f90-4e8a-baee-2d65d01d719a req-4fb1ce3a-8513-457e-88e6-a02d262a750b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138212 Oct 04 20:34:13.874531 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 280/545] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:13.885922 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9eb33b17-acc9-40dc-ab6c-328b8c96f9fa tempest-SecurityGroupsTestAdminJSON-1055982081 tempest-SecurityGroupsTestAdminJSON-1055982081-project] Action: 'create', calling method: .version_select at 0x7f77efa6a8b0>, body: {"security_group": {"name": "tempest-securitygroup-995270259", "description": "tempest-description-1218302463"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:14.363580 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-114cde6a-c304-45e7-9d22-25a2ecef35a3 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:14.366542 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-114cde6a-c304-45e7-9d22-25a2ecef35a3 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:14.394162 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-114cde6a-c304-45e7-9d22-25a2ecef35a3 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.395291 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-114cde6a-c304-45e7-9d22-25a2ecef35a3 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.399853 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-114cde6a-c304-45e7-9d22-25a2ecef35a3 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:14.403365 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-114cde6a-c304-45e7-9d22-25a2ecef35a3 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.406671 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-114cde6a-c304-45e7-9d22-25a2ecef35a3 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.409724 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-114cde6a-c304-45e7-9d22-25a2ecef35a3 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:15.019453 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9eb33b17-acc9-40dc-ab6c-328b8c96f9fa tempest-SecurityGroupsTestAdminJSON-1055982081 tempest-SecurityGroupsTestAdminJSON-1055982081-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.142319 Oct 04 20:34:15.023229 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 281/546] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:34:13 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:15.094313 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-114cde6a-c304-45e7-9d22-25a2ecef35a3 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1619 microversion: 2.1 time: 1.996343 Oct 04 20:34:15.096308 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 266/547] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:13 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1619 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:15.105190 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3e565a3f-a2eb-4622-8944-d56fdd1eb035 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:15.112816 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3e565a3f-a2eb-4622-8944-d56fdd1eb035 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:15.124477 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3e565a3f-a2eb-4622-8944-d56fdd1eb035 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:15.125360 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3e565a3f-a2eb-4622-8944-d56fdd1eb035 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:15.126555 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3e565a3f-a2eb-4622-8944-d56fdd1eb035 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:15.128612 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3e565a3f-a2eb-4622-8944-d56fdd1eb035 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:15.131290 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3e565a3f-a2eb-4622-8944-d56fdd1eb035 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:15.132199 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3e565a3f-a2eb-4622-8944-d56fdd1eb035 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:15.210431 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6d31d2ba-4c32-46bd-a4f8-2b264ee65b19 tempest-FloatingIPsAssociationNegativeTestJSON-43238373 tempest-FloatingIPsAssociationNegativeTestJSON-43238373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-893135626", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "b32b65b0-43ee-407f-9ee0-05ab0b34c9ff"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:15.353530 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-6d31d2ba-4c32-46bd-a4f8-2b264ee65b19 tempest-FloatingIPsAssociationNegativeTestJSON-43238373 tempest-FloatingIPsAssociationNegativeTestJSON-43238373-project] validate_networks() for [('b32b65b0-43ee-407f-9ee0-05ab0b34c9ff', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:15.949351 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3e565a3f-a2eb-4622-8944-d56fdd1eb035 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:15.972448 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3e565a3f-a2eb-4622-8944-d56fdd1eb035 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1321 microversion: 2.1 time: 0.872001 Oct 04 20:34:15.974034 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 267/548] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:15 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1321 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:16.146244 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-88342301", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": "none"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-6d31d2ba-4c32-46bd-a4f8-2b264ee65b19 tempest-FloatingIPsAssociationNegativeTestJSON-43238373 tempest-FloatingIPsAssociationNegativeTestJSON-43238373-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-14fc961c-5ed7-4049-84dd-63b0fc441f81) Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:34:16.320023 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:16.322472 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:34:16.325447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:34:16.328958 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-14fc961c-5ed7-4049-84dd-63b0fc441f81) Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-6d31d2ba-4c32-46bd-a4f8-2b264ee65b19 tempest-FloatingIPsAssociationNegativeTestJSON-43238373 tempest-FloatingIPsAssociationNegativeTestJSON-43238373-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6d31d2ba-4c32-46bd-a4f8-2b264ee65b19 tempest-FloatingIPsAssociationNegativeTestJSON-43238373 tempest-FloatingIPsAssociationNegativeTestJSON-43238373-project] Request method failure captured: Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 223 Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJjETGN17qd5SqTQn0czG-6vq7U3gDTsGgMeEZIRhmysi5NBn14iig9zAQeSFT-1hYuB4sMz5JfQcnd98JlfI_Jb5AIvHrZkev2MyX6JGLAsCMl1huOp8EfXvhkQHvsulnsNeud1Zg1bBHmyMkv09jSE4yL3Jw2ukxgEC9dG-3LttyQ Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 2b0c9c6a4aa448cca9a86ffe7484ec99 Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-43238373 Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:34:16.336717 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:34:16.342165 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b0c9c6a4aa448cca9a86ffe7484ec99", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b0c9c6a4aa448cca9a86ffe7484ec99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b0c9c6a4aa448cca9a86ffe7484ec99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b0c9c6a4aa448cca9a86ffe7484ec99"}]}] Oct 04 20:34:16.342165 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-43238373 Oct 04 20:34:16.342165 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 2b0c9c6a4aa448cca9a86ffe7484ec99 Oct 04 20:34:16.342165 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-43238373 Oct 04 20:34:16.342165 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-43238373-project Oct 04 20:34:16.342165 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:34:16.342165 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:34:16.342165 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 18c239f3dc7642d68104932b9e740c40 Oct 04 20:34:16.342165 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-43238373-project Oct 04 20:34:16.342165 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:34:16.342165 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-893135626", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "b32b65b0-43ee-407f-9ee0-05ab0b34c9ff"}]}} Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-server-893135626', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'b32b65b0-43ee-407f-9ee0-05ab0b34c9ff'}]}}} Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:34:16.371847 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:16.374173 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:34:16.377950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:34:16.388221 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-14fc961c-5ed7-4049-84dd-63b0fc441f81) Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:16.391484 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:16.395679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:16.395679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:16.395679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:16.395679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:16.395679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:34:16.395679 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6d31d2ba-4c32-46bd-a4f8-2b264ee65b19 tempest-FloatingIPsAssociationNegativeTestJSON-43238373 tempest-FloatingIPsAssociationNegativeTestJSON-43238373-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:16.395679 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:16.395679 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6d31d2ba-4c32-46bd-a4f8-2b264ee65b19 tempest-FloatingIPsAssociationNegativeTestJSON-43238373 tempest-FloatingIPsAssociationNegativeTestJSON-43238373-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.318136 Oct 04 20:34:16.395679 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 282/549] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:15 2022] POST /compute/v2.1/servers => generated 214 bytes in 1323 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:34:16.397731 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:16.397731 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:16.397731 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:16.397731 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:16.397731 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:16.398873 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.398873 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.398873 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.398873 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.399874 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.400145 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d532a508-5f08-4208-ad22-91b873f3b2f5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:16.400405 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.400649 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d532a508-5f08-4208-ad22-91b873f3b2f5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:16.413096 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d532a508-5f08-4208-ad22-91b873f3b2f5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.421877 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d532a508-5f08-4208-ad22-91b873f3b2f5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.421877 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d532a508-5f08-4208-ad22-91b873f3b2f5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.422424 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Getting quotas for project 526ce79b3ad7461eb974329c1e567568. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:16.423344 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d532a508-5f08-4208-ad22-91b873f3b2f5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.428501 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d532a508-5f08-4208-ad22-91b873f3b2f5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.429872 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Getting quotas for user 386f857786474effa6df298d43738c92 and project 526ce79b3ad7461eb974329c1e567568. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:16.431557 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d532a508-5f08-4208-ad22-91b873f3b2f5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.460348 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:16.465056 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:16.812476 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3f970e71-7b7d-4ee1-bdf5-0ccb333cac70 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.836110 Oct 04 20:34:16.821652 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 268/550] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:34:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:34:17.031228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-d532a508-5f08-4208-ad22-91b873f3b2f5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:17.081231 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d532a508-5f08-4208-ad22-91b873f3b2f5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 200 len: 1270 microversion: 2.1 time: 0.727948 Oct 04 20:34:17.082792 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 283/551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:16 2022] GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 1270 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:17.107590 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c4d73507-2904-455e-9ab6-120882df2506 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Action: 'create', calling method: .version_select at 0x7f77ef9de700>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-877476380", "policies": ["affinity"]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:17.249088 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-c4d73507-2904-455e-9ab6-120882df2506 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:17.276021 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-c4d73507-2904-455e-9ab6-120882df2506 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:17.327970 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-32e34c3c-0bfe-4556-a454-4564a79e9ea9 tempest-SecurityGroupsTestAdminJSON-1119633991 tempest-SecurityGroupsTestAdminJSON-1119633991-project-admin] Action: 'create', calling method: .version_select at 0x7f77ef56fb80>, body: {"security_group": {"name": "tempest-securitygroup-561793604", "description": "tempest-description-1400636749"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:17.601639 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-c4d73507-2904-455e-9ab6-120882df2506 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:17.625056 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-c4d73507-2904-455e-9ab6-120882df2506 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:17.626333 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:17.678275 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c4d73507-2904-455e-9ab6-120882df2506 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.589420 Oct 04 20:34:17.731288 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 284/552] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 4 20:34:17 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:17.761425 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-281847f8-aa57-492e-bcf8-c22a41d75fc5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:17.770624 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-281847f8-aa57-492e-bcf8-c22a41d75fc5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:18.302759 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-281847f8-aa57-492e-bcf8-c22a41d75fc5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:18.331769 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-281847f8-aa57-492e-bcf8-c22a41d75fc5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:18.336219 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-281847f8-aa57-492e-bcf8-c22a41d75fc5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:18.350311 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-281847f8-aa57-492e-bcf8-c22a41d75fc5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "PUT /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1357 microversion: 2.75 time: 0.615314 Oct 04 20:34:18.352234 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 285/553] 10.222.0.78 () {62 vars in 1297 bytes} [Tue Oct 4 20:34:17 2022] PUT /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1357 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:18.362053 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-35ce851f-4948-49a5-87f4-7df9a6294a33 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:18.363907 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-35ce851f-4948-49a5-87f4-7df9a6294a33 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:18.376901 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-35ce851f-4948-49a5-87f4-7df9a6294a33 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:18.378235 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-35ce851f-4948-49a5-87f4-7df9a6294a33 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:18.379908 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-35ce851f-4948-49a5-87f4-7df9a6294a33 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:18.381592 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-35ce851f-4948-49a5-87f4-7df9a6294a33 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:18.382815 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-35ce851f-4948-49a5-87f4-7df9a6294a33 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:18.387820 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-35ce851f-4948-49a5-87f4-7df9a6294a33 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:19.885080 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:20.082612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-35ce851f-4948-49a5-87f4-7df9a6294a33 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:20.114696 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-35ce851f-4948-49a5-87f4-7df9a6294a33 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1321 microversion: 2.1 time: 1.759371 Oct 04 20:34:20.118653 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 286/554] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:18 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1321 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:20.151858 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e89fb744-2d57-4208-92ef-5393a2069151 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:20.153245 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e89fb744-2d57-4208-92ef-5393a2069151 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:20.178093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e89fb744-2d57-4208-92ef-5393a2069151 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:20.183845 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e89fb744-2d57-4208-92ef-5393a2069151 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:20.184688 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e89fb744-2d57-4208-92ef-5393a2069151 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:20.188480 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e89fb744-2d57-4208-92ef-5393a2069151 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:20.192920 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e89fb744-2d57-4208-92ef-5393a2069151 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:20.196304 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e89fb744-2d57-4208-92ef-5393a2069151 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.810962 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e89fb744-2d57-4208-92ef-5393a2069151 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:21.861711 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e89fb744-2d57-4208-92ef-5393a2069151 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 200 len: 1312 microversion: 2.1 time: 1.729549 Oct 04 20:34:21.864653 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 287/555] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:20 2022] GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 1312 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:21.875820 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-165809853", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4e4d59f0-e230-4ab8-9191-d4a781ad480e"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:22.004281 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:22.522921 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-32e34c3c-0bfe-4556-a454-4564a79e9ea9 tempest-SecurityGroupsTestAdminJSON-1119633991 tempest-SecurityGroupsTestAdminJSON-1119633991-project-admin] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 5.697263 Oct 04 20:34:22.561291 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 269/556] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:34:16 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 5733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:22.586429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f02a3a74-4cbc-4c43-85ad-2f842fcac5a4 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:22.601391 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f02a3a74-4cbc-4c43-85ad-2f842fcac5a4 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:22.624119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f02a3a74-4cbc-4c43-85ad-2f842fcac5a4 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.624119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f02a3a74-4cbc-4c43-85ad-2f842fcac5a4 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.624492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f02a3a74-4cbc-4c43-85ad-2f842fcac5a4 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.626130 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f02a3a74-4cbc-4c43-85ad-2f842fcac5a4 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.627261 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f02a3a74-4cbc-4c43-85ad-2f842fcac5a4 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.628240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f02a3a74-4cbc-4c43-85ad-2f842fcac5a4 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.296958 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f02a3a74-4cbc-4c43-85ad-2f842fcac5a4 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:23.332415 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f02a3a74-4cbc-4c43-85ad-2f842fcac5a4 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:23.340116 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f02a3a74-4cbc-4c43-85ad-2f842fcac5a4 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:23.355460 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f02a3a74-4cbc-4c43-85ad-2f842fcac5a4 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1417 microversion: 2.75 time: 0.789656 Oct 04 20:34:23.357265 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 270/557] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:22 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1417 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:23.367254 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-fd2b8c44-07eb-4a08-9848-2e6006dbda73 req-4515c90d-ad28-4691-a6af-09af1937441d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5072682-0691-4542-a881-7f874a8d8ef3", "tag": "9508b042-5160-4988-9db8-7f6ce03be19a"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:23.382246 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-fd2b8c44-07eb-4a08-9848-2e6006dbda73 req-4515c90d-ad28-4691-a6af-09af1937441d service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.384337 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-fd2b8c44-07eb-4a08-9848-2e6006dbda73 req-4515c90d-ad28-4691-a6af-09af1937441d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.384337 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-fd2b8c44-07eb-4a08-9848-2e6006dbda73 req-4515c90d-ad28-4691-a6af-09af1937441d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.404682 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-fd2b8c44-07eb-4a08-9848-2e6006dbda73 req-4515c90d-ad28-4691-a6af-09af1937441d service nova] Creating event network-changed:9508b042-5160-4988-9db8-7f6ce03be19a for instance f5072682-0691-4542-a881-7f874a8d8ef3 on n-h2-852085-12 Oct 04 20:34:23.414736 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-fd2b8c44-07eb-4a08-9848-2e6006dbda73 req-4515c90d-ad28-4691-a6af-09af1937441d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054599 Oct 04 20:34:23.421557 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 271/558] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:23.433230 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6fa54558-1901-4e44-a338-06ef8c65acfc tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:23.437120 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6fa54558-1901-4e44-a338-06ef8c65acfc tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:23.450035 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6fa54558-1901-4e44-a338-06ef8c65acfc tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.451441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6fa54558-1901-4e44-a338-06ef8c65acfc tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.452825 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6fa54558-1901-4e44-a338-06ef8c65acfc tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.456169 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6fa54558-1901-4e44-a338-06ef8c65acfc tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.457632 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6fa54558-1901-4e44-a338-06ef8c65acfc tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.459125 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6fa54558-1901-4e44-a338-06ef8c65acfc tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.965242 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:23.968766 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:23.968766 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:23.968766 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:23.969397 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:24.043307 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:24.044675 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:24.046310 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:24.051530 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:24.053079 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:24.057207 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:24.121923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:24.133732 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:24.167323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Going to run 2 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:24.181245 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 75de593c-9f57-471f-a519-d97960ccde5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:24.366581 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6fa54558-1901-4e44-a338-06ef8c65acfc tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:24.413937 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6fa54558-1901-4e44-a338-06ef8c65acfc tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1321 microversion: 2.1 time: 0.989369 Oct 04 20:34:24.422016 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 272/559] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:23 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1321 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:24.438586 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d55df064-6a92-4269-be4a-62ab2105a7bc tempest-SecurityGroupsTestAdminJSON-1119633991 tempest-SecurityGroupsTestAdminJSON-1119633991-project-admin] Action: 'create', calling method: .version_select at 0x7f77ef5f8b80>, body: {"security_group": {"name": "tempest-securitygroup-2134425129", "description": "tempest-description-806714712"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:24.494133 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=123540) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 20:34:24.545750 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:24.558218 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:24.783633 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:24.794939 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:24.837394 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=75de593c-9f57-471f-a519-d97960ccde5f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:25.075254 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:25.086888 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:25.272920 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:25.290707 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:25.410036 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-80289419-ce4f-4886-a9dd-15c86ea5df51 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.542140 Oct 04 20:34:25.411792 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 288/560] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/servers => generated 32 bytes in 3546 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:34:25.421792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-420b240b-97b0-48d4-8e8b-957dd76fcb85 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:25.424218 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-420b240b-97b0-48d4-8e8b-957dd76fcb85 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:25.443415 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-420b240b-97b0-48d4-8e8b-957dd76fcb85 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.443415 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-420b240b-97b0-48d4-8e8b-957dd76fcb85 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.444039 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-420b240b-97b0-48d4-8e8b-957dd76fcb85 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.445458 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-420b240b-97b0-48d4-8e8b-957dd76fcb85 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.446234 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-420b240b-97b0-48d4-8e8b-957dd76fcb85 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.447018 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-420b240b-97b0-48d4-8e8b-957dd76fcb85 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.188729 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d55df064-6a92-4269-be4a-62ab2105a7bc tempest-SecurityGroupsTestAdminJSON-1119633991 tempest-SecurityGroupsTestAdminJSON-1119633991-project-admin] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.764247 Oct 04 20:34:26.189887 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 273/561] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:34:24 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:26.201249 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-90e5d145-287a-45ca-ba91-7fa18b016a9b req-da7cdc93-3c00-4fd3-95c2-d5d489f98e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9bfdee0-1a5d-4f35-b3be-ea3017b41442", "name": "network-vif-plugged", "status": "completed", "tag": "4f6676f8-f93e-43e5-81f8-b66d1444428a"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:26.221288 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-90e5d145-287a-45ca-ba91-7fa18b016a9b req-da7cdc93-3c00-4fd3-95c2-d5d489f98e3e service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.222087 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-90e5d145-287a-45ca-ba91-7fa18b016a9b req-da7cdc93-3c00-4fd3-95c2-d5d489f98e3e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.222827 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-90e5d145-287a-45ca-ba91-7fa18b016a9b req-da7cdc93-3c00-4fd3-95c2-d5d489f98e3e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.239353 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-420b240b-97b0-48d4-8e8b-957dd76fcb85 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:26.259363 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-90e5d145-287a-45ca-ba91-7fa18b016a9b req-da7cdc93-3c00-4fd3-95c2-d5d489f98e3e service nova] Creating event network-vif-plugged:4f6676f8-f93e-43e5-81f8-b66d1444428a for instance b9bfdee0-1a5d-4f35-b3be-ea3017b41442 on n-h1-852085-12 Oct 04 20:34:26.268702 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-90e5d145-287a-45ca-ba91-7fa18b016a9b req-da7cdc93-3c00-4fd3-95c2-d5d489f98e3e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076128 Oct 04 20:34:26.271445 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 274/562] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:26.278539 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-420b240b-97b0-48d4-8e8b-957dd76fcb85 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 200 len: 1312 microversion: 2.1 time: 0.864777 Oct 04 20:34:26.281987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a1533b96-8ca8-4c68-a2c5-d18a634d4f4c tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:26.283944 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a1533b96-8ca8-4c68-a2c5-d18a634d4f4c tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:26.298402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1533b96-8ca8-4c68-a2c5-d18a634d4f4c tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.303345 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 289/563] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:25 2022] GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 1312 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:26.313278 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1533b96-8ca8-4c68-a2c5-d18a634d4f4c tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.314422 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1533b96-8ca8-4c68-a2c5-d18a634d4f4c tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.314689 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6f0c99ed-912d-4a04-b213-30c9faae95e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:26.315284 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1533b96-8ca8-4c68-a2c5-d18a634d4f4c tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.316085 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1533b96-8ca8-4c68-a2c5-d18a634d4f4c tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.317300 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1533b96-8ca8-4c68-a2c5-d18a634d4f4c tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.344940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-6f0c99ed-912d-4a04-b213-30c9faae95e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:26.344940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-6f0c99ed-912d-4a04-b213-30c9faae95e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Searching by: {'deleted': False, 'project_id': '70436b8b504e43dc882f5ee434ecf443'} {{(pid=123540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:34:26.448825 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6f0c99ed-912d-4a04-b213-30c9faae95e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.454698 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:26.458651 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6f0c99ed-912d-4a04-b213-30c9faae95e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.459928 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6f0c99ed-912d-4a04-b213-30c9faae95e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.465239 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6f0c99ed-912d-4a04-b213-30c9faae95e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.475953 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=6 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:26.476399 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6f0c99ed-912d-4a04-b213-30c9faae95e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.476399 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6f0c99ed-912d-4a04-b213-30c9faae95e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.833594 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a1533b96-8ca8-4c68-a2c5-d18a634d4f4c tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:26.862021 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a1533b96-8ca8-4c68-a2c5-d18a634d4f4c tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:26.869888 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a1533b96-8ca8-4c68-a2c5-d18a634d4f4c tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:26.893555 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a1533b96-8ca8-4c68-a2c5-d18a634d4f4c tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1415 microversion: 2.75 time: 0.619617 Oct 04 20:34:26.894547 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 275/564] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:26 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1415 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:26.943415 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fc1f71c4-37e8-49db-b69d-317c5a7f8c78 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:26.944555 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.multi_cell_list [None req-6f0c99ed-912d-4a04-b213-30c9faae95e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=123540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:34:26.945478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-fc1f71c4-37e8-49db-b69d-317c5a7f8c78 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:26.959325 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fc1f71c4-37e8-49db-b69d-317c5a7f8c78 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.960937 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fc1f71c4-37e8-49db-b69d-317c5a7f8c78 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.962118 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fc1f71c4-37e8-49db-b69d-317c5a7f8c78 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.963874 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fc1f71c4-37e8-49db-b69d-317c5a7f8c78 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.968927 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fc1f71c4-37e8-49db-b69d-317c5a7f8c78 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.972102 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fc1f71c4-37e8-49db-b69d-317c5a7f8c78 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.270873 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6f0c99ed-912d-4a04-b213-30c9faae95e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.964998 Oct 04 20:34:27.275087 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 290/565] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 4 20:34:26 2022] GET /compute/v2.1/servers => generated 1002 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:27.285227 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-68579cbe-da00-4cb1-b5ba-282470e5b0f3 tempest-SecurityGroupsTestAdminJSON-1119633991 tempest-SecurityGroupsTestAdminJSON-1119633991-project-admin] Calling method '.version_select at 0x7f77ef947820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:28.030901 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-fc1f71c4-37e8-49db-b69d-317c5a7f8c78 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:28.062369 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fc1f71c4-37e8-49db-b69d-317c5a7f8c78 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1321 microversion: 2.1 time: 1.140609 Oct 04 20:34:28.064431 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 276/566] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:26 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1321 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:28.097158 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-eb1a33ec-c5f4-49c5-87a7-9a3f85091b46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:28.099544 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-eb1a33ec-c5f4-49c5-87a7-9a3f85091b46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:28.106767 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:28.438601 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-eb1a33ec-c5f4-49c5-87a7-9a3f85091b46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:28.458222 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-eb1a33ec-c5f4-49c5-87a7-9a3f85091b46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1218 microversion: 2.1 time: 0.387896 Oct 04 20:34:28.459999 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 277/567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:28 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1218 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:28.468227 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-62a87c6f-7d09-4384-be37-aae07c2ee7d2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:28.469570 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-62a87c6f-7d09-4384-be37-aae07c2ee7d2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:28.480753 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62a87c6f-7d09-4384-be37-aae07c2ee7d2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.482130 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62a87c6f-7d09-4384-be37-aae07c2ee7d2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.483299 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62a87c6f-7d09-4384-be37-aae07c2ee7d2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:28.485190 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62a87c6f-7d09-4384-be37-aae07c2ee7d2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.486783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62a87c6f-7d09-4384-be37-aae07c2ee7d2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.488215 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62a87c6f-7d09-4384-be37-aae07c2ee7d2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.211583 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-62a87c6f-7d09-4384-be37-aae07c2ee7d2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:29.225486 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-62a87c6f-7d09-4384-be37-aae07c2ee7d2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 200 len: 1312 microversion: 2.1 time: 0.763539 Oct 04 20:34:29.226537 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 278/568] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:28 2022] GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 1312 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:29.235846 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b3965090-43b8-4341-848b-1f1c9f0afe53 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:29.237393 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b3965090-43b8-4341-848b-1f1c9f0afe53 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:29.271435 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3965090-43b8-4341-848b-1f1c9f0afe53 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.272705 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3965090-43b8-4341-848b-1f1c9f0afe53 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.273835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3965090-43b8-4341-848b-1f1c9f0afe53 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.275657 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3965090-43b8-4341-848b-1f1c9f0afe53 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.277223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3965090-43b8-4341-848b-1f1c9f0afe53 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.278048 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3965090-43b8-4341-848b-1f1c9f0afe53 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.932464 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b3965090-43b8-4341-848b-1f1c9f0afe53 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:29.956105 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b3965090-43b8-4341-848b-1f1c9f0afe53 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:29.962948 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b3965090-43b8-4341-848b-1f1c9f0afe53 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:29.975184 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b3965090-43b8-4341-848b-1f1c9f0afe53 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1436 microversion: 2.75 time: 0.746156 Oct 04 20:34:29.977493 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 279/569] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:29 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1436 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:29.990948 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c3628a73-da5a-45c8-aad1-bac229116716 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:29.993600 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c3628a73-da5a-45c8-aad1-bac229116716 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:30.028990 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c3628a73-da5a-45c8-aad1-bac229116716 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:30.032640 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c3628a73-da5a-45c8-aad1-bac229116716 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:30.037025 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c3628a73-da5a-45c8-aad1-bac229116716 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:30.038352 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c3628a73-da5a-45c8-aad1-bac229116716 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:30.039185 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c3628a73-da5a-45c8-aad1-bac229116716 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:30.049153 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c3628a73-da5a-45c8-aad1-bac229116716 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:30.826818 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c3628a73-da5a-45c8-aad1-bac229116716 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:30.882788 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c3628a73-da5a-45c8-aad1-bac229116716 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1471 microversion: 2.1 time: 0.902964 Oct 04 20:34:30.886014 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 280/570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:29 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1471 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:30.921080 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-eef21502-ca4f-4494-b75c-9d560a04897c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:30.953591 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-eef21502-ca4f-4494-b75c-9d560a04897c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:31.021878 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eef21502-ca4f-4494-b75c-9d560a04897c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.027077 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eef21502-ca4f-4494-b75c-9d560a04897c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.033562 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eef21502-ca4f-4494-b75c-9d560a04897c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.043429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eef21502-ca4f-4494-b75c-9d560a04897c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.047219 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eef21502-ca4f-4494-b75c-9d560a04897c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.063297 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eef21502-ca4f-4494-b75c-9d560a04897c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.481973 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-eef21502-ca4f-4494-b75c-9d560a04897c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:31.520518 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-eef21502-ca4f-4494-b75c-9d560a04897c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1270 microversion: 2.1 time: 0.629581 Oct 04 20:34:31.529377 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 281/571] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:30 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1270 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:31.547418 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-46b6fd90-6605-4e1f-90b4-8221000e7a46 req-e0e6e53d-b3fd-4f5d-a732-62d359e721af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5072682-0691-4542-a881-7f874a8d8ef3", "name": "network-vif-plugged", "status": "completed", "tag": "9508b042-5160-4988-9db8-7f6ce03be19a"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:31.597711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-46b6fd90-6605-4e1f-90b4-8221000e7a46 req-e0e6e53d-b3fd-4f5d-a732-62d359e721af service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.598891 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-46b6fd90-6605-4e1f-90b4-8221000e7a46 req-e0e6e53d-b3fd-4f5d-a732-62d359e721af service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.599809 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-46b6fd90-6605-4e1f-90b4-8221000e7a46 req-e0e6e53d-b3fd-4f5d-a732-62d359e721af service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.654319 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=100 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:31.663064 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-46b6fd90-6605-4e1f-90b4-8221000e7a46 req-e0e6e53d-b3fd-4f5d-a732-62d359e721af service nova] Creating event network-vif-plugged:9508b042-5160-4988-9db8-7f6ce03be19a for instance f5072682-0691-4542-a881-7f874a8d8ef3 on n-h2-852085-12 Oct 04 20:34:31.676723 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-46b6fd90-6605-4e1f-90b4-8221000e7a46 req-e0e6e53d-b3fd-4f5d-a732-62d359e721af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145004 Oct 04 20:34:31.678194 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 282/572] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:31.708052 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:31.733536 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:31.780019 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.785638 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.787906 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.792089 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.796021 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.801684 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.200211 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:32.202476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:32.202476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:32.211905 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:32.215213 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:32.640603 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:32.690643 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.695130 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.696158 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.697508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.700043 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.701302 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.166457 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:33.209725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:33.216850 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:33.229743 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-083917b3-1dc8-4bec-b5d8-0122df413e45 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "POST /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35/action" status: 202 len: 1493 microversion: 2.75 time: 1.549707 Oct 04 20:34:33.232468 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 283/573] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 4 20:34:31 2022] POST /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35/action => generated 1493 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 20:34:33.248354 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-807b1bdd-1f33-41d0-a785-bcca023e7528 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:33.249764 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-807b1bdd-1f33-41d0-a785-bcca023e7528 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:33.263762 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-807b1bdd-1f33-41d0-a785-bcca023e7528 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.265792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-807b1bdd-1f33-41d0-a785-bcca023e7528 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.266940 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-807b1bdd-1f33-41d0-a785-bcca023e7528 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.268744 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-807b1bdd-1f33-41d0-a785-bcca023e7528 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.269774 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-807b1bdd-1f33-41d0-a785-bcca023e7528 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.270766 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-807b1bdd-1f33-41d0-a785-bcca023e7528 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.984957 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-807b1bdd-1f33-41d0-a785-bcca023e7528 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:34.032508 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-807b1bdd-1f33-41d0-a785-bcca023e7528 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 200 len: 1312 microversion: 2.1 time: 0.797104 Oct 04 20:34:34.033458 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 284/574] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:33 2022] GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 1312 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:34.571837 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d10a8900-ecba-4a5a-b7c7-47d3e0f88b9a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:34.581006 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d10a8900-ecba-4a5a-b7c7-47d3e0f88b9a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] [instance: de441f93-e784-4aff-8f4d-392235b04daa] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:34.638035 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-d10a8900-ecba-4a5a-b7c7-47d3e0f88b9a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] HTTP exception thrown: Instance de441f93-e784-4aff-8f4d-392235b04daa could not be found. Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d10a8900-ecba-4a5a-b7c7-47d3e0f88b9a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Request method failure captured: Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers/de441f93-e784-4aff-8f4d-392235b04daa/action HTTP/1.1 Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 15 Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJis9KwxL8gHDbPjc_7_LGL6g3HOAgVeJUZWHBWML-XvO6B3BoFwfIPvTS3peEYatfjOxlHifyja4v2o67tIYjxHPahOxEwneIox4jBv4Zmgx_prT6xeih2a292gDeED1Cr1UtiXaBlEw_1WvakQrH1kokbv4NDIfBWVlmk8zslsaLo Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 102b4fb7ac5e4cfdb2affbecc59ecbb2 Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:34:34.663110 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_102b4fb7ac5e4cfdb2affbecc59ecbb2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}] Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 102b4fb7ac5e4cfdb2affbecc59ecbb2 Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersAdminNegativeTestJSON-359119102-project-admin Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: aa74dd7fba5a467eb147229e77a0f25a Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersAdminNegativeTestJSON-359119102-project-admin Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: {"migrate": {}} Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:34:34.666195 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance de441f93-e784-4aff-8f4d-392235b04daa could not be found. Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'de441f93-e784-4aff-8f4d-392235b04daa', 'body': {'migrate': {}}} Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de441f93-e784-4aff-8f4d-392235b04daa could not be found. Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:34.667705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de441f93-e784-4aff-8f4d-392235b04daa could not be found. Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de441f93-e784-4aff-8f4d-392235b04daa could not be found. Oct 04 20:34:34.669815 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:34.672908 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d10a8900-ecba-4a5a-b7c7-47d3e0f88b9a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Returning 404 to user: Instance de441f93-e784-4aff-8f4d-392235b04daa could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:34.684858 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d10a8900-ecba-4a5a-b7c7-47d3e0f88b9a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/de441f93-e784-4aff-8f4d-392235b04daa/action" status: 404 len: 111 microversion: 2.1 time: 0.648387 Oct 04 20:34:34.685943 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 285/575] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:34 2022] POST /compute/v2.1/servers/de441f93-e784-4aff-8f4d-392235b04daa/action => generated 111 bytes in 652 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:34.723800 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4efbb3e7-e60f-4698-bf82-9990ce8ccce1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:34.730598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4efbb3e7-e60f-4698-bf82-9990ce8ccce1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:34.765415 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4efbb3e7-e60f-4698-bf82-9990ce8ccce1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:34.766586 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4efbb3e7-e60f-4698-bf82-9990ce8ccce1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:34.771369 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4efbb3e7-e60f-4698-bf82-9990ce8ccce1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:34.772947 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4efbb3e7-e60f-4698-bf82-9990ce8ccce1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:34.776343 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4efbb3e7-e60f-4698-bf82-9990ce8ccce1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:34.783371 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4efbb3e7-e60f-4698-bf82-9990ce8ccce1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.317006 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=38 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:35.346591 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4efbb3e7-e60f-4698-bf82-9990ce8ccce1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:35.368040 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4efbb3e7-e60f-4698-bf82-9990ce8ccce1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1276 microversion: 2.1 time: 0.672781 Oct 04 20:34:35.379389 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 286/576] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:34 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1276 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:35.422352 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9aae848c-6207-45e7-a1e8-5926e9df5c9a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:35.423942 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9aae848c-6207-45e7-a1e8-5926e9df5c9a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:35.438679 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9aae848c-6207-45e7-a1e8-5926e9df5c9a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.439699 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9aae848c-6207-45e7-a1e8-5926e9df5c9a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.440469 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9aae848c-6207-45e7-a1e8-5926e9df5c9a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.442718 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9aae848c-6207-45e7-a1e8-5926e9df5c9a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.447589 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9aae848c-6207-45e7-a1e8-5926e9df5c9a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.448661 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9aae848c-6207-45e7-a1e8-5926e9df5c9a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.756337 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9aae848c-6207-45e7-a1e8-5926e9df5c9a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:35.775601 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9aae848c-6207-45e7-a1e8-5926e9df5c9a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:35.779030 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9aae848c-6207-45e7-a1e8-5926e9df5c9a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:35.812009 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9aae848c-6207-45e7-a1e8-5926e9df5c9a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1445 microversion: 2.75 time: 0.424894 Oct 04 20:34:35.821149 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 287/577] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:35 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1445 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:35.841431 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-20eac229-449e-42ed-8ef3-b83ba4ba7dfe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:35.844034 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-20eac229-449e-42ed-8ef3-b83ba4ba7dfe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:35.858585 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20eac229-449e-42ed-8ef3-b83ba4ba7dfe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.859904 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20eac229-449e-42ed-8ef3-b83ba4ba7dfe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.860961 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20eac229-449e-42ed-8ef3-b83ba4ba7dfe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.862793 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20eac229-449e-42ed-8ef3-b83ba4ba7dfe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.864021 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20eac229-449e-42ed-8ef3-b83ba4ba7dfe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.865026 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20eac229-449e-42ed-8ef3-b83ba4ba7dfe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:36.367639 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:36.627488 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:37.070270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-20eac229-449e-42ed-8ef3-b83ba4ba7dfe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:37.086075 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-20eac229-449e-42ed-8ef3-b83ba4ba7dfe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 200 len: 1461 microversion: 2.1 time: 1.262864 Oct 04 20:34:37.092584 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 288/578] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:35 2022] GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 1461 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:37.120793 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-914697792", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:37.255286 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=73 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:37.396784 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:38.448762 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:39.350522 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:39.353371 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:39.354703 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:39.359242 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:39.359242 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:39.430277 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.438256 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.439876 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.442278 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.443668 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.449485 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.530296 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Getting quotas for project 7e024c248dfa402e9aa19677dd749c9f. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:39.539669 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Getting quotas for user 7caebe70d8da45aebdeeae629801512c and project 7e024c248dfa402e9aa19677dd749c9f. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:39.565206 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:39.571552 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:39.951443 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-97f9dda0-be5b-4bc7-8012-6f8a9c047b99 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.855710 Oct 04 20:34:39.959428 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 289/579] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:34:39.968575 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-06fc9a5c-24f1-4f6e-bb92-d3bd4fee4424 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:39.970613 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-06fc9a5c-24f1-4f6e-bb92-d3bd4fee4424 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:39.995191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-06fc9a5c-24f1-4f6e-bb92-d3bd4fee4424 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.996589 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-06fc9a5c-24f1-4f6e-bb92-d3bd4fee4424 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.998295 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-06fc9a5c-24f1-4f6e-bb92-d3bd4fee4424 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:40.001898 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-06fc9a5c-24f1-4f6e-bb92-d3bd4fee4424 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:40.003694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-06fc9a5c-24f1-4f6e-bb92-d3bd4fee4424 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:40.005241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-06fc9a5c-24f1-4f6e-bb92-d3bd4fee4424 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:40.988940 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-06fc9a5c-24f1-4f6e-bb92-d3bd4fee4424 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:41.009998 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-06fc9a5c-24f1-4f6e-bb92-d3bd4fee4424 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1318 microversion: 2.1 time: 1.050912 Oct 04 20:34:41.011758 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 290/580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:39 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1318 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:41.021837 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2a5dc8d3-ba95-48c3-abbd-fc47b2716096 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:41.023685 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2a5dc8d3-ba95-48c3-abbd-fc47b2716096 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:41.036948 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a5dc8d3-ba95-48c3-abbd-fc47b2716096 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.038857 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a5dc8d3-ba95-48c3-abbd-fc47b2716096 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.040147 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a5dc8d3-ba95-48c3-abbd-fc47b2716096 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.041895 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a5dc8d3-ba95-48c3-abbd-fc47b2716096 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.043161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a5dc8d3-ba95-48c3-abbd-fc47b2716096 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.044382 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a5dc8d3-ba95-48c3-abbd-fc47b2716096 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.405994 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2a5dc8d3-ba95-48c3-abbd-fc47b2716096 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:41.437109 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2a5dc8d3-ba95-48c3-abbd-fc47b2716096 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:41.440417 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2a5dc8d3-ba95-48c3-abbd-fc47b2716096 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:41.452616 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2a5dc8d3-ba95-48c3-abbd-fc47b2716096 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1445 microversion: 2.75 time: 0.438487 Oct 04 20:34:41.459222 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 291/581] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:41 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1445 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:41.479728 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:41.489123 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:41.526444 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.527745 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.528210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.529549 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.530726 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.531807 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.699424 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-68579cbe-da00-4cb1-b5ba-282470e5b0f3 tempest-SecurityGroupsTestAdminJSON-1119633991 tempest-SecurityGroupsTestAdminJSON-1119633991-project-admin] 10.222.0.78 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11053 microversion: 2.1 time: 14.419387 Oct 04 20:34:41.701203 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 291/582] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Oct 4 20:34:27 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11053 bytes in 14425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:41.715885 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6d72b7c5-c6be-45ae-a806-fd06bbce7c51 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:41.717296 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-6d72b7c5-c6be-45ae-a806-fd06bbce7c51 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f3a19931-0f54-4ae7-a531-7a007541a689) Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:34:41.884513 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:34:41.886394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:34:41.888456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f3a19931-0f54-4ae7-a531-7a007541a689) Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:41.890264 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:41.892279 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Request method failure captured: Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3/action HTTP/1.1 Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 32 Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJiNhV16z4nc9-dvgN1oYsetPABmQ80TjNNMdhys6K47SL84YUPJDpCiDufhH6v6wucCeWAWpWRlL3sBxgSgOzZxFtoEU5iSlSP7PSv8nRhInko8xxLPpv2dozhhyMkCcqR6fHIamFhrC5KfY_KiAl6N23PBq4pT47eDAlx7uY-2aSk Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 74eef3bf938c491d8a2f5192ba598c19 Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-MigrationsAdminTest-1386345839 Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:34:41.900357 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74eef3bf938c491d8a2f5192ba598c19", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74eef3bf938c491d8a2f5192ba598c19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74eef3bf938c491d8a2f5192ba598c19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74eef3bf938c491d8a2f5192ba598c19"}]}] Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-MigrationsAdminTest-1386345839 Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 74eef3bf938c491d8a2f5192ba598c19 Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-MigrationsAdminTest-1386345839 Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-MigrationsAdminTest-1386345839-project Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 4360a08eed56405b99333776285fef3a Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-MigrationsAdminTest-1386345839-project Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: {"resize": {"flavorRef": "451"}} Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:34:41.901921 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'f5072682-0691-4542-a881-7f874a8d8ef3', 'body': {'resize': {'flavorRef': '451'}}} Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:34:41.902728 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:34:41.905497 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:34:41.907614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f3a19931-0f54-4ae7-a531-7a007541a689) Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:41.909632 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:34:41.920205 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:41.922177 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0417a767-4cb3-4a18-a280-27093afbf306 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "POST /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3/action" status: 500 len: 214 microversion: 2.1 time: 0.442116 Oct 04 20:34:41.922177 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 292/583] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:41 2022] POST /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3/action => generated 214 bytes in 446 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:34:41.936306 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-293c80d4-d463-4f7d-98bd-5a5a01c70a00 tempest-SecurityGroupsTestAdminJSON-1055982081 tempest-SecurityGroupsTestAdminJSON-1055982081-project] Calling method '.version_select at 0x7f77ef56f280>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:42.068433 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-6d72b7c5-c6be-45ae-a806-fd06bbce7c51 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:42.082960 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6d72b7c5-c6be-45ae-a806-fd06bbce7c51 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1221 microversion: 2.1 time: 0.377784 Oct 04 20:34:42.085732 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 292/584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:41 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1221 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:42.095500 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2df71ae5-5a6f-4f72-994b-20ab1d9f1ebd tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:42.126034 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2df71ae5-5a6f-4f72-994b-20ab1d9f1ebd tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037596 Oct 04 20:34:42.127985 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 293/585] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:34:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:42.139410 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2ce64c88-ca57-4220-99c4-d1118220536e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:42.142697 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2ce64c88-ca57-4220-99c4-d1118220536e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:42.159367 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2ce64c88-ca57-4220-99c4-d1118220536e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:42.161621 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2ce64c88-ca57-4220-99c4-d1118220536e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:42.163091 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2ce64c88-ca57-4220-99c4-d1118220536e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:42.165883 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2ce64c88-ca57-4220-99c4-d1118220536e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:42.165883 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2ce64c88-ca57-4220-99c4-d1118220536e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:42.166845 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2ce64c88-ca57-4220-99c4-d1118220536e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:42.894558 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-2ce64c88-ca57-4220-99c4-d1118220536e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:42.937429 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2ce64c88-ca57-4220-99c4-d1118220536e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1318 microversion: 2.1 time: 0.804343 Oct 04 20:34:42.938613 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 294/586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:42 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:42.953446 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0127ed51-783d-41fc-bd5f-6514e6091170 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-504611071", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:43.075464 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0127ed51-783d-41fc-bd5f-6514e6091170 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.125135 Oct 04 20:34:43.075464 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 295/587] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Oct 4 20:34:42 2022] POST /compute/v2.1/flavors => generated 498 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:43.091345 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a1f0b27b-548a-4a03-bd4a-4b2e4c5e4e0b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:43.093165 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a1f0b27b-548a-4a03-bd4a-4b2e4c5e4e0b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:43.106630 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1f0b27b-548a-4a03-bd4a-4b2e4c5e4e0b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.107548 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1f0b27b-548a-4a03-bd4a-4b2e4c5e4e0b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.108305 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1f0b27b-548a-4a03-bd4a-4b2e4c5e4e0b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.110479 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1f0b27b-548a-4a03-bd4a-4b2e4c5e4e0b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.113167 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1f0b27b-548a-4a03-bd4a-4b2e4c5e4e0b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.114977 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1f0b27b-548a-4a03-bd4a-4b2e4c5e4e0b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.138692 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-293c80d4-d463-4f7d-98bd-5a5a01c70a00 tempest-SecurityGroupsTestAdminJSON-1055982081 tempest-SecurityGroupsTestAdminJSON-1055982081-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 1.229853 Oct 04 20:34:43.152524 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 293/588] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Oct 4 20:34:41 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:43.177292 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-662d20d7-8e2e-420e-b68f-fe83b5e7d022 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:43.197462 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-662d20d7-8e2e-420e-b68f-fe83b5e7d022 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.042519 Oct 04 20:34:43.199175 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 294/589] 10.222.0.78 () {58 vars in 1182 bytes} [Tue Oct 4 20:34:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:34:43.210340 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-92adb395-f002-4f5b-8e6d-240abd59f430 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:43.212226 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-92adb395-f002-4f5b-8e6d-240abd59f430 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:43.249800 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-92adb395-f002-4f5b-8e6d-240abd59f430 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.253977 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-92adb395-f002-4f5b-8e6d-240abd59f430 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.258088 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-92adb395-f002-4f5b-8e6d-240abd59f430 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.263020 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-92adb395-f002-4f5b-8e6d-240abd59f430 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.264488 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-92adb395-f002-4f5b-8e6d-240abd59f430 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.265881 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-92adb395-f002-4f5b-8e6d-240abd59f430 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.610398 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a1f0b27b-548a-4a03-bd4a-4b2e4c5e4e0b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:43.626007 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-92adb395-f002-4f5b-8e6d-240abd59f430 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:43.645709 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a1f0b27b-548a-4a03-bd4a-4b2e4c5e4e0b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:43.649327 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a1f0b27b-548a-4a03-bd4a-4b2e4c5e4e0b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:43.658302 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-92adb395-f002-4f5b-8e6d-240abd59f430 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1217 microversion: 2.1 time: 0.454543 Oct 04 20:34:43.659628 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 295/590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:43 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1217 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:43.677773 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e23cd949-9c65-425e-b651-936bce3671ae tempest-SecurityGroupsTestAdminJSON-1119633991 tempest-SecurityGroupsTestAdminJSON-1119633991-project-admin] Calling method '.version_select at 0x7f77ef5f8a60>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:43.712604 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a1f0b27b-548a-4a03-bd4a-4b2e4c5e4e0b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1445 microversion: 2.75 time: 0.635738 Oct 04 20:34:43.716571 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 296/591] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:43 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1445 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:43.759522 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2003783815", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "3dd9b571-606f-4449-973e-3afbb6686838"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:43.994529 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:45.959732 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:45.960803 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:45.960803 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:45.961402 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:45.962152 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:45.995454 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:45.996545 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:45.998228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:45.998667 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.004575 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.012226 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.101148 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Getting quotas for project 74eef3bf938c491d8a2f5192ba598c19. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:46.122807 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e23cd949-9c65-425e-b651-936bce3671ae tempest-SecurityGroupsTestAdminJSON-1119633991 tempest-SecurityGroupsTestAdminJSON-1119633991-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/9c16a6a2-0acc-4e78-8dc5-09bdfbfdc034" status: 202 len: 0 microversion: 2.1 time: 2.455771 Oct 04 20:34:46.124652 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 296/592] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:34:43 2022] DELETE /compute/v2.1/os-security-groups/9c16a6a2-0acc-4e78-8dc5-09bdfbfdc034 => generated 0 bytes in 2464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:34:46.141896 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Getting quotas for user 4360a08eed56405b99333776285fef3a and project 74eef3bf938c491d8a2f5192ba598c19. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:46.148735 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-41601334-3f83-4bc8-9c52-295b84b2ceff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:46.152905 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-41601334-3f83-4bc8-9c52-295b84b2ceff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:46.185343 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-41601334-3f83-4bc8-9c52-295b84b2ceff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.188499 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Going to run 1 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:46.198631 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-41601334-3f83-4bc8-9c52-295b84b2ceff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.199636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-41601334-3f83-4bc8-9c52-295b84b2ceff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.201079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-41601334-3f83-4bc8-9c52-295b84b2ceff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.201812 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:46.202016 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-41601334-3f83-4bc8-9c52-295b84b2ceff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.210254 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-41601334-3f83-4bc8-9c52-295b84b2ceff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.633722 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bc2c0b96-98c0-4de1-bc7d-59db7f9617c7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.905041 Oct 04 20:34:46.641172 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 297/593] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:34:46.689552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-91b87365-12c8-4813-a90f-814a8bc11e7b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:46.695643 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-91b87365-12c8-4813-a90f-814a8bc11e7b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:46.724950 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-91b87365-12c8-4813-a90f-814a8bc11e7b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.725897 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-91b87365-12c8-4813-a90f-814a8bc11e7b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.726714 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-91b87365-12c8-4813-a90f-814a8bc11e7b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.739865 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-91b87365-12c8-4813-a90f-814a8bc11e7b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.739865 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-91b87365-12c8-4813-a90f-814a8bc11e7b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.739865 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-91b87365-12c8-4813-a90f-814a8bc11e7b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.254332 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-91b87365-12c8-4813-a90f-814a8bc11e7b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:47.277798 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-91b87365-12c8-4813-a90f-814a8bc11e7b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1279 microversion: 2.1 time: 0.632609 Oct 04 20:34:47.293874 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 298/594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:46 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1279 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:47.310250 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9805c076-1a1b-49da-8855-7145d59176a6 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:47.317228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9805c076-1a1b-49da-8855-7145d59176a6 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:47.345246 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9805c076-1a1b-49da-8855-7145d59176a6 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:47.353413 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9805c076-1a1b-49da-8855-7145d59176a6 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:47.354590 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9805c076-1a1b-49da-8855-7145d59176a6 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.356283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9805c076-1a1b-49da-8855-7145d59176a6 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:47.360978 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9805c076-1a1b-49da-8855-7145d59176a6 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:47.362291 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9805c076-1a1b-49da-8855-7145d59176a6 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.388153 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-41601334-3f83-4bc8-9c52-295b84b2ceff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:47.412902 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-41601334-3f83-4bc8-9c52-295b84b2ceff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1318 microversion: 2.1 time: 1.283400 Oct 04 20:34:47.412902 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 297/595] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:46 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1318 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:47.435968 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-58b04deb-618a-4cee-8b5f-59cb86e44f1f req-fa509daf-227a-4ba4-80cc-88bae6239fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75de593c-9f57-471f-a519-d97960ccde5f", "tag": "1d4c616d-0938-4b70-9e11-adcaef4edc51"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:47.488652 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-58b04deb-618a-4cee-8b5f-59cb86e44f1f req-fa509daf-227a-4ba4-80cc-88bae6239fc5 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:47.495173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-58b04deb-618a-4cee-8b5f-59cb86e44f1f req-fa509daf-227a-4ba4-80cc-88bae6239fc5 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:47.497388 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-58b04deb-618a-4cee-8b5f-59cb86e44f1f req-fa509daf-227a-4ba4-80cc-88bae6239fc5 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.579341 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-58b04deb-618a-4cee-8b5f-59cb86e44f1f req-fa509daf-227a-4ba4-80cc-88bae6239fc5 service nova] Creating event network-changed:1d4c616d-0938-4b70-9e11-adcaef4edc51 for instance 75de593c-9f57-471f-a519-d97960ccde5f on n-h2-852085-12 Oct 04 20:34:47.599113 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-58b04deb-618a-4cee-8b5f-59cb86e44f1f req-fa509daf-227a-4ba4-80cc-88bae6239fc5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182999 Oct 04 20:34:47.601346 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 298/596] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:47.618234 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-4df6b509-1b30-46ed-b14d-298f23375903 req-da03d3e1-a2ef-4c98-9b9e-7e1bdc658740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acea6767-d8a4-488e-8d07-1c7362778255", "tag": "883b816a-c7ca-4854-9627-ee3644556a24"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:47.669062 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-4df6b509-1b30-46ed-b14d-298f23375903 req-da03d3e1-a2ef-4c98-9b9e-7e1bdc658740 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:47.670031 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-4df6b509-1b30-46ed-b14d-298f23375903 req-da03d3e1-a2ef-4c98-9b9e-7e1bdc658740 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:47.676437 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-4df6b509-1b30-46ed-b14d-298f23375903 req-da03d3e1-a2ef-4c98-9b9e-7e1bdc658740 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.744348 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-4df6b509-1b30-46ed-b14d-298f23375903 req-da03d3e1-a2ef-4c98-9b9e-7e1bdc658740 service nova] Creating event network-changed:883b816a-c7ca-4854-9627-ee3644556a24 for instance acea6767-d8a4-488e-8d07-1c7362778255 on n-h2-852085-12 Oct 04 20:34:47.757418 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-4df6b509-1b30-46ed-b14d-298f23375903 req-da03d3e1-a2ef-4c98-9b9e-7e1bdc658740 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151864 Oct 04 20:34:47.759324 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 299/597] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:47.771503 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0bc45e09-df14-43c8-9e15-5af9f69074b9 tempest-SecurityGroupsTestAdminJSON-1119633991 tempest-SecurityGroupsTestAdminJSON-1119633991-project-admin] Calling method '.version_select at 0x7f77ef749f70>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:47.938847 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9805c076-1a1b-49da-8855-7145d59176a6 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:47.992249 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9805c076-1a1b-49da-8855-7145d59176a6 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:47.998610 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9805c076-1a1b-49da-8855-7145d59176a6 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:48.028943 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9805c076-1a1b-49da-8855-7145d59176a6 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1445 microversion: 2.75 time: 0.728211 Oct 04 20:34:48.030749 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 299/598] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:47 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1445 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:48.061020 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-10c8e9cf-21d9-4ef9-b9ca-0657a9ee87f3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:48.062715 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-10c8e9cf-21d9-4ef9-b9ca-0657a9ee87f3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:48.311704 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-10c8e9cf-21d9-4ef9-b9ca-0657a9ee87f3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:48.328562 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-10c8e9cf-21d9-4ef9-b9ca-0657a9ee87f3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1279 microversion: 2.1 time: 0.293998 Oct 04 20:34:48.329925 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 300/599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:48 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1279 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:48.343450 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9c795ca5-8a8f-4a3e-94fe-b69ec77500a7 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:48.345155 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9c795ca5-8a8f-4a3e-94fe-b69ec77500a7 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:48.358230 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c795ca5-8a8f-4a3e-94fe-b69ec77500a7 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.361754 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c795ca5-8a8f-4a3e-94fe-b69ec77500a7 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.361754 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c795ca5-8a8f-4a3e-94fe-b69ec77500a7 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.361754 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c795ca5-8a8f-4a3e-94fe-b69ec77500a7 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.362320 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c795ca5-8a8f-4a3e-94fe-b69ec77500a7 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.363474 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c795ca5-8a8f-4a3e-94fe-b69ec77500a7 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.672064 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9c795ca5-8a8f-4a3e-94fe-b69ec77500a7 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:48.711666 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9c795ca5-8a8f-4a3e-94fe-b69ec77500a7 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1279 microversion: 2.1 time: 0.373636 Oct 04 20:34:48.716675 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 301/600] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:48 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1279 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:48.776121 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-895e980d-2681-4d0a-bb77-4d81eddef812 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:48.776288 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-895e980d-2681-4d0a-bb77-4d81eddef812 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:48.801360 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-895e980d-2681-4d0a-bb77-4d81eddef812 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.804707 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-895e980d-2681-4d0a-bb77-4d81eddef812 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.806627 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-895e980d-2681-4d0a-bb77-4d81eddef812 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.816904 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-895e980d-2681-4d0a-bb77-4d81eddef812 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.818516 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-895e980d-2681-4d0a-bb77-4d81eddef812 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.819858 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-895e980d-2681-4d0a-bb77-4d81eddef812 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.142713 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0bc45e09-df14-43c8-9e15-5af9f69074b9 tempest-SecurityGroupsTestAdminJSON-1119633991 tempest-SecurityGroupsTestAdminJSON-1119633991-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/12527032-64f9-4b32-8cb8-6976ac9cf964" status: 202 len: 0 microversion: 2.1 time: 1.380942 Oct 04 20:34:49.148916 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 300/601] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:34:47 2022] DELETE /compute/v2.1/os-security-groups/12527032-64f9-4b32-8cb8-6976ac9cf964 => generated 0 bytes in 1389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:34:49.177260 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d83ddba5-827f-4876-a4b0-77b0c10f069f tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:49.179610 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d83ddba5-827f-4876-a4b0-77b0c10f069f tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:49.218025 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d83ddba5-827f-4876-a4b0-77b0c10f069f tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.230263 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d83ddba5-827f-4876-a4b0-77b0c10f069f tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.231383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d83ddba5-827f-4876-a4b0-77b0c10f069f tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.232443 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d83ddba5-827f-4876-a4b0-77b0c10f069f tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.233672 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d83ddba5-827f-4876-a4b0-77b0c10f069f tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.234481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d83ddba5-827f-4876-a4b0-77b0c10f069f tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.427872 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d83ddba5-827f-4876-a4b0-77b0c10f069f tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:49.447980 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d83ddba5-827f-4876-a4b0-77b0c10f069f tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:49.451782 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d83ddba5-827f-4876-a4b0-77b0c10f069f tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:49.462053 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d83ddba5-827f-4876-a4b0-77b0c10f069f tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1445 microversion: 2.75 time: 0.305182 Oct 04 20:34:49.462280 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-895e980d-2681-4d0a-bb77-4d81eddef812 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:49.475946 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 301/602] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:49 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1445 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:49.482203 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-895e980d-2681-4d0a-bb77-4d81eddef812 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1318 microversion: 2.1 time: 0.741060 Oct 04 20:34:49.484248 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 302/603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:48 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1318 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:49.498029 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3dfe1e08-9cfc-4c0c-86bb-2836ee3aca9f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:49.499959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3dfe1e08-9cfc-4c0c-86bb-2836ee3aca9f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:49.514080 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e4889135-e1f2-4a88-8b32-c0bb4927216a tempest-SecurityGroupsTestAdminJSON-1055982081 tempest-SecurityGroupsTestAdminJSON-1055982081-project] Calling method '.version_select at 0x7f77ef4970d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:49.525805 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:49.557434 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=6 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:49.779825 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3dfe1e08-9cfc-4c0c-86bb-2836ee3aca9f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:49.816469 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3dfe1e08-9cfc-4c0c-86bb-2836ee3aca9f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1279 microversion: 2.1 time: 0.328711 Oct 04 20:34:49.831997 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 303/604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:49 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1279 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:49.836711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9032c5c6-932f-402d-a67b-fe32cefc113e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:49.839873 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9032c5c6-932f-402d-a67b-fe32cefc113e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:49.872812 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9032c5c6-932f-402d-a67b-fe32cefc113e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.877749 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9032c5c6-932f-402d-a67b-fe32cefc113e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.884742 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9032c5c6-932f-402d-a67b-fe32cefc113e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.891963 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9032c5c6-932f-402d-a67b-fe32cefc113e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.896431 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9032c5c6-932f-402d-a67b-fe32cefc113e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.897727 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9032c5c6-932f-402d-a67b-fe32cefc113e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.775576 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9032c5c6-932f-402d-a67b-fe32cefc113e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:51.802750 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9032c5c6-932f-402d-a67b-fe32cefc113e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 1.976290 Oct 04 20:34:51.804855 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 304/605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:49 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:51.818666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-85d35813-9db8-4038-9c79-878863ff9e64 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:51.821310 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-85d35813-9db8-4038-9c79-878863ff9e64 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:51.834870 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-85d35813-9db8-4038-9c79-878863ff9e64 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.844734 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-85d35813-9db8-4038-9c79-878863ff9e64 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.845893 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-85d35813-9db8-4038-9c79-878863ff9e64 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.847088 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-85d35813-9db8-4038-9c79-878863ff9e64 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.847951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-85d35813-9db8-4038-9c79-878863ff9e64 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.848693 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-85d35813-9db8-4038-9c79-878863ff9e64 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.967273 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-85d35813-9db8-4038-9c79-878863ff9e64 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:51.993406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-85d35813-9db8-4038-9c79-878863ff9e64 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:51.997891 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-85d35813-9db8-4038-9c79-878863ff9e64 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:52.025272 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-85d35813-9db8-4038-9c79-878863ff9e64 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1445 microversion: 2.75 time: 0.214377 Oct 04 20:34:52.027210 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 305/606] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:51 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1445 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:52.042937 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3253182f-eba8-4350-a972-47b3400edbcc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:52.044628 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3253182f-eba8-4350-a972-47b3400edbcc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:52.058416 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3253182f-eba8-4350-a972-47b3400edbcc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.060533 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3253182f-eba8-4350-a972-47b3400edbcc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.068810 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3253182f-eba8-4350-a972-47b3400edbcc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.071875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3253182f-eba8-4350-a972-47b3400edbcc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.074348 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3253182f-eba8-4350-a972-47b3400edbcc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.075426 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3253182f-eba8-4350-a972-47b3400edbcc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.392550 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3253182f-eba8-4350-a972-47b3400edbcc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:52.418940 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3253182f-eba8-4350-a972-47b3400edbcc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1318 microversion: 2.1 time: 0.387577 Oct 04 20:34:52.447526 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 306/607] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:52 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:52.465562 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e4889135-e1f2-4a88-8b32-c0bb4927216a tempest-SecurityGroupsTestAdminJSON-1055982081 tempest-SecurityGroupsTestAdminJSON-1055982081-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/840faa52-a5df-4f30-a877-17ad77727f51" status: 202 len: 0 microversion: 2.1 time: 2.987092 Oct 04 20:34:52.467036 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 302/608] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:34:49 2022] DELETE /compute/v2.1/os-security-groups/840faa52-a5df-4f30-a877-17ad77727f51 => generated 0 bytes in 2990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:34:52.472066 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-59a70e4e-e3b2-4efb-9881-4bce40905058 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:52.482819 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f102b414-70a3-43fb-96c8-608ac3602b12 tempest-SecurityGroupsTestAdminJSON-1055982081 tempest-SecurityGroupsTestAdminJSON-1055982081-project] Calling method '.version_select at 0x7f77ef57fa60>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:52.486629 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-59a70e4e-e3b2-4efb-9881-4bce40905058 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:52.513185 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59a70e4e-e3b2-4efb-9881-4bce40905058 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.515666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59a70e4e-e3b2-4efb-9881-4bce40905058 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.517441 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59a70e4e-e3b2-4efb-9881-4bce40905058 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.519474 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59a70e4e-e3b2-4efb-9881-4bce40905058 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.523272 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59a70e4e-e3b2-4efb-9881-4bce40905058 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.524599 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59a70e4e-e3b2-4efb-9881-4bce40905058 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.021132 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-59a70e4e-e3b2-4efb-9881-4bce40905058 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:53.054221 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-59a70e4e-e3b2-4efb-9881-4bce40905058 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1331 microversion: 2.1 time: 0.604339 Oct 04 20:34:53.056202 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 307/609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:52 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1331 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:53.072923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d1fe4bd8-ace7-4846-8972-9edfb7e30989 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:53.081496 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d1fe4bd8-ace7-4846-8972-9edfb7e30989 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:53.116819 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d1fe4bd8-ace7-4846-8972-9edfb7e30989 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.118105 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d1fe4bd8-ace7-4846-8972-9edfb7e30989 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.122514 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d1fe4bd8-ace7-4846-8972-9edfb7e30989 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.122514 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d1fe4bd8-ace7-4846-8972-9edfb7e30989 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.122514 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d1fe4bd8-ace7-4846-8972-9edfb7e30989 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.126649 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d1fe4bd8-ace7-4846-8972-9edfb7e30989 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.757388 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-d1fe4bd8-ace7-4846-8972-9edfb7e30989 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:53.779359 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d1fe4bd8-ace7-4846-8972-9edfb7e30989 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 0.714045 Oct 04 20:34:53.780524 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 308/610] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:53 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:53.826935 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4857b0f1-a627-4b68-86b6-6d36119a288a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:53.830200 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4857b0f1-a627-4b68-86b6-6d36119a288a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:53.874680 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4857b0f1-a627-4b68-86b6-6d36119a288a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.877835 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4857b0f1-a627-4b68-86b6-6d36119a288a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.880242 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4857b0f1-a627-4b68-86b6-6d36119a288a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.883294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4857b0f1-a627-4b68-86b6-6d36119a288a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.884640 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4857b0f1-a627-4b68-86b6-6d36119a288a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.886064 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4857b0f1-a627-4b68-86b6-6d36119a288a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.238448 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4857b0f1-a627-4b68-86b6-6d36119a288a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:54.280232 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4857b0f1-a627-4b68-86b6-6d36119a288a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:54.288121 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4857b0f1-a627-4b68-86b6-6d36119a288a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:54.304587 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4857b0f1-a627-4b68-86b6-6d36119a288a tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1445 microversion: 2.75 time: 0.521305 Oct 04 20:34:54.308317 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 309/611] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:53 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1445 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:54.324238 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-531580c3-ae60-40f6-b9db-68aa9c21af6a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:54.329627 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-531580c3-ae60-40f6-b9db-68aa9c21af6a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:54.351276 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-531580c3-ae60-40f6-b9db-68aa9c21af6a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.353414 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-531580c3-ae60-40f6-b9db-68aa9c21af6a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.355085 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-531580c3-ae60-40f6-b9db-68aa9c21af6a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.357224 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-531580c3-ae60-40f6-b9db-68aa9c21af6a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.358152 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-531580c3-ae60-40f6-b9db-68aa9c21af6a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.359306 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-531580c3-ae60-40f6-b9db-68aa9c21af6a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.390944 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f102b414-70a3-43fb-96c8-608ac3602b12 tempest-SecurityGroupsTestAdminJSON-1055982081 tempest-SecurityGroupsTestAdminJSON-1055982081-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/24aa28a5-675f-4b47-8ab6-66399e046160" status: 202 len: 0 microversion: 2.1 time: 1.916549 Oct 04 20:34:54.392771 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 303/612] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:34:52 2022] DELETE /compute/v2.1/os-security-groups/24aa28a5-675f-4b47-8ab6-66399e046160 => generated 0 bytes in 1920 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:34:54.411030 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f77fc840-bb2f-4e4a-b08c-f9eacad948be tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:54.413192 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f77fc840-bb2f-4e4a-b08c-f9eacad948be tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:54.453480 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f77fc840-bb2f-4e4a-b08c-f9eacad948be tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.458937 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f77fc840-bb2f-4e4a-b08c-f9eacad948be tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.461830 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f77fc840-bb2f-4e4a-b08c-f9eacad948be tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.466247 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f77fc840-bb2f-4e4a-b08c-f9eacad948be tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.467715 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f77fc840-bb2f-4e4a-b08c-f9eacad948be tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.473649 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f77fc840-bb2f-4e4a-b08c-f9eacad948be tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.862792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f77fc840-bb2f-4e4a-b08c-f9eacad948be tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:54.896912 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f77fc840-bb2f-4e4a-b08c-f9eacad948be tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1331 microversion: 2.1 time: 0.502002 Oct 04 20:34:54.900827 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 304/613] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:54 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1331 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:54.926045 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3933b7d9-752c-4b4c-b76e-d47ed71b988f tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:54.930799 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3933b7d9-752c-4b4c-b76e-d47ed71b988f tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:54.953527 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3933b7d9-752c-4b4c-b76e-d47ed71b988f tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.954503 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3933b7d9-752c-4b4c-b76e-d47ed71b988f tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.955481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3933b7d9-752c-4b4c-b76e-d47ed71b988f tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.956914 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3933b7d9-752c-4b4c-b76e-d47ed71b988f tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.957975 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3933b7d9-752c-4b4c-b76e-d47ed71b988f tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.958793 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3933b7d9-752c-4b4c-b76e-d47ed71b988f tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.058213 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:56.092216 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-531580c3-ae60-40f6-b9db-68aa9c21af6a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:56.146597 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-531580c3-ae60-40f6-b9db-68aa9c21af6a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1318 microversion: 2.1 time: 1.827751 Oct 04 20:34:56.150185 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 310/614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:54 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1318 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:56.182661 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-206cee5b-0835-41d8-9a8b-e97c0c87c8f9 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:56.192721 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-206cee5b-0835-41d8-9a8b-e97c0c87c8f9 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:56.224874 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-206cee5b-0835-41d8-9a8b-e97c0c87c8f9 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.225767 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-206cee5b-0835-41d8-9a8b-e97c0c87c8f9 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.226569 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-206cee5b-0835-41d8-9a8b-e97c0c87c8f9 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.236235 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-206cee5b-0835-41d8-9a8b-e97c0c87c8f9 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.239004 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-206cee5b-0835-41d8-9a8b-e97c0c87c8f9 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.240352 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-206cee5b-0835-41d8-9a8b-e97c0c87c8f9 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.773373 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-206cee5b-0835-41d8-9a8b-e97c0c87c8f9 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:56.822862 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3933b7d9-752c-4b4c-b76e-d47ed71b988f tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:56.824107 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-206cee5b-0835-41d8-9a8b-e97c0c87c8f9 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:56.838039 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-206cee5b-0835-41d8-9a8b-e97c0c87c8f9 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:56.856055 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-206cee5b-0835-41d8-9a8b-e97c0c87c8f9 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1445 microversion: 2.75 time: 0.703416 Oct 04 20:34:56.863188 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 311/615] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:56 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1445 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:56.874109 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3933b7d9-752c-4b4c-b76e-d47ed71b988f tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 1.970208 Oct 04 20:34:56.877039 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 305/616] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:54 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:56.907082 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-670e6c6d-9697-425d-bea2-13fd9329d450 req-f49d4e19-a918-4100-93d3-12714d062502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75de593c-9f57-471f-a519-d97960ccde5f", "name": "network-vif-plugged", "status": "completed", "tag": "1d4c616d-0938-4b70-9e11-adcaef4edc51"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:56.921991 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0cb6edd5-4405-4625-8378-bb014ce27833 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:56.923638 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0cb6edd5-4405-4625-8378-bb014ce27833 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:56.935315 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-670e6c6d-9697-425d-bea2-13fd9329d450 req-f49d4e19-a918-4100-93d3-12714d062502 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.936909 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-670e6c6d-9697-425d-bea2-13fd9329d450 req-f49d4e19-a918-4100-93d3-12714d062502 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.939335 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-670e6c6d-9697-425d-bea2-13fd9329d450 req-f49d4e19-a918-4100-93d3-12714d062502 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.958387 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0cb6edd5-4405-4625-8378-bb014ce27833 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.959717 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0cb6edd5-4405-4625-8378-bb014ce27833 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.960666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0cb6edd5-4405-4625-8378-bb014ce27833 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.962212 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0cb6edd5-4405-4625-8378-bb014ce27833 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.963309 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0cb6edd5-4405-4625-8378-bb014ce27833 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.964265 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0cb6edd5-4405-4625-8378-bb014ce27833 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.981017 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-670e6c6d-9697-425d-bea2-13fd9329d450 req-f49d4e19-a918-4100-93d3-12714d062502 service nova] Creating event network-vif-plugged:1d4c616d-0938-4b70-9e11-adcaef4edc51 for instance 75de593c-9f57-471f-a519-d97960ccde5f on n-h2-852085-12 Oct 04 20:34:57.022739 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-670e6c6d-9697-425d-bea2-13fd9329d450 req-f49d4e19-a918-4100-93d3-12714d062502 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143311 Oct 04 20:34:57.024698 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 306/617] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:57.204814 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8b32cfbd-f541-4a2d-bcf6-cb2ba5ef97f3 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:57.208911 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8b32cfbd-f541-4a2d-bcf6-cb2ba5ef97f3 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:57.235654 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8b32cfbd-f541-4a2d-bcf6-cb2ba5ef97f3 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.237096 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8b32cfbd-f541-4a2d-bcf6-cb2ba5ef97f3 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.241386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8b32cfbd-f541-4a2d-bcf6-cb2ba5ef97f3 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.246859 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8b32cfbd-f541-4a2d-bcf6-cb2ba5ef97f3 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.248270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8b32cfbd-f541-4a2d-bcf6-cb2ba5ef97f3 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.249459 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8b32cfbd-f541-4a2d-bcf6-cb2ba5ef97f3 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.263962 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:57.610131 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0cb6edd5-4405-4625-8378-bb014ce27833 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:57.638399 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0cb6edd5-4405-4625-8378-bb014ce27833 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1339 microversion: 2.1 time: 0.769165 Oct 04 20:34:57.666876 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 312/618] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:56 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1339 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:57.935168 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-634ce869-6cb2-45e8-ae25-2a8034f858cb tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:57.939577 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-634ce869-6cb2-45e8-ae25-2a8034f858cb tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:57.960789 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-634ce869-6cb2-45e8-ae25-2a8034f858cb tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.961793 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-634ce869-6cb2-45e8-ae25-2a8034f858cb tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.963606 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-634ce869-6cb2-45e8-ae25-2a8034f858cb tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.964847 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-634ce869-6cb2-45e8-ae25-2a8034f858cb tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.966975 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-634ce869-6cb2-45e8-ae25-2a8034f858cb tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.968049 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-634ce869-6cb2-45e8-ae25-2a8034f858cb tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.949402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8b32cfbd-f541-4a2d-bcf6-cb2ba5ef97f3 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:58.986572 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-634ce869-6cb2-45e8-ae25-2a8034f858cb tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:58.988197 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8b32cfbd-f541-4a2d-bcf6-cb2ba5ef97f3 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1318 microversion: 2.1 time: 1.780983 Oct 04 20:34:58.990930 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 307/619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:57 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1318 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:59.022708 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7cb7b612-3fa5-4535-ba86-111cd396c998 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:59.028148 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7cb7b612-3fa5-4535-ba86-111cd396c998 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:59.034765 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-634ce869-6cb2-45e8-ae25-2a8034f858cb tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 1.114352 Oct 04 20:34:59.037410 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 313/620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:57 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:59.048061 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cc5c5996-b155-4f30-b691-1d61d918b3e9 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:59.051181 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-cc5c5996-b155-4f30-b691-1d61d918b3e9 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:59.067169 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cc5c5996-b155-4f30-b691-1d61d918b3e9 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.068950 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cc5c5996-b155-4f30-b691-1d61d918b3e9 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.070356 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cc5c5996-b155-4f30-b691-1d61d918b3e9 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.073385 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cc5c5996-b155-4f30-b691-1d61d918b3e9 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.074864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cc5c5996-b155-4f30-b691-1d61d918b3e9 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.081823 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cc5c5996-b155-4f30-b691-1d61d918b3e9 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.090040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=100 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:59.096958 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:59.107051 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cb7b612-3fa5-4535-ba86-111cd396c998 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.107847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cb7b612-3fa5-4535-ba86-111cd396c998 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.110225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cb7b612-3fa5-4535-ba86-111cd396c998 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.116433 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cb7b612-3fa5-4535-ba86-111cd396c998 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.122201 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cb7b612-3fa5-4535-ba86-111cd396c998 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.126471 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cb7b612-3fa5-4535-ba86-111cd396c998 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.694993 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-cc5c5996-b155-4f30-b691-1d61d918b3e9 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:59.722079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7cb7b612-3fa5-4535-ba86-111cd396c998 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:59.752012 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cc5c5996-b155-4f30-b691-1d61d918b3e9 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1337 microversion: 2.1 time: 0.707288 Oct 04 20:34:59.755276 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 314/621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:59 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1337 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:59.777578 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7cb7b612-3fa5-4535-ba86-111cd396c998 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:59.780331 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7cb7b612-3fa5-4535-ba86-111cd396c998 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:59.794824 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-bd77ca78-8a4e-41a5-94f4-a6bd74b1acab req-42527701-e2b8-4e24-bf8e-a029cdab873e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa10127f-3488-4ff2-ac91-5411815abde8", "tag": "e2b12abe-be90-4826-bd13-1dc771ab7219"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:59.811325 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7cb7b612-3fa5-4535-ba86-111cd396c998 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1445 microversion: 2.75 time: 0.816052 Oct 04 20:34:59.819598 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 308/622] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:58 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1445 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:59.820819 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=12 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:59.850947 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-bd77ca78-8a4e-41a5-94f4-a6bd74b1acab req-42527701-e2b8-4e24-bf8e-a029cdab873e service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.851793 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-bd77ca78-8a4e-41a5-94f4-a6bd74b1acab req-42527701-e2b8-4e24-bf8e-a029cdab873e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.865154 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-bd77ca78-8a4e-41a5-94f4-a6bd74b1acab req-42527701-e2b8-4e24-bf8e-a029cdab873e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.904983 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-bd77ca78-8a4e-41a5-94f4-a6bd74b1acab req-42527701-e2b8-4e24-bf8e-a029cdab873e service nova] Creating event network-changed:e2b12abe-be90-4826-bd13-1dc771ab7219 for instance aa10127f-3488-4ff2-ac91-5411815abde8 on n-h1-852085-12 Oct 04 20:34:59.934446 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-bd77ca78-8a4e-41a5-94f4-a6bd74b1acab req-42527701-e2b8-4e24-bf8e-a029cdab873e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167691 Oct 04 20:34:59.939378 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 315/623] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:00.033116 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7e9dde11-1245-477a-823c-ea297a6313a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:00.034446 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7e9dde11-1245-477a-823c-ea297a6313a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:00.059065 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7e9dde11-1245-477a-823c-ea297a6313a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.071232 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7e9dde11-1245-477a-823c-ea297a6313a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.074198 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7e9dde11-1245-477a-823c-ea297a6313a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.076830 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7e9dde11-1245-477a-823c-ea297a6313a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.078208 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7e9dde11-1245-477a-823c-ea297a6313a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.082447 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7e9dde11-1245-477a-823c-ea297a6313a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.091114 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-25ce1f0e-9036-45bd-a5d3-d8d0642a1e5c tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:00.105612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-25ce1f0e-9036-45bd-a5d3-d8d0642a1e5c tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:00.144105 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25ce1f0e-9036-45bd-a5d3-d8d0642a1e5c tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.145726 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25ce1f0e-9036-45bd-a5d3-d8d0642a1e5c tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.150151 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25ce1f0e-9036-45bd-a5d3-d8d0642a1e5c tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.152255 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25ce1f0e-9036-45bd-a5d3-d8d0642a1e5c tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.154435 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25ce1f0e-9036-45bd-a5d3-d8d0642a1e5c tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.158057 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25ce1f0e-9036-45bd-a5d3-d8d0642a1e5c tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.150092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-25ce1f0e-9036-45bd-a5d3-d8d0642a1e5c tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:01.203600 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-25ce1f0e-9036-45bd-a5d3-d8d0642a1e5c tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 1.128774 Oct 04 20:35:01.227354 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 316/624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:00 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:01.261205 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a746e800-30ab-43b0-be8a-81bf40d81b29 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:01.262864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a746e800-30ab-43b0-be8a-81bf40d81b29 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:01.287475 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a746e800-30ab-43b0-be8a-81bf40d81b29 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.288867 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a746e800-30ab-43b0-be8a-81bf40d81b29 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.289984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a746e800-30ab-43b0-be8a-81bf40d81b29 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.291857 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a746e800-30ab-43b0-be8a-81bf40d81b29 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.292885 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a746e800-30ab-43b0-be8a-81bf40d81b29 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.293918 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a746e800-30ab-43b0-be8a-81bf40d81b29 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.389682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7e9dde11-1245-477a-823c-ea297a6313a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:01.458924 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7e9dde11-1245-477a-823c-ea297a6313a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1318 microversion: 2.1 time: 1.428262 Oct 04 20:35:01.463049 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 309/625] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:00 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1318 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:01.479745 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-92f54085-0677-4177-91ae-2201c02a321d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:01.481672 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-92f54085-0677-4177-91ae-2201c02a321d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:01.498841 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-92f54085-0677-4177-91ae-2201c02a321d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.506323 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-92f54085-0677-4177-91ae-2201c02a321d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.506323 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-92f54085-0677-4177-91ae-2201c02a321d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.519534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-92f54085-0677-4177-91ae-2201c02a321d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.521347 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-92f54085-0677-4177-91ae-2201c02a321d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.522482 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-92f54085-0677-4177-91ae-2201c02a321d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.981665 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-92f54085-0677-4177-91ae-2201c02a321d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:02.048598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-92f54085-0677-4177-91ae-2201c02a321d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:02.068639 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-92f54085-0677-4177-91ae-2201c02a321d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:02.110431 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-92f54085-0677-4177-91ae-2201c02a321d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1445 microversion: 2.75 time: 0.641448 Oct 04 20:35:02.122348 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 310/626] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:01 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1445 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:02.269210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-140ab974-d1e2-4367-99ce-84abf49c1350 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:02.273188 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-140ab974-d1e2-4367-99ce-84abf49c1350 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:02.302269 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-140ab974-d1e2-4367-99ce-84abf49c1350 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.305709 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-140ab974-d1e2-4367-99ce-84abf49c1350 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.308747 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-140ab974-d1e2-4367-99ce-84abf49c1350 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.310439 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-140ab974-d1e2-4367-99ce-84abf49c1350 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.316366 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-140ab974-d1e2-4367-99ce-84abf49c1350 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.318505 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-140ab974-d1e2-4367-99ce-84abf49c1350 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.533162 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a746e800-30ab-43b0-be8a-81bf40d81b29 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:02.568508 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a746e800-30ab-43b0-be8a-81bf40d81b29 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1379 microversion: 2.1 time: 1.312294 Oct 04 20:35:02.573220 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 317/627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:01 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1379 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:02.622264 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a6e96629-3d92-4501-b209-1280bc962887 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:02.623471 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a6e96629-3d92-4501-b209-1280bc962887 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:02.635941 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a6e96629-3d92-4501-b209-1280bc962887 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.636939 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a6e96629-3d92-4501-b209-1280bc962887 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.637832 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a6e96629-3d92-4501-b209-1280bc962887 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.639284 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a6e96629-3d92-4501-b209-1280bc962887 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.640212 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a6e96629-3d92-4501-b209-1280bc962887 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.641543 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a6e96629-3d92-4501-b209-1280bc962887 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.044455 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-140ab974-d1e2-4367-99ce-84abf49c1350 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:03.078203 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-140ab974-d1e2-4367-99ce-84abf49c1350 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 0.811017 Oct 04 20:35:03.079877 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 311/628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:02 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:03.182413 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-63787343-cb92-4dec-b927-befe47d38db1 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:03.183609 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-63787343-cb92-4dec-b927-befe47d38db1 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:03.202448 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-63787343-cb92-4dec-b927-befe47d38db1 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.202999 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-63787343-cb92-4dec-b927-befe47d38db1 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.203844 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-63787343-cb92-4dec-b927-befe47d38db1 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.205204 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-63787343-cb92-4dec-b927-befe47d38db1 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.211953 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-63787343-cb92-4dec-b927-befe47d38db1 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.212955 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-63787343-cb92-4dec-b927-befe47d38db1 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.415756 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a6e96629-3d92-4501-b209-1280bc962887 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:03.442741 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a6e96629-3d92-4501-b209-1280bc962887 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1318 microversion: 2.1 time: 0.839364 Oct 04 20:35:03.444468 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 318/629] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:02 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1318 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:03.623941 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3199bb63-eb36-430a-b2c2-167ed00bb24a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:03.636135 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3199bb63-eb36-430a-b2c2-167ed00bb24a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:03.650706 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-63787343-cb92-4dec-b927-befe47d38db1 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:03.665583 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3199bb63-eb36-430a-b2c2-167ed00bb24a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.669156 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3199bb63-eb36-430a-b2c2-167ed00bb24a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.672315 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3199bb63-eb36-430a-b2c2-167ed00bb24a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.676242 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3199bb63-eb36-430a-b2c2-167ed00bb24a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.681242 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3199bb63-eb36-430a-b2c2-167ed00bb24a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.683330 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3199bb63-eb36-430a-b2c2-167ed00bb24a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.686136 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-63787343-cb92-4dec-b927-befe47d38db1 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:03.694460 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-63787343-cb92-4dec-b927-befe47d38db1 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:03.731086 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-63787343-cb92-4dec-b927-befe47d38db1 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1451 microversion: 2.75 time: 0.556026 Oct 04 20:35:03.734928 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 312/630] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:03 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1451 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:03.980653 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-df402a98-cb2e-49f5-bfac-38ddada54d0e req-885124ec-546c-4500-8aae-9b383fee8d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acea6767-d8a4-488e-8d07-1c7362778255", "name": "network-vif-plugged", "status": "completed", "tag": "883b816a-c7ca-4854-9627-ee3644556a24"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:04.056068 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-df402a98-cb2e-49f5-bfac-38ddada54d0e req-885124ec-546c-4500-8aae-9b383fee8d3b service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.063716 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-df402a98-cb2e-49f5-bfac-38ddada54d0e req-885124ec-546c-4500-8aae-9b383fee8d3b service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.067457 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-df402a98-cb2e-49f5-bfac-38ddada54d0e req-885124ec-546c-4500-8aae-9b383fee8d3b service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.171465 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-df402a98-cb2e-49f5-bfac-38ddada54d0e req-885124ec-546c-4500-8aae-9b383fee8d3b service nova] Creating event network-vif-plugged:883b816a-c7ca-4854-9627-ee3644556a24 for instance acea6767-d8a4-488e-8d07-1c7362778255 on n-h2-852085-12 Oct 04 20:35:04.198084 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-df402a98-cb2e-49f5-bfac-38ddada54d0e req-885124ec-546c-4500-8aae-9b383fee8d3b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226208 Oct 04 20:35:04.205373 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 313/631] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:04.230074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3199bb63-eb36-430a-b2c2-167ed00bb24a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:04.233303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ce6c853f-1203-4e42-948c-03622f3432ee tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:04.234844 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ce6c853f-1203-4e42-948c-03622f3432ee tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:04.252984 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3199bb63-eb36-430a-b2c2-167ed00bb24a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1379 microversion: 2.1 time: 0.637859 Oct 04 20:35:04.262584 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 319/632] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:03 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1379 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:04.322839 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ce6c853f-1203-4e42-948c-03622f3432ee tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.333431 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ce6c853f-1203-4e42-948c-03622f3432ee tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.335952 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ce6c853f-1203-4e42-948c-03622f3432ee tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.348467 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ce6c853f-1203-4e42-948c-03622f3432ee tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.351493 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ce6c853f-1203-4e42-948c-03622f3432ee tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.356070 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ce6c853f-1203-4e42-948c-03622f3432ee tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.492146 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c20ec8a4-c810-4132-b433-b908069bef5e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:04.495503 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c20ec8a4-c810-4132-b433-b908069bef5e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:04.536436 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c20ec8a4-c810-4132-b433-b908069bef5e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.538794 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c20ec8a4-c810-4132-b433-b908069bef5e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.544444 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c20ec8a4-c810-4132-b433-b908069bef5e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.548594 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c20ec8a4-c810-4132-b433-b908069bef5e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.552524 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c20ec8a4-c810-4132-b433-b908069bef5e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.555416 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c20ec8a4-c810-4132-b433-b908069bef5e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.163704 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ce6c853f-1203-4e42-948c-03622f3432ee tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:05.216808 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ce6c853f-1203-4e42-948c-03622f3432ee tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 1.003692 Oct 04 20:35:05.223605 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 314/633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:04 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:05.260082 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c20ec8a4-c810-4132-b433-b908069bef5e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:05.273390 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-48a8b9b0-4c03-4fd4-9c39-0fe723d0eed5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:05.278492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-48a8b9b0-4c03-4fd4-9c39-0fe723d0eed5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:05.326537 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c20ec8a4-c810-4132-b433-b908069bef5e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1318 microversion: 2.1 time: 0.841759 Oct 04 20:35:05.357583 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 320/634] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:04 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1318 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:05.381150 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-49f758a9-81a1-4acc-8d01-a89760012a2b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:05.383924 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-49f758a9-81a1-4acc-8d01-a89760012a2b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:05.408816 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-48a8b9b0-4c03-4fd4-9c39-0fe723d0eed5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:05.421841 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-48a8b9b0-4c03-4fd4-9c39-0fe723d0eed5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:05.422660 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-48a8b9b0-4c03-4fd4-9c39-0fe723d0eed5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.424477 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49f758a9-81a1-4acc-8d01-a89760012a2b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:05.426626 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-48a8b9b0-4c03-4fd4-9c39-0fe723d0eed5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:05.427716 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-48a8b9b0-4c03-4fd4-9c39-0fe723d0eed5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:05.428530 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-48a8b9b0-4c03-4fd4-9c39-0fe723d0eed5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.432217 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49f758a9-81a1-4acc-8d01-a89760012a2b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:05.433048 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49f758a9-81a1-4acc-8d01-a89760012a2b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.436836 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49f758a9-81a1-4acc-8d01-a89760012a2b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:05.437705 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49f758a9-81a1-4acc-8d01-a89760012a2b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:05.438480 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49f758a9-81a1-4acc-8d01-a89760012a2b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.681627 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-48a8b9b0-4c03-4fd4-9c39-0fe723d0eed5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:05.732723 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-48a8b9b0-4c03-4fd4-9c39-0fe723d0eed5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:05.744736 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-48a8b9b0-4c03-4fd4-9c39-0fe723d0eed5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:05.770506 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-48a8b9b0-4c03-4fd4-9c39-0fe723d0eed5 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1451 microversion: 2.75 time: 0.531381 Oct 04 20:35:05.772101 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 315/635] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:05 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1451 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:06.130944 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-49f758a9-81a1-4acc-8d01-a89760012a2b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:06.162889 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-49f758a9-81a1-4acc-8d01-a89760012a2b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1379 microversion: 2.1 time: 0.803639 Oct 04 20:35:06.165255 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 321/636] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:05 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1379 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:06.279412 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-17d79765-eda7-4d32-aa2f-f67f9bd9b378 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:06.297021 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-17d79765-eda7-4d32-aa2f-f67f9bd9b378 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:06.323415 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17d79765-eda7-4d32-aa2f-f67f9bd9b378 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.324851 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17d79765-eda7-4d32-aa2f-f67f9bd9b378 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.330581 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17d79765-eda7-4d32-aa2f-f67f9bd9b378 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.330581 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17d79765-eda7-4d32-aa2f-f67f9bd9b378 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.331124 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17d79765-eda7-4d32-aa2f-f67f9bd9b378 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.332453 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17d79765-eda7-4d32-aa2f-f67f9bd9b378 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.411864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0ba6cdc5-e283-4bfe-b8ab-0a952f452c64 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:06.413089 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0ba6cdc5-e283-4bfe-b8ab-0a952f452c64 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:06.440387 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0ba6cdc5-e283-4bfe-b8ab-0a952f452c64 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.441317 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0ba6cdc5-e283-4bfe-b8ab-0a952f452c64 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.442110 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0ba6cdc5-e283-4bfe-b8ab-0a952f452c64 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.443464 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0ba6cdc5-e283-4bfe-b8ab-0a952f452c64 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.451096 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0ba6cdc5-e283-4bfe-b8ab-0a952f452c64 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.451943 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0ba6cdc5-e283-4bfe-b8ab-0a952f452c64 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.979987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-17d79765-eda7-4d32-aa2f-f67f9bd9b378 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:07.022613 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-17d79765-eda7-4d32-aa2f-f67f9bd9b378 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 0.761259 Oct 04 20:35:07.030407 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 316/637] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:06 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:07.089504 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ff7d8ffc-0369-4268-bd27-29e8e4df251d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:07.097796 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ff7d8ffc-0369-4268-bd27-29e8e4df251d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:07.145909 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff7d8ffc-0369-4268-bd27-29e8e4df251d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:07.155080 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff7d8ffc-0369-4268-bd27-29e8e4df251d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:07.156247 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff7d8ffc-0369-4268-bd27-29e8e4df251d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:07.157923 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff7d8ffc-0369-4268-bd27-29e8e4df251d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:07.167851 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff7d8ffc-0369-4268-bd27-29e8e4df251d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:07.167851 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff7d8ffc-0369-4268-bd27-29e8e4df251d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:07.334820 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0ba6cdc5-e283-4bfe-b8ab-0a952f452c64 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:07.369712 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0ba6cdc5-e283-4bfe-b8ab-0a952f452c64 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1318 microversion: 2.1 time: 0.992029 Oct 04 20:35:07.370766 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 322/638] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:06 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1318 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:07.411581 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f76dddd1-dfb2-41d0-879e-8011b256f878 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:07.412844 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f76dddd1-dfb2-41d0-879e-8011b256f878 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:07.429809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:07.429809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f76dddd1-dfb2-41d0-879e-8011b256f878 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:07.429809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f76dddd1-dfb2-41d0-879e-8011b256f878 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:07.430391 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f76dddd1-dfb2-41d0-879e-8011b256f878 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:07.431835 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f76dddd1-dfb2-41d0-879e-8011b256f878 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:07.432747 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f76dddd1-dfb2-41d0-879e-8011b256f878 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:07.433620 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f76dddd1-dfb2-41d0-879e-8011b256f878 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:07.469151 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ff7d8ffc-0369-4268-bd27-29e8e4df251d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:07.506698 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ff7d8ffc-0369-4268-bd27-29e8e4df251d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:07.517784 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ff7d8ffc-0369-4268-bd27-29e8e4df251d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:07.544402 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ff7d8ffc-0369-4268-bd27-29e8e4df251d tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1451 microversion: 2.75 time: 0.506589 Oct 04 20:35:07.578878 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 317/639] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:07 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1451 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:07.955073 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f76dddd1-dfb2-41d0-879e-8011b256f878 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:07.993358 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f76dddd1-dfb2-41d0-879e-8011b256f878 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1379 microversion: 2.1 time: 0.607644 Oct 04 20:35:07.995538 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 323/640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:07 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1379 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:08.089607 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1944d95f-fcaf-47da-a4f4-b85fc9b3d46e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:08.097222 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-1944d95f-fcaf-47da-a4f4-b85fc9b3d46e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:08.159024 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1944d95f-fcaf-47da-a4f4-b85fc9b3d46e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.164767 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1944d95f-fcaf-47da-a4f4-b85fc9b3d46e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.165054 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1944d95f-fcaf-47da-a4f4-b85fc9b3d46e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.188725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1944d95f-fcaf-47da-a4f4-b85fc9b3d46e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.190356 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1944d95f-fcaf-47da-a4f4-b85fc9b3d46e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.191507 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1944d95f-fcaf-47da-a4f4-b85fc9b3d46e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.321570 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-e0efc2e3-19be-436e-b98f-e10487eb0c33 req-34d7634e-7ce6-4051-b0df-3a94d535b1af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f57f25a-23a5-469a-bdab-c55a3d3a7201", "tag": "0c7adf8c-2e14-4eaa-bfab-9dbb2f275d44"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:08.379266 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e0efc2e3-19be-436e-b98f-e10487eb0c33 req-34d7634e-7ce6-4051-b0df-3a94d535b1af service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.388198 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e0efc2e3-19be-436e-b98f-e10487eb0c33 req-34d7634e-7ce6-4051-b0df-3a94d535b1af service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.389635 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e0efc2e3-19be-436e-b98f-e10487eb0c33 req-34d7634e-7ce6-4051-b0df-3a94d535b1af service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.448223 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-e0efc2e3-19be-436e-b98f-e10487eb0c33 req-34d7634e-7ce6-4051-b0df-3a94d535b1af service nova] Creating event network-changed:0c7adf8c-2e14-4eaa-bfab-9dbb2f275d44 for instance 0f57f25a-23a5-469a-bdab-c55a3d3a7201 on n-h2-852085-12 Oct 04 20:35:08.484352 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-e0efc2e3-19be-436e-b98f-e10487eb0c33 req-34d7634e-7ce6-4051-b0df-3a94d535b1af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156749 Oct 04 20:35:08.484352 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 324/641] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:35:08.503845 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dd1a2fe9-f922-42c3-8cf3-a7e3a5d44e3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:08.508022 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-dd1a2fe9-f922-42c3-8cf3-a7e3a5d44e3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:08.525381 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dd1a2fe9-f922-42c3-8cf3-a7e3a5d44e3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.526612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dd1a2fe9-f922-42c3-8cf3-a7e3a5d44e3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.527434 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dd1a2fe9-f922-42c3-8cf3-a7e3a5d44e3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.529000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dd1a2fe9-f922-42c3-8cf3-a7e3a5d44e3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.530209 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dd1a2fe9-f922-42c3-8cf3-a7e3a5d44e3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.531584 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dd1a2fe9-f922-42c3-8cf3-a7e3a5d44e3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.782893 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-1944d95f-fcaf-47da-a4f4-b85fc9b3d46e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:08.803206 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1944d95f-fcaf-47da-a4f4-b85fc9b3d46e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 0.728201 Oct 04 20:35:08.804002 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 318/642] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:08 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:08.849296 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1467086c-7ba9-43b8-a723-eca045569a56 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:08.850742 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-1467086c-7ba9-43b8-a723-eca045569a56 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:08.873473 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1467086c-7ba9-43b8-a723-eca045569a56 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.875610 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1467086c-7ba9-43b8-a723-eca045569a56 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.876670 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1467086c-7ba9-43b8-a723-eca045569a56 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.878179 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1467086c-7ba9-43b8-a723-eca045569a56 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.879586 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1467086c-7ba9-43b8-a723-eca045569a56 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.880493 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1467086c-7ba9-43b8-a723-eca045569a56 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.033220 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-dd1a2fe9-f922-42c3-8cf3-a7e3a5d44e3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:09.051686 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-dd1a2fe9-f922-42c3-8cf3-a7e3a5d44e3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1467 microversion: 2.1 time: 0.569389 Oct 04 20:35:09.066794 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 325/643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:08 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1467 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:09.088400 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9e852144-625e-4737-8a99-ea66d2a9f18c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:09.089501 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9e852144-625e-4737-8a99-ea66d2a9f18c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:09.118732 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9e852144-625e-4737-8a99-ea66d2a9f18c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.119692 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9e852144-625e-4737-8a99-ea66d2a9f18c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.120517 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9e852144-625e-4737-8a99-ea66d2a9f18c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.121872 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9e852144-625e-4737-8a99-ea66d2a9f18c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.122760 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9e852144-625e-4737-8a99-ea66d2a9f18c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.123547 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9e852144-625e-4737-8a99-ea66d2a9f18c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.157236 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-1467086c-7ba9-43b8-a723-eca045569a56 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:09.176413 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-1467086c-7ba9-43b8-a723-eca045569a56 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:09.179267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-1467086c-7ba9-43b8-a723-eca045569a56 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:09.188984 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1467086c-7ba9-43b8-a723-eca045569a56 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1451 microversion: 2.75 time: 0.355220 Oct 04 20:35:09.191385 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 319/644] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:08 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1451 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:09.212849 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8d35e516-c1c2-4192-8c57-5ff5da69c6e1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:09.214402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8d35e516-c1c2-4192-8c57-5ff5da69c6e1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 75de593c-9f57-471f-a519-d97960ccde5f] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:09.234871 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d35e516-c1c2-4192-8c57-5ff5da69c6e1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.236092 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d35e516-c1c2-4192-8c57-5ff5da69c6e1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.237086 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d35e516-c1c2-4192-8c57-5ff5da69c6e1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.238937 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d35e516-c1c2-4192-8c57-5ff5da69c6e1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.240030 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d35e516-c1c2-4192-8c57-5ff5da69c6e1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.241014 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d35e516-c1c2-4192-8c57-5ff5da69c6e1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.736100 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9e852144-625e-4737-8a99-ea66d2a9f18c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:09.765963 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9e852144-625e-4737-8a99-ea66d2a9f18c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1379 microversion: 2.1 time: 0.682928 Oct 04 20:35:09.771597 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 326/645] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:09 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1379 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:09.783983 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8d35e516-c1c2-4192-8c57-5ff5da69c6e1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:09.801814 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8d35e516-c1c2-4192-8c57-5ff5da69c6e1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f" status: 200 len: 1468 microversion: 2.1 time: 0.608350 Oct 04 20:35:09.803193 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 320/646] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:09 2022] GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f => generated 1468 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:09.853273 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:09.865839 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:09.868754 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Searching by: {'reservation_id': 'r-hoo7mun9', 'deleted': False, 'project_id': '70436b8b504e43dc882f5ee434ecf443'} {{(pid=123539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:35:09.888925 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a458b88f-052d-4437-b7e0-77bc34deb5c1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:09.890732 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.894542 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.894904 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a458b88f-052d-4437-b7e0-77bc34deb5c1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:09.896835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.898754 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.900635 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.902028 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.942957 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a458b88f-052d-4437-b7e0-77bc34deb5c1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.949333 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a458b88f-052d-4437-b7e0-77bc34deb5c1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.950971 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a458b88f-052d-4437-b7e0-77bc34deb5c1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.955063 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a458b88f-052d-4437-b7e0-77bc34deb5c1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.955063 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a458b88f-052d-4437-b7e0-77bc34deb5c1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.957104 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a458b88f-052d-4437-b7e0-77bc34deb5c1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.484942 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.multi_cell_list [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:35:10.899117 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:10.920057 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.922184 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.923409 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.997733 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a458b88f-052d-4437-b7e0-77bc34deb5c1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.027189 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a458b88f-052d-4437-b7e0-77bc34deb5c1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 1.183902 Oct 04 20:35:11.028147 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 327/647] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:09 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:11.047413 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c4530946-3d27-43c3-a98f-724e455e54ea tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:11.055828 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c4530946-3d27-43c3-a98f-724e455e54ea tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:11.073328 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4530946-3d27-43c3-a98f-724e455e54ea tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.074623 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4530946-3d27-43c3-a98f-724e455e54ea tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.075783 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4530946-3d27-43c3-a98f-724e455e54ea tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.077505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4530946-3d27-43c3-a98f-724e455e54ea tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.078691 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4530946-3d27-43c3-a98f-724e455e54ea tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.079779 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c4530946-3d27-43c3-a98f-724e455e54ea tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.344808 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c4530946-3d27-43c3-a98f-724e455e54ea tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.370374 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c4530946-3d27-43c3-a98f-724e455e54ea tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.387033 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c4530946-3d27-43c3-a98f-724e455e54ea tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.412052 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c4530946-3d27-43c3-a98f-724e455e54ea tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1436 microversion: 2.75 time: 0.381217 Oct 04 20:35:11.418370 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 328/648] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:11 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1436 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:11.556294 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-08d31586-768d-40b9-a9b5-41fe1ff30727 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?reservation_id=r-hoo7mun9" status: 200 len: 2928 microversion: 2.1 time: 1.713780 Oct 04 20:35:11.557956 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 321/649] 10.222.0.78 () {58 vars in 1197 bytes} [Tue Oct 4 20:35:09 2022] GET /compute/v2.1/servers/detail?reservation_id=r-hoo7mun9 => generated 2928 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:11.568372 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7060a5d1-a39e-4d63-9028-c3b3df5b05d7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:11.570406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7060a5d1-a39e-4d63-9028-c3b3df5b05d7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:11.616065 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7060a5d1-a39e-4d63-9028-c3b3df5b05d7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.617045 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7060a5d1-a39e-4d63-9028-c3b3df5b05d7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.617847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7060a5d1-a39e-4d63-9028-c3b3df5b05d7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.620371 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7060a5d1-a39e-4d63-9028-c3b3df5b05d7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.621304 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7060a5d1-a39e-4d63-9028-c3b3df5b05d7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.622332 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7060a5d1-a39e-4d63-9028-c3b3df5b05d7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.902383 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0e674ecf-615a-4cc8-8953-a0112f07a260 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef9b9550>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:11.914684 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e674ecf-615a-4cc8-8953-a0112f07a260 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.916112 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e674ecf-615a-4cc8-8953-a0112f07a260 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.916911 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e674ecf-615a-4cc8-8953-a0112f07a260 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.952689 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e674ecf-615a-4cc8-8953-a0112f07a260 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.957266 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e674ecf-615a-4cc8-8953-a0112f07a260 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.958127 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e674ecf-615a-4cc8-8953-a0112f07a260 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.993416 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-0e674ecf-615a-4cc8-8953-a0112f07a260 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] HTTP exception thrown: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0e674ecf-615a-4cc8-8953-a0112f07a260 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Request method failure captured: Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: request: PUT /compute/v2.1/os-services/f46226e8-e38a-47b3-b5e8-8a6c8913ea60 HTTP/1.1 Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 56 Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJj-LXD20L12fPw-QD_VqrirO6CY-zPxjGx-QaRZ465jsGhMfg5ZAels_fetWGhORfh9HyFv2pE7ZGkHv-ulL1GoBF6YBBOaOYLJ6GJuqXqq17w5RcpYzWwL5-CK2HwHqAk_z9-m4JyR9s0iOTv5vvh_aX10quXFb8CV79h_O0eBx6Y Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: ecbe677ae0a6436a8605bf95396eea4a Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-626379840 Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:35:12.000268 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ecbe677ae0a6436a8605bf95396eea4a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ecbe677ae0a6436a8605bf95396eea4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ecbe677ae0a6436a8605bf95396eea4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ecbe677ae0a6436a8605bf95396eea4a"}]}] Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-626379840 Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: ecbe677ae0a6436a8605bf95396eea4a Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-626379840 Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 03f0d81caac94d1397c021db58207253 Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:35:12.004798 n-d-852085-12 devstack@n-api.service[123540]: exception: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'f46226e8-e38a-47b3-b5e8-8a6c8913ea60', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.006476 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:12.013618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:12.017951 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:12.017951 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:12.017951 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.017951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0e674ecf-615a-4cc8-8953-a0112f07a260 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Returning 404 to user: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:12.018898 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0e674ecf-615a-4cc8-8953-a0112f07a260 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/f46226e8-e38a-47b3-b5e8-8a6c8913ea60" status: 404 len: 110 microversion: 2.53 time: 0.598123 Oct 04 20:35:12.023944 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 329/650] 10.222.0.78 () {62 vars in 1309 bytes} [Tue Oct 4 20:35:11 2022] PUT /compute/v2.1/os-services/f46226e8-e38a-47b3-b5e8-8a6c8913ea60 => generated 110 bytes in 605 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:12.088898 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7060a5d1-a39e-4d63-9028-c3b3df5b05d7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:12.107058 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7060a5d1-a39e-4d63-9028-c3b3df5b05d7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1379 microversion: 2.1 time: 0.546965 Oct 04 20:35:12.117172 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 322/651] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:11 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1379 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:12.132080 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-08b7ba6f-407c-4a76-b9e7-c3126867e5c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:12.200012 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.compute.server_groups [None req-08b7ba6f-407c-4a76-b9e7-c3126867e5c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Querying cell 8c6f5a8f-3e7f-4559-98c8-58d2585358de(cell1) for 2 instances {{(pid=123539) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 20:35:12.201592 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08b7ba6f-407c-4a76-b9e7-c3126867e5c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.203478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08b7ba6f-407c-4a76-b9e7-c3126867e5c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.203478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08b7ba6f-407c-4a76-b9e7-c3126867e5c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.275163 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-08b7ba6f-407c-4a76-b9e7-c3126867e5c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/4e4d59f0-e230-4ab8-9191-d4a781ad480e" status: 200 len: 265 microversion: 2.1 time: 0.164272 Oct 04 20:35:12.276791 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 323/652] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:35:12 2022] GET /compute/v2.1/os-server-groups/4e4d59f0-e230-4ab8-9191-d4a781ad480e => generated 265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:12.289171 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-494262e3-eee5-431c-b767-7bcb5ad45394 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef70bc10>, body: {"status": "disabled"} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:12.296078 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-494262e3-eee5-431c-b767-7bcb5ad45394 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.297068 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-494262e3-eee5-431c-b767-7bcb5ad45394 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.298242 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-494262e3-eee5-431c-b767-7bcb5ad45394 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.312575 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-494262e3-eee5-431c-b767-7bcb5ad45394 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.313591 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-494262e3-eee5-431c-b767-7bcb5ad45394 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.314811 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-494262e3-eee5-431c-b767-7bcb5ad45394 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.333047 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=100 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:12.335533 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-494262e3-eee5-431c-b767-7bcb5ad45394 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] HTTP exception thrown: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-494262e3-eee5-431c-b767-7bcb5ad45394 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Request method failure captured: Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: request: PUT /compute/v2.1/os-services/f46226e8-e38a-47b3-b5e8-8a6c8913ea60 HTTP/1.1 Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 22 Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJj-LXD20L12fPw-QD_VqrirO6CY-zPxjGx-QaRZ465jsGhMfg5ZAels_fetWGhORfh9HyFv2pE7ZGkHv-ulL1GoBF6YBBOaOYLJ6GJuqXqq17w5RcpYzWwL5-CK2HwHqAk_z9-m4JyR9s0iOTv5vvh_aX10quXFb8CV79h_O0eBx6Y Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: ecbe677ae0a6436a8605bf95396eea4a Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-626379840 Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:35:12.341575 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ecbe677ae0a6436a8605bf95396eea4a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ecbe677ae0a6436a8605bf95396eea4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ecbe677ae0a6436a8605bf95396eea4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ecbe677ae0a6436a8605bf95396eea4a"}]}] Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-626379840 Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: ecbe677ae0a6436a8605bf95396eea4a Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-626379840 Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 03f0d81caac94d1397c021db58207253 Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: {"status": "disabled"} Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: exception: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:12.358611 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'f46226e8-e38a-47b3-b5e8-8a6c8913ea60', 'body': {'status': 'disabled'}} Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:12.360699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:12.365260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:12.372903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:12.372903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.372903 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-494262e3-eee5-431c-b767-7bcb5ad45394 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Returning 404 to user: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:12.372903 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-494262e3-eee5-431c-b767-7bcb5ad45394 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/f46226e8-e38a-47b3-b5e8-8a6c8913ea60" status: 404 len: 110 microversion: 2.53 time: 0.066225 Oct 04 20:35:12.372903 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 324/653] 10.222.0.78 () {62 vars in 1309 bytes} [Tue Oct 4 20:35:12 2022] PUT /compute/v2.1/os-services/f46226e8-e38a-47b3-b5e8-8a6c8913ea60 => generated 110 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:12.372903 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9656edc9-43d7-4053-b64d-a990563554ab tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:12.374356 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9656edc9-43d7-4053-b64d-a990563554ab tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:12.374617 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9656edc9-43d7-4053-b64d-a990563554ab tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.375162 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9656edc9-43d7-4053-b64d-a990563554ab tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.375921 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9656edc9-43d7-4053-b64d-a990563554ab tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.377739 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9656edc9-43d7-4053-b64d-a990563554ab tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.378650 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9656edc9-43d7-4053-b64d-a990563554ab tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.379481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9656edc9-43d7-4053-b64d-a990563554ab tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.400955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:12.407713 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:12.421413 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.422860 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.424722 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.426385 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.427683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.428819 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.733484 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:12.734250 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:12.735121 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:12.737246 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:12.739293 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:12.819398 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9656edc9-43d7-4053-b64d-a990563554ab tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:12.837538 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9656edc9-43d7-4053-b64d-a990563554ab tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 0.486972 Oct 04 20:35:12.838932 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 325/654] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:12 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:12.850514 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e94a8802-35f6-4134-9813-4a7e9b6940a7 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:12.852016 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e94a8802-35f6-4134-9813-4a7e9b6940a7 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] [instance: 75de593c-9f57-471f-a519-d97960ccde5f] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:12.864909 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e94a8802-35f6-4134-9813-4a7e9b6940a7 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.867290 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e94a8802-35f6-4134-9813-4a7e9b6940a7 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.868464 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e94a8802-35f6-4134-9813-4a7e9b6940a7 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.871644 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e94a8802-35f6-4134-9813-4a7e9b6940a7 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.873091 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e94a8802-35f6-4134-9813-4a7e9b6940a7 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.874610 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e94a8802-35f6-4134-9813-4a7e9b6940a7 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.232423 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e94a8802-35f6-4134-9813-4a7e9b6940a7 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f" status: 200 len: 1621 microversion: 2.1 time: 0.389997 Oct 04 20:35:13.237019 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 326/655] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:12 2022] GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f => generated 1621 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:13.255664 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8d98988f-6fde-4640-88ee-2fe9af3f5b0b tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef26da60>, body: {"status": "enabled"} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:13.267578 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d98988f-6fde-4640-88ee-2fe9af3f5b0b tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.271815 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d98988f-6fde-4640-88ee-2fe9af3f5b0b tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.274439 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d98988f-6fde-4640-88ee-2fe9af3f5b0b tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.285772 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:13.302073 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d98988f-6fde-4640-88ee-2fe9af3f5b0b tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.303931 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d98988f-6fde-4640-88ee-2fe9af3f5b0b tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.306614 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d98988f-6fde-4640-88ee-2fe9af3f5b0b tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.308106 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.310210 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.310914 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.313934 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.317976 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.318290 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.326983 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-8d98988f-6fde-4640-88ee-2fe9af3f5b0b tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] HTTP exception thrown: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8d98988f-6fde-4640-88ee-2fe9af3f5b0b tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Request method failure captured: Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: request: PUT /compute/v2.1/os-services/f46226e8-e38a-47b3-b5e8-8a6c8913ea60 HTTP/1.1 Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 21 Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJj-LXD20L12fPw-QD_VqrirO6CY-zPxjGx-QaRZ465jsGhMfg5ZAels_fetWGhORfh9HyFv2pE7ZGkHv-ulL1GoBF6YBBOaOYLJ6GJuqXqq17w5RcpYzWwL5-CK2HwHqAk_z9-m4JyR9s0iOTv5vvh_aX10quXFb8CV79h_O0eBx6Y Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: ecbe677ae0a6436a8605bf95396eea4a Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-626379840 Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:35:13.332757 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ecbe677ae0a6436a8605bf95396eea4a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ecbe677ae0a6436a8605bf95396eea4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ecbe677ae0a6436a8605bf95396eea4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ecbe677ae0a6436a8605bf95396eea4a"}]}] Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-626379840 Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: ecbe677ae0a6436a8605bf95396eea4a Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-626379840 Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 03f0d81caac94d1397c021db58207253 Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: {"status": "enabled"} Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: exception: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:13.335856 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'f46226e8-e38a-47b3-b5e8-8a6c8913ea60', 'body': {'status': 'enabled'}} Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:13.337626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:13.340379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:13.342989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. Oct 04 20:35:13.342989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:13.342989 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8d98988f-6fde-4640-88ee-2fe9af3f5b0b tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Returning 404 to user: Service f46226e8-e38a-47b3-b5e8-8a6c8913ea60 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:13.346071 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8d98988f-6fde-4640-88ee-2fe9af3f5b0b tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/f46226e8-e38a-47b3-b5e8-8a6c8913ea60" status: 404 len: 110 microversion: 2.53 time: 0.105481 Oct 04 20:35:13.347628 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 327/656] 10.222.0.78 () {62 vars in 1309 bytes} [Tue Oct 4 20:35:13 2022] PUT /compute/v2.1/os-services/f46226e8-e38a-47b3-b5e8-8a6c8913ea60 => generated 110 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:13.362054 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-28f09676-c1e4-421b-8ada-ae880f9e7581 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:13.364613 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-28f09676-c1e4-421b-8ada-ae880f9e7581 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:13.567529 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:13.777840 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:13.886415 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-28f09676-c1e4-421b-8ada-ae880f9e7581 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.900282 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-28f09676-c1e4-421b-8ada-ae880f9e7581 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.900282 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-28f09676-c1e4-421b-8ada-ae880f9e7581 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.900282 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-28f09676-c1e4-421b-8ada-ae880f9e7581 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.900282 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-28f09676-c1e4-421b-8ada-ae880f9e7581 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.901820 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-28f09676-c1e4-421b-8ada-ae880f9e7581 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.982396 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1b720dae-d24e-47ca-ad72-484775d79157 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35/action" status: 202 len: 1940 microversion: 2.75 time: 1.946815 Oct 04 20:35:14.007289 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 330/657] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 4 20:35:12 2022] POST /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35/action => generated 1940 bytes in 1973 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 20:35:14.028120 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1d2e97ee-94a1-4b84-9dc0-b3afe7bb1ec9 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.031907 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1d2e97ee-94a1-4b84-9dc0-b3afe7bb1ec9 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:14.051119 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d2e97ee-94a1-4b84-9dc0-b3afe7bb1ec9 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.052024 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d2e97ee-94a1-4b84-9dc0-b3afe7bb1ec9 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.052600 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d2e97ee-94a1-4b84-9dc0-b3afe7bb1ec9 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.053360 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d2e97ee-94a1-4b84-9dc0-b3afe7bb1ec9 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.054222 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d2e97ee-94a1-4b84-9dc0-b3afe7bb1ec9 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.054546 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d2e97ee-94a1-4b84-9dc0-b3afe7bb1ec9 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.490935 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1d2e97ee-94a1-4b84-9dc0-b3afe7bb1ec9 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 200 len: 1620 microversion: 2.1 time: 0.480083 Oct 04 20:35:14.492082 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 331/658] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 1620 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:14.515535 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-15b88074-66c7-4f83-ad95-33fe21e8c175 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.526969 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-15b88074-66c7-4f83-ad95-33fe21e8c175 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.528654 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-15b88074-66c7-4f83-ad95-33fe21e8c175 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.529725 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-15b88074-66c7-4f83-ad95-33fe21e8c175 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.531499 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-15b88074-66c7-4f83-ad95-33fe21e8c175 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.541307 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-15b88074-66c7-4f83-ad95-33fe21e8c175 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.550959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-15b88074-66c7-4f83-ad95-33fe21e8c175 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.655957 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-28f09676-c1e4-421b-8ada-ae880f9e7581 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:14.712800 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-28f09676-c1e4-421b-8ada-ae880f9e7581 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1379 microversion: 2.1 time: 1.359926 Oct 04 20:35:14.716797 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 328/659] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:13 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1379 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:14.735446 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0ba94bcc-8350-4e1d-97f7-d45f4141aded tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.741006 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-0ba94bcc-8350-4e1d-97f7-d45f4141aded tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:14.764607 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-15b88074-66c7-4f83-ad95-33fe21e8c175 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.260292 Oct 04 20:35:14.765858 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0ba94bcc-8350-4e1d-97f7-d45f4141aded tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.768403 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0ba94bcc-8350-4e1d-97f7-d45f4141aded tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.770931 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 332/660] 10.222.0.78 () {60 vars in 1178 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:14.772926 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0ba94bcc-8350-4e1d-97f7-d45f4141aded tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.780197 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0ba94bcc-8350-4e1d-97f7-d45f4141aded tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.783596 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0ba94bcc-8350-4e1d-97f7-d45f4141aded tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.784700 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0ba94bcc-8350-4e1d-97f7-d45f4141aded tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.790296 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-14bd8c82-b377-4ea5-9976-cee55bd4c25c tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.791885 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-14bd8c82-b377-4ea5-9976-cee55bd4c25c tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:14.811811 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-14bd8c82-b377-4ea5-9976-cee55bd4c25c tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.813635 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-14bd8c82-b377-4ea5-9976-cee55bd4c25c tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.815310 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-14bd8c82-b377-4ea5-9976-cee55bd4c25c tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.817181 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-14bd8c82-b377-4ea5-9976-cee55bd4c25c tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.823620 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-14bd8c82-b377-4ea5-9976-cee55bd4c25c tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.825049 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-14bd8c82-b377-4ea5-9976-cee55bd4c25c tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.026789 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-14bd8c82-b377-4ea5-9976-cee55bd4c25c tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:15.115561 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-14bd8c82-b377-4ea5-9976-cee55bd4c25c tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.339922 Oct 04 20:35:15.124093 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 333/661] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:15.149946 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2aa0e39f-7af3-43a6-8be7-c601ffc74cfe tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Action: 'create', calling method: .version_select at 0x7f77ef908430>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1049647365", "policies": ["anti-affinity"]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:15.227047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-2aa0e39f-7af3-43a6-8be7-c601ffc74cfe tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:15.245762 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-2aa0e39f-7af3-43a6-8be7-c601ffc74cfe tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:15.390521 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-0ba94bcc-8350-4e1d-97f7-d45f4141aded tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:15.417669 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0ba94bcc-8350-4e1d-97f7-d45f4141aded tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 0.697079 Oct 04 20:35:15.420691 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 329/662] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:15.433482 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-03658313-e07a-4c30-8d8a-f7a30d97c967 req-97c8d4b0-25ef-47a3-b937-d9308922195f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa10127f-3488-4ff2-ac91-5411815abde8", "name": "network-vif-plugged", "status": "completed", "tag": "e2b12abe-be90-4826-bd13-1dc771ab7219"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:15.492725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-03658313-e07a-4c30-8d8a-f7a30d97c967 req-97c8d4b0-25ef-47a3-b937-d9308922195f service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.494029 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-03658313-e07a-4c30-8d8a-f7a30d97c967 req-97c8d4b0-25ef-47a3-b937-d9308922195f service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.498705 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-03658313-e07a-4c30-8d8a-f7a30d97c967 req-97c8d4b0-25ef-47a3-b937-d9308922195f service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.536297 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-03658313-e07a-4c30-8d8a-f7a30d97c967 req-97c8d4b0-25ef-47a3-b937-d9308922195f service nova] Creating event network-vif-plugged:e2b12abe-be90-4826-bd13-1dc771ab7219 for instance aa10127f-3488-4ff2-ac91-5411815abde8 on n-h1-852085-12 Oct 04 20:35:15.550141 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-03658313-e07a-4c30-8d8a-f7a30d97c967 req-97c8d4b0-25ef-47a3-b937-d9308922195f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126559 Oct 04 20:35:15.551292 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 330/663] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:15.561415 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-59661528-1c0a-421e-8dcc-79e4546a50b1 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:15.568424 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-59661528-1c0a-421e-8dcc-79e4546a50b1 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.569366 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-59661528-1c0a-421e-8dcc-79e4546a50b1 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.570042 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-59661528-1c0a-421e-8dcc-79e4546a50b1 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.572708 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-59661528-1c0a-421e-8dcc-79e4546a50b1 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.574041 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-59661528-1c0a-421e-8dcc-79e4546a50b1 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.575101 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-59661528-1c0a-421e-8dcc-79e4546a50b1 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.583963 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-2aa0e39f-7af3-43a6-8be7-c601ffc74cfe tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:15.626001 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-2aa0e39f-7af3-43a6-8be7-c601ffc74cfe tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:15.680887 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-59661528-1c0a-421e-8dcc-79e4546a50b1 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.127394 Oct 04 20:35:15.690603 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 331/664] 10.222.0.78 () {60 vars in 1211 bytes} [Tue Oct 4 20:35:15 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:15.698165 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2aa0e39f-7af3-43a6-8be7-c601ffc74cfe tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.558119 Oct 04 20:35:15.712425 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 334/665] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 4 20:35:15 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:15.722508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-05ed469a-cbb4-4ad0-be0c-e6f3df28e91d tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:15.741676 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-05ed469a-cbb4-4ad0-be0c-e6f3df28e91d tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.745341 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-05ed469a-cbb4-4ad0-be0c-e6f3df28e91d tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.746116 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-05ed469a-cbb4-4ad0-be0c-e6f3df28e91d tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.753224 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-05ed469a-cbb4-4ad0-be0c-e6f3df28e91d tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.755879 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-05ed469a-cbb4-4ad0-be0c-e6f3df28e91d tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.759086 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-05ed469a-cbb4-4ad0-be0c-e6f3df28e91d tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.775991 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b592e0c3-f91a-4e51-8b2b-25824587f3e5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:15.776755 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b592e0c3-f91a-4e51-8b2b-25824587f3e5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:15.827550 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b592e0c3-f91a-4e51-8b2b-25824587f3e5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.828398 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b592e0c3-f91a-4e51-8b2b-25824587f3e5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.837666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b592e0c3-f91a-4e51-8b2b-25824587f3e5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.846396 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b592e0c3-f91a-4e51-8b2b-25824587f3e5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.848046 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-05ed469a-cbb4-4ad0-be0c-e6f3df28e91d tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.145219 Oct 04 20:35:15.848798 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b592e0c3-f91a-4e51-8b2b-25824587f3e5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.855269 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 332/666] 10.222.0.78 () {60 vars in 1178 bytes} [Tue Oct 4 20:35:15 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:35:15.858696 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b592e0c3-f91a-4e51-8b2b-25824587f3e5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.889946 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e1e2d65a-0795-4d6c-aa89-dffd522f68fd tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:15.903320 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e1e2d65a-0795-4d6c-aa89-dffd522f68fd tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.904224 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e1e2d65a-0795-4d6c-aa89-dffd522f68fd tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.915837 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e1e2d65a-0795-4d6c-aa89-dffd522f68fd tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.917987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e1e2d65a-0795-4d6c-aa89-dffd522f68fd tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.926471 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e1e2d65a-0795-4d6c-aa89-dffd522f68fd tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.928227 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e1e2d65a-0795-4d6c-aa89-dffd522f68fd tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.093969 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e1e2d65a-0795-4d6c-aa89-dffd522f68fd tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=n-d-852085-12&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.223586 Oct 04 20:35:16.101742 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 333/667] 10.222.0.78 () {60 vars in 1237 bytes} [Tue Oct 4 20:35:15 2022] GET /compute/v2.1/os-services?host=n-d-852085-12&binary=xxx => generated 16 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:16.115512 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ef8d007c-b6b1-4e56-9cdd-7644ef5ccf96 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:16.137154 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ef8d007c-b6b1-4e56-9cdd-7644ef5ccf96 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.138232 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ef8d007c-b6b1-4e56-9cdd-7644ef5ccf96 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.139005 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ef8d007c-b6b1-4e56-9cdd-7644ef5ccf96 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.140501 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ef8d007c-b6b1-4e56-9cdd-7644ef5ccf96 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.141315 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ef8d007c-b6b1-4e56-9cdd-7644ef5ccf96 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.142041 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ef8d007c-b6b1-4e56-9cdd-7644ef5ccf96 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.279408 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ef8d007c-b6b1-4e56-9cdd-7644ef5ccf96 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.170966 Oct 04 20:35:16.281180 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 334/668] 10.222.0.78 () {60 vars in 1178 bytes} [Tue Oct 4 20:35:16 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:16.303041 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e09b825e-9bd5-43e5-b85e-b51846fc453a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:16.305106 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e09b825e-9bd5-43e5-b85e-b51846fc453a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:16.353679 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e09b825e-9bd5-43e5-b85e-b51846fc453a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.357770 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e09b825e-9bd5-43e5-b85e-b51846fc453a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.358765 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e09b825e-9bd5-43e5-b85e-b51846fc453a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.361070 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e09b825e-9bd5-43e5-b85e-b51846fc453a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.364352 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e09b825e-9bd5-43e5-b85e-b51846fc453a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.365152 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e09b825e-9bd5-43e5-b85e-b51846fc453a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.718605 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b592e0c3-f91a-4e51-8b2b-25824587f3e5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:16.722100 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-e09b825e-9bd5-43e5-b85e-b51846fc453a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:16.762836 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b592e0c3-f91a-4e51-8b2b-25824587f3e5 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1379 microversion: 2.1 time: 0.998237 Oct 04 20:35:16.762836 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 335/669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:15 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1379 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:16.807020 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2103731794", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f8f639ea-6302-42b9-87dc-b2de964d9733"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:17.012019 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e09b825e-9bd5-43e5-b85e-b51846fc453a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.728610 Oct 04 20:35:17.016793 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 335/670] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:16 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:17.031396 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:35:17.071369 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cc73cb33-8f3a-4f98-901f-e8043a86e2c9 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:17.081497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cc73cb33-8f3a-4f98-901f-e8043a86e2c9 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.083001 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cc73cb33-8f3a-4f98-901f-e8043a86e2c9 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.084144 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cc73cb33-8f3a-4f98-901f-e8043a86e2c9 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.085766 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cc73cb33-8f3a-4f98-901f-e8043a86e2c9 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.086781 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cc73cb33-8f3a-4f98-901f-e8043a86e2c9 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.087865 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cc73cb33-8f3a-4f98-901f-e8043a86e2c9 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.140771 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cc73cb33-8f3a-4f98-901f-e8043a86e2c9 tempest-ServicesAdminNegativeV253TestJSON-626379840 tempest-ServicesAdminNegativeV253TestJSON-626379840-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.088881 Oct 04 20:35:17.142169 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 336/671] 10.222.0.78 () {60 vars in 1239 bytes} [Tue Oct 4 20:35:17 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:17.162879 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9c164945-1bf9-45de-b9cd-57d5b0ac963e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:17.168901 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9c164945-1bf9-45de-b9cd-57d5b0ac963e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:17.185861 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9c164945-1bf9-45de-b9cd-57d5b0ac963e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.190026 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9c164945-1bf9-45de-b9cd-57d5b0ac963e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.194992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9c164945-1bf9-45de-b9cd-57d5b0ac963e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.194992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9c164945-1bf9-45de-b9cd-57d5b0ac963e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.194992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9c164945-1bf9-45de-b9cd-57d5b0ac963e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.194992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9c164945-1bf9-45de-b9cd-57d5b0ac963e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.572482 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9c164945-1bf9-45de-b9cd-57d5b0ac963e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:17.605821 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9c164945-1bf9-45de-b9cd-57d5b0ac963e tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1321 microversion: 2.1 time: 0.457479 Oct 04 20:35:17.607099 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 337/672] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:17 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1321 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:17.728319 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:17.730466 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:17.731645 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:17.732578 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:17.734889 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:17.810060 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.811344 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.812492 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.823121 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.824064 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.824868 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.874545 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c702f462-3b9e-44b4-9301-a678cce7c2ab tempest-ServicesAdminNegativeV253TestJSON-217905783 tempest-ServicesAdminNegativeV253TestJSON-217905783-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:17.875448 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:17.883288 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c702f462-3b9e-44b4-9301-a678cce7c2ab tempest-ServicesAdminNegativeV253TestJSON-217905783 tempest-ServicesAdminNegativeV253TestJSON-217905783-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4949f5e6b26f48cbb78653da0c6bcebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16052b1f5c824dc0a6fa99ae0bc043c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:17.884612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c702f462-3b9e-44b4-9301-a678cce7c2ab tempest-ServicesAdminNegativeV253TestJSON-217905783 tempest-ServicesAdminNegativeV253TestJSON-217905783-project] Request method failure captured: Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJj7x-uZDyUH18hgwuWsrBl0zDrbvauT1r66ybjESEPTJOqYBblAF82mvCLLMjKlshrs-Yrb0cHGMfdGHlO901Hi4lUAgeS13pqHNlMT6tnYfB08pP9kzb9QQzYnRfIqjY527TmzoaE6z1XIlkhyIW4kZO03jgVZbSlvF6IMNL7Gzxk Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 16052b1f5c824dc0a6fa99ae0bc043c1 Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-217905783 Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:35:17.889692 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:35:17.894875 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_16052b1f5c824dc0a6fa99ae0bc043c1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/16052b1f5c824dc0a6fa99ae0bc043c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/16052b1f5c824dc0a6fa99ae0bc043c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/16052b1f5c824dc0a6fa99ae0bc043c1"}]}] Oct 04 20:35:17.894875 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-217905783 Oct 04 20:35:17.894875 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 16052b1f5c824dc0a6fa99ae0bc043c1 Oct 04 20:35:17.894875 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-217905783 Oct 04 20:35:17.894875 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServicesAdminNegativeV253TestJSON-217905783-project Oct 04 20:35:17.894875 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:35:17.894875 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:35:17.894875 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 4949f5e6b26f48cbb78653da0c6bcebb Oct 04 20:35:17.894875 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-217905783-project Oct 04 20:35:17.894875 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:35:17.894875 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:35:17.894875 n-d-852085-12 devstack@n-api.service[123539]: action_args: {} Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:35:17.897699 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:35:17.913873 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:17.916195 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c702f462-3b9e-44b4-9301-a678cce7c2ab tempest-ServicesAdminNegativeV253TestJSON-217905783 tempest-ServicesAdminNegativeV253TestJSON-217905783-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:17.916195 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c702f462-3b9e-44b4-9301-a678cce7c2ab tempest-ServicesAdminNegativeV253TestJSON-217905783 tempest-ServicesAdminNegativeV253TestJSON-217905783-project] 10.222.0.78 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.294100 Oct 04 20:35:17.917187 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Going to run 2 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:35:17.919517 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: d937ec04-8d81-4926-a578-27ca4e58ca63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:17.921192 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 338/673] 10.222.0.78 () {60 vars in 1178 bytes} [Tue Oct 4 20:35:17 2022] GET /compute/v2.1/os-services => generated 112 bytes in 313 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:17.928447 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-540fc585-a1e4-4aff-9686-58bfda332e91 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:17.929318 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-540fc585-a1e4-4aff-9686-58bfda332e91 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:17.942934 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-540fc585-a1e4-4aff-9686-58bfda332e91 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.943707 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-540fc585-a1e4-4aff-9686-58bfda332e91 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.944345 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-540fc585-a1e4-4aff-9686-58bfda332e91 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.946517 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-540fc585-a1e4-4aff-9686-58bfda332e91 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.947289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-540fc585-a1e4-4aff-9686-58bfda332e91 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.948089 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-540fc585-a1e4-4aff-9686-58bfda332e91 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:18.280142 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:18.305699 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:18.394986 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-540fc585-a1e4-4aff-9686-58bfda332e91 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:18.422400 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-540fc585-a1e4-4aff-9686-58bfda332e91 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1379 microversion: 2.1 time: 0.495704 Oct 04 20:35:18.425187 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 339/674] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:17 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1379 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:18.448035 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4f55234e-2886-49e5-8526-147697e7893b tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:18.449616 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4f55234e-2886-49e5-8526-147697e7893b tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:18.463984 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f55234e-2886-49e5-8526-147697e7893b tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:18.465349 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f55234e-2886-49e5-8526-147697e7893b tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:18.466223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f55234e-2886-49e5-8526-147697e7893b tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:18.467721 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f55234e-2886-49e5-8526-147697e7893b tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:18.468555 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f55234e-2886-49e5-8526-147697e7893b tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:18.469396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f55234e-2886-49e5-8526-147697e7893b tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:18.646413 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:18.667089 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:18.679416 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:18.750029 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=d937ec04-8d81-4926-a578-27ca4e58ca63,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:18.895241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-4f55234e-2886-49e5-8526-147697e7893b tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:18.955715 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4f55234e-2886-49e5-8526-147697e7893b tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.526130 Oct 04 20:35:18.957771 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 340/675] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:18 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:18.977603 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-88e367f4-12a9-4c95-85e4-73a4bdf975d0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:18.979318 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-88e367f4-12a9-4c95-85e4-73a4bdf975d0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:19.017059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-88e367f4-12a9-4c95-85e4-73a4bdf975d0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:19.018071 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-88e367f4-12a9-4c95-85e4-73a4bdf975d0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:19.019033 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-88e367f4-12a9-4c95-85e4-73a4bdf975d0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:19.024651 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-88e367f4-12a9-4c95-85e4-73a4bdf975d0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:19.025532 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-88e367f4-12a9-4c95-85e4-73a4bdf975d0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:19.026357 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-88e367f4-12a9-4c95-85e4-73a4bdf975d0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:19.255599 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:19.271306 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:19.508691 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:19.522603 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'server_group_members'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:19.662427 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ada002fa-0c30-4231-a821-f97e71d3e3de tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.899148 Oct 04 20:35:19.664369 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 336/676] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:35:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 2902 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:35:19.706583 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ef0532bf-8895-4c2a-bbc1-f227be633d42 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:19.706583 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ef0532bf-8895-4c2a-bbc1-f227be633d42 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:19.706583 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ef0532bf-8895-4c2a-bbc1-f227be633d42 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:19.706583 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ef0532bf-8895-4c2a-bbc1-f227be633d42 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:19.707182 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ef0532bf-8895-4c2a-bbc1-f227be633d42 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:19.709572 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ef0532bf-8895-4c2a-bbc1-f227be633d42 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:19.710514 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ef0532bf-8895-4c2a-bbc1-f227be633d42 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:19.711861 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ef0532bf-8895-4c2a-bbc1-f227be633d42 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.349256 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ef0532bf-8895-4c2a-bbc1-f227be633d42 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:20.386029 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ef0532bf-8895-4c2a-bbc1-f227be633d42 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1379 microversion: 2.1 time: 0.715164 Oct 04 20:35:20.405428 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 337/677] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:19 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1379 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:20.483060 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-8b217738-8723-4635-ba89-31780dcfe319 req-97bec9a3-640a-44f3-a371-601b595d6aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f57f25a-23a5-469a-bdab-c55a3d3a7201", "name": "network-vif-plugged", "status": "completed", "tag": "0c7adf8c-2e14-4eaa-bfab-9dbb2f275d44"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:20.483772 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-88e367f4-12a9-4c95-85e4-73a4bdf975d0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:20.510663 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-88e367f4-12a9-4c95-85e4-73a4bdf975d0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1470 microversion: 2.1 time: 1.550066 Oct 04 20:35:20.524992 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 341/678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:18 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1470 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:20.566289 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-8b217738-8723-4635-ba89-31780dcfe319 req-97bec9a3-640a-44f3-a371-601b595d6aad service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.568385 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-8b217738-8723-4635-ba89-31780dcfe319 req-97bec9a3-640a-44f3-a371-601b595d6aad service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.570534 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-8b217738-8723-4635-ba89-31780dcfe319 req-97bec9a3-640a-44f3-a371-601b595d6aad service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.573620 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0980cbcd-1343-473f-87e3-7d12d8b02d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:20.598223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-0980cbcd-1343-473f-87e3-7d12d8b02d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:20.601456 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-0980cbcd-1343-473f-87e3-7d12d8b02d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Searching by: {'deleted': False, 'project_id': '70436b8b504e43dc882f5ee434ecf443'} {{(pid=123539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:35:20.616384 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-8b217738-8723-4635-ba89-31780dcfe319 req-97bec9a3-640a-44f3-a371-601b595d6aad service nova] Creating event network-vif-plugged:0c7adf8c-2e14-4eaa-bfab-9dbb2f275d44 for instance 0f57f25a-23a5-469a-bdab-c55a3d3a7201 on n-h2-852085-12 Oct 04 20:35:20.631502 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-8b217738-8723-4635-ba89-31780dcfe319 req-97bec9a3-640a-44f3-a371-601b595d6aad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184330 Oct 04 20:35:20.632883 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 338/679] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:20.656310 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a04dbcfa-6abd-4fc0-b0af-32ea00d342d7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:20.659367 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a04dbcfa-6abd-4fc0-b0af-32ea00d342d7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:20.695348 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0980cbcd-1343-473f-87e3-7d12d8b02d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.701020 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0980cbcd-1343-473f-87e3-7d12d8b02d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.701020 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0980cbcd-1343-473f-87e3-7d12d8b02d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.703518 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0980cbcd-1343-473f-87e3-7d12d8b02d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.705284 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0980cbcd-1343-473f-87e3-7d12d8b02d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.706371 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a04dbcfa-6abd-4fc0-b0af-32ea00d342d7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.707431 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a04dbcfa-6abd-4fc0-b0af-32ea00d342d7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.708362 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0980cbcd-1343-473f-87e3-7d12d8b02d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.724780 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a04dbcfa-6abd-4fc0-b0af-32ea00d342d7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.725674 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a04dbcfa-6abd-4fc0-b0af-32ea00d342d7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.726695 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a04dbcfa-6abd-4fc0-b0af-32ea00d342d7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.726897 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a04dbcfa-6abd-4fc0-b0af-32ea00d342d7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.900481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:21.086719 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-a04dbcfa-6abd-4fc0-b0af-32ea00d342d7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:21.112256 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.multi_cell_list [None req-0980cbcd-1343-473f-87e3-7d12d8b02d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=123539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:35:21.179214 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a04dbcfa-6abd-4fc0-b0af-32ea00d342d7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.543168 Oct 04 20:35:21.183734 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 339/680] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:20 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:21.236577 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a3d0574b-4d36-46ca-8f66-ba620f8294a0 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:21.238084 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a3d0574b-4d36-46ca-8f66-ba620f8294a0 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:21.275694 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a3d0574b-4d36-46ca-8f66-ba620f8294a0 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:21.276094 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a3d0574b-4d36-46ca-8f66-ba620f8294a0 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:21.280407 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a3d0574b-4d36-46ca-8f66-ba620f8294a0 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:21.284521 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0980cbcd-1343-473f-87e3-7d12d8b02d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.757645 Oct 04 20:35:21.286399 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a3d0574b-4d36-46ca-8f66-ba620f8294a0 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:21.287181 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a3d0574b-4d36-46ca-8f66-ba620f8294a0 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:21.288066 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a3d0574b-4d36-46ca-8f66-ba620f8294a0 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:21.288584 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 342/681] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 4 20:35:20 2022] GET /compute/v2.1/servers => generated 1664 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:21.314020 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e8bebabe-2525-4c85-a37b-db407dd1b63f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:21.315738 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e8bebabe-2525-4c85-a37b-db407dd1b63f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:21.359203 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-a3d0574b-4d36-46ca-8f66-ba620f8294a0 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lazy-loading 'flavor' on Instance uuid aa10127f-3488-4ff2-ac91-5411815abde8 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:21.521531 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e8bebabe-2525-4c85-a37b-db407dd1b63f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:21.549474 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e8bebabe-2525-4c85-a37b-db407dd1b63f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1219 microversion: 2.1 time: 0.243293 Oct 04 20:35:21.550720 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 343/682] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:21 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1219 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:21.587920 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-90ff9f5d-c404-4041-9035-6e3567161a0e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:21.590002 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-90ff9f5d-c404-4041-9035-6e3567161a0e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:21.602523 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-90ff9f5d-c404-4041-9035-6e3567161a0e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:21.604219 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-90ff9f5d-c404-4041-9035-6e3567161a0e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:21.605772 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-90ff9f5d-c404-4041-9035-6e3567161a0e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:21.607757 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-90ff9f5d-c404-4041-9035-6e3567161a0e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:21.609511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-90ff9f5d-c404-4041-9035-6e3567161a0e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:21.610658 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-90ff9f5d-c404-4041-9035-6e3567161a0e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.084457 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-90ff9f5d-c404-4041-9035-6e3567161a0e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:22.101752 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-90ff9f5d-c404-4041-9035-6e3567161a0e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1379 microversion: 2.1 time: 0.535800 Oct 04 20:35:22.103502 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 344/683] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:21 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1379 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:22.261389 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a3d0574b-4d36-46ca-8f66-ba620f8294a0 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8/action" status: 202 len: 0 microversion: 2.1 time: 1.070244 Oct 04 20:35:22.265066 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 340/684] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:21 2022] POST /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8/action => generated 0 bytes in 1079 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:22.287250 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-64992e18-c04d-443b-9c62-5698be7e332a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.287716 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-64992e18-c04d-443b-9c62-5698be7e332a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:22.310514 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5bc33d14-8ef6-4bd7-a6bd-030b1f14ff4a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.318936 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-5bc33d14-8ef6-4bd7-a6bd-030b1f14ff4a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:22.337962 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=100 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:22.341897 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-64992e18-c04d-443b-9c62-5698be7e332a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.347166 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-64992e18-c04d-443b-9c62-5698be7e332a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.347491 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5bc33d14-8ef6-4bd7-a6bd-030b1f14ff4a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.356201 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-64992e18-c04d-443b-9c62-5698be7e332a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.357923 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-64992e18-c04d-443b-9c62-5698be7e332a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.364162 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5bc33d14-8ef6-4bd7-a6bd-030b1f14ff4a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.364976 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-64992e18-c04d-443b-9c62-5698be7e332a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.365792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-64992e18-c04d-443b-9c62-5698be7e332a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.368974 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5bc33d14-8ef6-4bd7-a6bd-030b1f14ff4a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.383046 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5bc33d14-8ef6-4bd7-a6bd-030b1f14ff4a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.383046 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5bc33d14-8ef6-4bd7-a6bd-030b1f14ff4a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.383046 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5bc33d14-8ef6-4bd7-a6bd-030b1f14ff4a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.729522 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-64992e18-c04d-443b-9c62-5698be7e332a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:22.791004 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-64992e18-c04d-443b-9c62-5698be7e332a tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.545599 Oct 04 20:35:22.793642 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 345/685] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:22 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:35:22.806115 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e383b9bf-d6b5-4bd9-bc47-2da230b35a8b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.808300 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e383b9bf-d6b5-4bd9-bc47-2da230b35a8b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:22.989977 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e383b9bf-d6b5-4bd9-bc47-2da230b35a8b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:23.012969 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e383b9bf-d6b5-4bd9-bc47-2da230b35a8b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1219 microversion: 2.1 time: 0.216702 Oct 04 20:35:23.014181 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 346/686] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:22 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1219 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:23.146890 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a06a5a17-93d9-4b2b-acb8-6ea455af139e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:23.148079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a06a5a17-93d9-4b2b-acb8-6ea455af139e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:23.185069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a06a5a17-93d9-4b2b-acb8-6ea455af139e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.186187 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a06a5a17-93d9-4b2b-acb8-6ea455af139e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.190055 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a06a5a17-93d9-4b2b-acb8-6ea455af139e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.195212 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a06a5a17-93d9-4b2b-acb8-6ea455af139e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.196364 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a06a5a17-93d9-4b2b-acb8-6ea455af139e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.198617 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a06a5a17-93d9-4b2b-acb8-6ea455af139e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.966943 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a06a5a17-93d9-4b2b-acb8-6ea455af139e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:23.972327 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=100 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:24.001212 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a06a5a17-93d9-4b2b-acb8-6ea455af139e tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1379 microversion: 2.1 time: 0.852510 Oct 04 20:35:24.001212 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 347/687] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:23 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1379 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:24.368861 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5bc33d14-8ef6-4bd7-a6bd-030b1f14ff4a tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1631 microversion: 2.1 time: 2.098661 Oct 04 20:35:24.381358 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 341/688] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:22 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1631 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:24.398956 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-07a9e996-94a3-43b9-90c5-2ec912cdd326 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.406891 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-07a9e996-94a3-43b9-90c5-2ec912cdd326 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:24.444556 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-07a9e996-94a3-43b9-90c5-2ec912cdd326 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.444556 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-07a9e996-94a3-43b9-90c5-2ec912cdd326 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.444556 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-07a9e996-94a3-43b9-90c5-2ec912cdd326 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.452609 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-07a9e996-94a3-43b9-90c5-2ec912cdd326 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.455571 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-07a9e996-94a3-43b9-90c5-2ec912cdd326 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.460631 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-07a9e996-94a3-43b9-90c5-2ec912cdd326 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.691731 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-07a9e996-94a3-43b9-90c5-2ec912cdd326 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:24.778897 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-07a9e996-94a3-43b9-90c5-2ec912cdd326 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.395318 Oct 04 20:35:24.780000 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 342/689] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:24.791992 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fc4b04f6-c2c5-4ef4-bf21-c941094d8854 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.793132 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-fc4b04f6-c2c5-4ef4-bf21-c941094d8854 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:24.805481 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fc4b04f6-c2c5-4ef4-bf21-c941094d8854 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.807087 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fc4b04f6-c2c5-4ef4-bf21-c941094d8854 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.807846 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fc4b04f6-c2c5-4ef4-bf21-c941094d8854 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.808832 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fc4b04f6-c2c5-4ef4-bf21-c941094d8854 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.809788 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fc4b04f6-c2c5-4ef4-bf21-c941094d8854 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.811934 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fc4b04f6-c2c5-4ef4-bf21-c941094d8854 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.992257 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b864b09c-2f7b-475a-8c5c-8408494c6524 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] Calling method '.version_select at 0x7f77ef4ce940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.994907 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-fc4b04f6-c2c5-4ef4-bf21-c941094d8854 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:25.015989 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fc4b04f6-c2c5-4ef4-bf21-c941094d8854 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1223 microversion: 2.1 time: 0.234027 Oct 04 20:35:25.046712 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 343/690] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1223 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:25.054104 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-70d075b5-31e6-40c8-9c56-0cba52098f9d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:25.057635 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-70d075b5-31e6-40c8-9c56-0cba52098f9d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:25.076421 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70d075b5-31e6-40c8-9c56-0cba52098f9d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.077020 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70d075b5-31e6-40c8-9c56-0cba52098f9d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.077528 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70d075b5-31e6-40c8-9c56-0cba52098f9d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.078341 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70d075b5-31e6-40c8-9c56-0cba52098f9d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.078868 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70d075b5-31e6-40c8-9c56-0cba52098f9d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.081887 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70d075b5-31e6-40c8-9c56-0cba52098f9d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.172403 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b864b09c-2f7b-475a-8c5c-8408494c6524 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.176454 Oct 04 20:35:25.174455 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 348/691] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 4 20:35:23 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:35:25.207490 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7754d273-1758-4760-b5c2-338a674a9369 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] Action: 'create', calling method: .version_select at 0x7f77ef57f310>, body: {"pool": "non_exist_pool"} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:25.340185 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-7754d273-1758-4760-b5c2-338a674a9369 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] HTTP exception thrown: Floating IP pool not found. Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7754d273-1758-4760-b5c2-338a674a9369 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] Request method failure captured: Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 26 Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJkLaL6CYB2D8WbBADHXDUD_GdGNNaK5l8aUuS9ZDgkd9hIvaboXxus9bZ03zTI9jsvj8_K2Ww3P690uGzmw7asWCs8vzGjuHsToAJkIsUMZA7chyQDAiEQjPC4EQDclVM8HK0FsE78gukYv6kIGe-mDAK1UpQBpiXZesrQuik2Yrro Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 1a11d1435a15411dac3494ce54e4a8e5 Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-580501871 Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:35:25.344623 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1a11d1435a15411dac3494ce54e4a8e5", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1a11d1435a15411dac3494ce54e4a8e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1a11d1435a15411dac3494ce54e4a8e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1a11d1435a15411dac3494ce54e4a8e5"}]}] Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-580501871 Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 1a11d1435a15411dac3494ce54e4a8e5 Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-580501871 Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-FloatingIPsNegativeTestJSON-580501871-project Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 323ba3fc0aa144bf99adcd5c70370ef0 Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-580501871-project Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: {"pool": "non_exist_pool"} Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: exception: Floating IP pool not found. Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 04 20:35:25.347680 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:25.349867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 04 20:35:25.352772 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.356710 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7754d273-1758-4760-b5c2-338a674a9369 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] Returning 404 to user: Floating IP pool not found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:25.358734 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7754d273-1758-4760-b5c2-338a674a9369 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.164573 Oct 04 20:35:25.365706 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 349/692] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 4 20:35:25 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:35:25.391071 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-99674fc0-99a1-4eab-b531-d716eb22dd49 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] Calling method '.version_select at 0x7f77ef614b80>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-99674fc0-99a1-4eab-b531-d716eb22dd49 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 784e0c26-da8f-486c-8e12-7b0a481e5a91 could not be found", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-99674fc0-99a1-4eab-b531-d716eb22dd49 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] HTTP exception thrown: Floating IP not found for ID 784e0c26-da8f-486c-8e12-7b0a481e5a91 Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-99674fc0-99a1-4eab-b531-d716eb22dd49 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] Request method failure captured: Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/os-floating-ips/784e0c26-da8f-486c-8e12-7b0a481e5a91 HTTP/1.1 Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJkLaL6CYB2D8WbBADHXDUD_GdGNNaK5l8aUuS9ZDgkd9hIvaboXxus9bZ03zTI9jsvj8_K2Ww3P690uGzmw7asWCs8vzGjuHsToAJkIsUMZA7chyQDAiEQjPC4EQDclVM8HK0FsE78gukYv6kIGe-mDAK1UpQBpiXZesrQuik2Yrro Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 1a11d1435a15411dac3494ce54e4a8e5 Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-580501871 Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:35:25.606448 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1a11d1435a15411dac3494ce54e4a8e5", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1a11d1435a15411dac3494ce54e4a8e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1a11d1435a15411dac3494ce54e4a8e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1a11d1435a15411dac3494ce54e4a8e5"}]}] Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-580501871 Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 1a11d1435a15411dac3494ce54e4a8e5 Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-580501871 Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-FloatingIPsNegativeTestJSON-580501871-project Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 323ba3fc0aa144bf99adcd5c70370ef0 Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-580501871-project Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: exception: Floating IP not found for ID 784e0c26-da8f-486c-8e12-7b0a481e5a91 Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '784e0c26-da8f-486c-8e12-7b0a481e5a91'} Oct 04 20:35:25.609500 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:35:25.613558 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 784e0c26-da8f-486c-8e12-7b0a481e5a91 could not be found Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fde6f423-18fd-4957-9c91-1d7d3f847dc5'] Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 784e0c26-da8f-486c-8e12-7b0a481e5a91. Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:25.616686 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 784e0c26-da8f-486c-8e12-7b0a481e5a91 Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:25.622091 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:25.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 784e0c26-da8f-486c-8e12-7b0a481e5a91 Oct 04 20:35:25.629472 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.629472 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-99674fc0-99a1-4eab-b531-d716eb22dd49 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] Returning 404 to user: Floating IP not found for ID 784e0c26-da8f-486c-8e12-7b0a481e5a91 {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:25.629472 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-99674fc0-99a1-4eab-b531-d716eb22dd49 tempest-FloatingIPsNegativeTestJSON-580501871 tempest-FloatingIPsNegativeTestJSON-580501871-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/784e0c26-da8f-486c-8e12-7b0a481e5a91" status: 404 len: 111 microversion: 2.1 time: 0.233485 Oct 04 20:35:25.629472 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 350/693] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:35:25 2022] DELETE /compute/v2.1/os-floating-ips/784e0c26-da8f-486c-8e12-7b0a481e5a91 => generated 111 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:25.629472 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d4578678-0ece-4afa-adaf-fdff5fd0ac3c tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:25.630538 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d4578678-0ece-4afa-adaf-fdff5fd0ac3c tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:25.652266 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d4578678-0ece-4afa-adaf-fdff5fd0ac3c tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.655075 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d4578678-0ece-4afa-adaf-fdff5fd0ac3c tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.659022 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d4578678-0ece-4afa-adaf-fdff5fd0ac3c tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.661187 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d4578678-0ece-4afa-adaf-fdff5fd0ac3c tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.664073 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d4578678-0ece-4afa-adaf-fdff5fd0ac3c tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.670225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d4578678-0ece-4afa-adaf-fdff5fd0ac3c tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.917607 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-70d075b5-31e6-40c8-9c56-0cba52098f9d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:26.001100 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-70d075b5-31e6-40c8-9c56-0cba52098f9d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1528 microversion: 2.1 time: 0.941367 Oct 04 20:35:26.005881 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 344/694] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:25 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1528 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:26.038925 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-99a9b6a5-fc4d-44ad-b48c-987b39156f51 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:26.059888 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-99a9b6a5-fc4d-44ad-b48c-987b39156f51 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:26.101815 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-99a9b6a5-fc4d-44ad-b48c-987b39156f51 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.103331 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-99a9b6a5-fc4d-44ad-b48c-987b39156f51 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.104548 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-99a9b6a5-fc4d-44ad-b48c-987b39156f51 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:26.106605 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-99a9b6a5-fc4d-44ad-b48c-987b39156f51 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.107961 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-99a9b6a5-fc4d-44ad-b48c-987b39156f51 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.108995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-99a9b6a5-fc4d-44ad-b48c-987b39156f51 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:26.730669 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d4578678-0ece-4afa-adaf-fdff5fd0ac3c tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1614 microversion: 2.1 time: 1.120920 Oct 04 20:35:26.739812 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 351/695] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:25 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1614 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:26.763789 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-65cc3dd7-ebc7-4605-b6c9-6947df7cc266 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:26.764957 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-65cc3dd7-ebc7-4605-b6c9-6947df7cc266 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:26.813510 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-65cc3dd7-ebc7-4605-b6c9-6947df7cc266 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.814448 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-65cc3dd7-ebc7-4605-b6c9-6947df7cc266 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.815318 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-65cc3dd7-ebc7-4605-b6c9-6947df7cc266 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:26.816703 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-65cc3dd7-ebc7-4605-b6c9-6947df7cc266 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.817591 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-65cc3dd7-ebc7-4605-b6c9-6947df7cc266 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.839503 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-65cc3dd7-ebc7-4605-b6c9-6947df7cc266 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:27.022317 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-99a9b6a5-fc4d-44ad-b48c-987b39156f51 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:27.117974 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-99a9b6a5-fc4d-44ad-b48c-987b39156f51 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 1.107719 Oct 04 20:35:27.119292 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 345/696] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:26 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:27.188001 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5f4e474b-fea9-4523-8ba8-33429120061d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:27.200015 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-5f4e474b-fea9-4523-8ba8-33429120061d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:27.232762 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5f4e474b-fea9-4523-8ba8-33429120061d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:27.238271 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5f4e474b-fea9-4523-8ba8-33429120061d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:27.242740 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5f4e474b-fea9-4523-8ba8-33429120061d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:27.252865 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5f4e474b-fea9-4523-8ba8-33429120061d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:27.252865 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5f4e474b-fea9-4523-8ba8-33429120061d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:27.252865 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5f4e474b-fea9-4523-8ba8-33429120061d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:27.624594 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-65cc3dd7-ebc7-4605-b6c9-6947df7cc266 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:27.655203 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-65cc3dd7-ebc7-4605-b6c9-6947df7cc266 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1271 microversion: 2.1 time: 0.913767 Oct 04 20:35:27.686343 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 352/697] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:26 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1271 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:27.712031 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:27.715564 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:27.744288 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:27.746676 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:27.747817 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:27.749747 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:27.751020 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:27.759076 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:27.859202 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-20fd6d9f-0d0c-4226-ae0a-f2c9fe5555f7) Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:35:27.932330 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:27.933664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:35:27.934749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:35:27.936046 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:35:27.936046 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:35:27.936046 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:35:27.936046 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:35:27.936046 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:35:27.936046 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:35:27.936046 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:35:27.936046 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:35:27.936046 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:35:27.936046 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:35:27.936046 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-20fd6d9f-0d0c-4226-ae0a-f2c9fe5555f7) Oct 04 20:35:27.936046 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:27.948179 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:27.948179 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Request method failure captured: Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8/action HTTP/1.1 Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 15 Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJis9KwxL8gHDbPjc_7_LGL6g3HOAgVeJUZWHBWML-XvO6B3BoFwfIPvTS3peEYatfjOxlHifyja4v2o67tIYjxHPahOxEwneIox4jBv4Zmgx_prT6xeih2a292gDeED1Cr1UtiXaBlEw_1WvakQrH1kokbv4NDIfBWVlmk8zslsaLo Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 102b4fb7ac5e4cfdb2affbecc59ecbb2 Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:35:27.962679 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:35:27.965643 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_102b4fb7ac5e4cfdb2affbecc59ecbb2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}] Oct 04 20:35:27.965643 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:35:27.965643 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 102b4fb7ac5e4cfdb2affbecc59ecbb2 Oct 04 20:35:27.965643 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:35:27.965643 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersAdminNegativeTestJSON-359119102-project-admin Oct 04 20:35:27.965643 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:35:27.965643 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:35:27.965643 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: aa74dd7fba5a467eb147229e77a0f25a Oct 04 20:35:27.965643 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersAdminNegativeTestJSON-359119102-project-admin Oct 04 20:35:27.965643 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:35:27.965643 n-d-852085-12 devstack@n-api.service[123539]: {"migrate": {}} Oct 04 20:35:27.965643 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'aa10127f-3488-4ff2-ac91-5411815abde8', 'body': {'migrate': {}}} Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:35:27.967486 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:35:27.968835 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:35:27.970183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-20fd6d9f-0d0c-4226-ae0a-f2c9fe5555f7) Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:27.971974 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:27.974609 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:27.976207 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:27.976207 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:27.981355 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cdebb3bd-4601-457a-b6f6-085bd2d3b25f tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8/action" status: 500 len: 214 microversion: 2.1 time: 0.287880 Oct 04 20:35:27.984108 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 353/698] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:27 2022] POST /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8/action => generated 214 bytes in 297 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:35:28.016771 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1e400204-4c26-433f-be49-12775bdba1b2 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1e400204-4c26-433f-be49-12775bdba1b2 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Request method failure captured: Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442/action HTTP/1.1 Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 39 Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJis9KwxL8gHDbPjc_7_LGL6g3HOAgVeJUZWHBWML-XvO6B3BoFwfIPvTS3peEYatfjOxlHifyja4v2o67tIYjxHPahOxEwneIox4jBv4Zmgx_prT6xeih2a292gDeED1Cr1UtiXaBlEw_1WvakQrH1kokbv4NDIfBWVlmk8zslsaLo Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 102b4fb7ac5e4cfdb2affbecc59ecbb2 Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:35:28.023679 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:35:28.025529 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_102b4fb7ac5e4cfdb2affbecc59ecbb2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}] Oct 04 20:35:28.025529 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:35:28.025529 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 102b4fb7ac5e4cfdb2affbecc59ecbb2 Oct 04 20:35:28.025529 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:35:28.025529 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersAdminNegativeTestJSON-359119102-project-admin Oct 04 20:35:28.025529 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:35:28.025529 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:35:28.025529 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: aa74dd7fba5a467eb147229e77a0f25a Oct 04 20:35:28.025529 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersAdminNegativeTestJSON-359119102-project-admin Oct 04 20:35:28.025529 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:35:28.025529 n-d-852085-12 devstack@n-api.service[123539]: {"os-resetState": {"state": "invalid"}} Oct 04 20:35:28.025529 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'b9bfdee0-1a5d-4f35-b3be-ea3017b41442', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:28.026441 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:35:28.028039 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 20:35:28.029878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.030167 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1e400204-4c26-433f-be49-12775bdba1b2 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:28.031426 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1e400204-4c26-433f-be49-12775bdba1b2 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442/action" status: 400 len: 144 microversion: 2.1 time: 0.023888 Oct 04 20:35:28.032559 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 354/699] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:28 2022] POST /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442/action => generated 144 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:28.063582 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4194895b-b363-40e2-9be6-a576f17ca8b9 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4194895b-b363-40e2-9be6-a576f17ca8b9 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Request method failure captured: Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442/action HTTP/1.1 Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 31 Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJis9KwxL8gHDbPjc_7_LGL6g3HOAgVeJUZWHBWML-XvO6B3BoFwfIPvTS3peEYatfjOxlHifyja4v2o67tIYjxHPahOxEwneIox4jBv4Zmgx_prT6xeih2a292gDeED1Cr1UtiXaBlEw_1WvakQrH1kokbv4NDIfBWVlmk8zslsaLo Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 102b4fb7ac5e4cfdb2affbecc59ecbb2 Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:35:28.083667 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_102b4fb7ac5e4cfdb2affbecc59ecbb2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}] Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 102b4fb7ac5e4cfdb2affbecc59ecbb2 Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersAdminNegativeTestJSON-359119102-project-admin Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: aa74dd7fba5a467eb147229e77a0f25a Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersAdminNegativeTestJSON-359119102-project-admin Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: {"os-resetState": {"state": 1}} Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:35:28.086243 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'b9bfdee0-1a5d-4f35-b3be-ea3017b41442', 'body': {'os-resetState': {'state': 1}}} Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 1 Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:28.091282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 20:35:28.105222 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.107435 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4194895b-b363-40e2-9be6-a576f17ca8b9 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:28.107435 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4194895b-b363-40e2-9be6-a576f17ca8b9 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442/action" status: 400 len: 120 microversion: 2.1 time: 0.061545 Oct 04 20:35:28.111261 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 355/700] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:28 2022] POST /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442/action => generated 120 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:28.138611 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cc7bb3c0-5bbf-4c57-845a-b8a686d26678 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:28.144606 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cc7bb3c0-5bbf-4c57-845a-b8a686d26678 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Failed to fetch instance by id 999 {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:35:28.146019 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-cc7bb3c0-5bbf-4c57-845a-b8a686d26678 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cc7bb3c0-5bbf-4c57-845a-b8a686d26678 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Request method failure captured: Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 37 Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJis9KwxL8gHDbPjc_7_LGL6g3HOAgVeJUZWHBWML-XvO6B3BoFwfIPvTS3peEYatfjOxlHifyja4v2o67tIYjxHPahOxEwneIox4jBv4Zmgx_prT6xeih2a292gDeED1Cr1UtiXaBlEw_1WvakQrH1kokbv4NDIfBWVlmk8zslsaLo Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 102b4fb7ac5e4cfdb2affbecc59ecbb2 Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:35:28.150284 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_102b4fb7ac5e4cfdb2affbecc59ecbb2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/102b4fb7ac5e4cfdb2affbecc59ecbb2"}]}] Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 102b4fb7ac5e4cfdb2affbecc59ecbb2 Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-359119102 Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersAdminNegativeTestJSON-359119102-project-admin Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: aa74dd7fba5a467eb147229e77a0f25a Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersAdminNegativeTestJSON-359119102-project-admin Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: {"os-resetState": {"state": "error"}} Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:35:28.153184 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 999 could not be found. Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:28.154638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 20:35:28.157090 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:28.165073 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cc7bb3c0-5bbf-4c57-845a-b8a686d26678 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:28.167486 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cc7bb3c0-5bbf-4c57-845a-b8a686d26678 tempest-ServersAdminNegativeTestJSON-359119102 tempest-ServersAdminNegativeTestJSON-359119102-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.047604 Oct 04 20:35:28.169825 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 356/701] 10.222.0.78 () {60 vars in 1179 bytes} [Tue Oct 4 20:35:28 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:35:28.189865 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-25618de6-951f-4269-b445-727d32eac8b0 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:28.191210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-25618de6-951f-4269-b445-727d32eac8b0 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:28.220797 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25618de6-951f-4269-b445-727d32eac8b0 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:28.223755 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25618de6-951f-4269-b445-727d32eac8b0 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:28.225252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25618de6-951f-4269-b445-727d32eac8b0 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:28.239432 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25618de6-951f-4269-b445-727d32eac8b0 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:28.241382 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25618de6-951f-4269-b445-727d32eac8b0 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:28.242793 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25618de6-951f-4269-b445-727d32eac8b0 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:28.466237 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-25618de6-951f-4269-b445-727d32eac8b0 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:28.595535 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-25618de6-951f-4269-b445-727d32eac8b0 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.422433 Oct 04 20:35:28.639595 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 357/702] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:28 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:28.656879 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ee5b7d08-dcb4-46c0-8a2f-70975aa671ae tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:28.659127 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ee5b7d08-dcb4-46c0-8a2f-70975aa671ae tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:28.675520 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee5b7d08-dcb4-46c0-8a2f-70975aa671ae tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:28.676662 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee5b7d08-dcb4-46c0-8a2f-70975aa671ae tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:28.677607 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee5b7d08-dcb4-46c0-8a2f-70975aa671ae tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:28.679618 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee5b7d08-dcb4-46c0-8a2f-70975aa671ae tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:28.680673 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee5b7d08-dcb4-46c0-8a2f-70975aa671ae tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:28.681732 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee5b7d08-dcb4-46c0-8a2f-70975aa671ae tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:28.824110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ee5b7d08-dcb4-46c0-8a2f-70975aa671ae tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:35:29.413635 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ee5b7d08-dcb4-46c0-8a2f-70975aa671ae tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 204 len: 0 microversion: 2.1 time: 0.778479 Oct 04 20:35:29.415184 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 358/703] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:28 2022] DELETE /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:35:29.427067 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-885764e4-26b4-47e7-8aae-70100c03a2fe tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1811052992", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "5a968067-4034-47ae-963a-b80f9544a870"}], "block_device_mapping_v2": [{"uuid": "a0bd89cf-7d52-4b8d-97f5-51767a72e259", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:29.550801 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=30 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:29.858851 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-885764e4-26b4-47e7-8aae-70100c03a2fe tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] validate_networks() for [('5a968067-4034-47ae-963a-b80f9544a870', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:35:29.865092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-5f4e474b-fea9-4523-8ba8-33429120061d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:29.897127 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:29.907109 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5f4e474b-fea9-4523-8ba8-33429120061d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1528 microversion: 2.1 time: 2.785527 Oct 04 20:35:29.924525 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 346/704] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:27 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1528 bytes in 2804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:29.950405 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-096df986-f1f5-4432-84de-4d5685a35ee8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:29.963470 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-096df986-f1f5-4432-84de-4d5685a35ee8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:30.074580 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-096df986-f1f5-4432-84de-4d5685a35ee8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.079939 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-096df986-f1f5-4432-84de-4d5685a35ee8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.080916 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-096df986-f1f5-4432-84de-4d5685a35ee8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.082317 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-096df986-f1f5-4432-84de-4d5685a35ee8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.083177 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-096df986-f1f5-4432-84de-4d5685a35ee8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.084019 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-096df986-f1f5-4432-84de-4d5685a35ee8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.345131 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-096df986-f1f5-4432-84de-4d5685a35ee8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:30.372785 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-096df986-f1f5-4432-84de-4d5685a35ee8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1277 microversion: 2.1 time: 0.442748 Oct 04 20:35:30.386888 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 347/705] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:29 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1277 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:30.409476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-69e9a280-b4ff-4e4c-b027-a16d337dffd9 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:30.411508 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-69e9a280-b4ff-4e4c-b027-a16d337dffd9 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:30.428552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-69e9a280-b4ff-4e4c-b027-a16d337dffd9 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.435406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-69e9a280-b4ff-4e4c-b027-a16d337dffd9 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.435406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-69e9a280-b4ff-4e4c-b027-a16d337dffd9 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.435406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-69e9a280-b4ff-4e4c-b027-a16d337dffd9 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.435406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-69e9a280-b4ff-4e4c-b027-a16d337dffd9 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.436055 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-69e9a280-b4ff-4e4c-b027-a16d337dffd9 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.900829 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=18 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-885764e4-26b4-47e7-8aae-70100c03a2fe tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0066f3f1-8547-4bb6-8ffa-40dbe4c2695d) Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:35:31.213928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:31.216194 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:35:31.218516 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:35:31.222352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:35:31.224458 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0066f3f1-8547-4bb6-8ffa-40dbe4c2695d) Oct 04 20:35:31.224458 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.224458 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-885764e4-26b4-47e7-8aae-70100c03a2fe tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:31.224458 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-885764e4-26b4-47e7-8aae-70100c03a2fe tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Request method failure captured: Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 362 Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJiOcGPqUAbnkDjAg_GhinWcah-rx0Vl-q-M0tIygmaRKI62opXYulC1e7x1_4avsIhRzdEky_hF7SXdT5V4zlgd-pOekF9orc8vR9Ot2udgiIVUc6d4uobcXJ5bhvMcO7w3nPEgIDk0ONj7Z0MTGS9QX6SE3ASdFMLDpSRKpLvyINA Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: cf616fd82dd34c7d92f4d8e9e80f89f4 Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1439487668 Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:35:31.230566 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:35:31.233642 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cf616fd82dd34c7d92f4d8e9e80f89f4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf616fd82dd34c7d92f4d8e9e80f89f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf616fd82dd34c7d92f4d8e9e80f89f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cf616fd82dd34c7d92f4d8e9e80f89f4"}]}] Oct 04 20:35:31.233642 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1439487668 Oct 04 20:35:31.233642 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: cf616fd82dd34c7d92f4d8e9e80f89f4 Oct 04 20:35:31.233642 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1439487668 Oct 04 20:35:31.233642 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-LiveAutoBlockMigrationV225Test-1439487668-project Oct 04 20:35:31.233642 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:35:31.233642 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:35:31.233642 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 6a310d2bd16e4d52841042364253a86b Oct 04 20:35:31.233642 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1439487668-project Oct 04 20:35:31.233642 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1811052992", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "5a968067-4034-47ae-963a-b80f9544a870"}], "block_device_mapping_v2": [{"uuid": "a0bd89cf-7d52-4b8d-97f5-51767a72e259", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-1811052992', 'imageRef': '', 'flavorRef': '452', 'networks': [{'uuid': '5a968067-4034-47ae-963a-b80f9544a870'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': 'a0bd89cf-7d52-4b8d-97f5-51767a72e259'}]}}} Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:31.234816 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:31.237385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:35:31.242068 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:35:31.249711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0066f3f1-8547-4bb6-8ffa-40dbe4c2695d) Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.252846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-885764e4-26b4-47e7-8aae-70100c03a2fe tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:31.254881 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-885764e4-26b4-47e7-8aae-70100c03a2fe tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 1.825183 Oct 04 20:35:31.257422 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 359/706] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:35:29 2022] POST /compute/v2.1/servers => generated 214 bytes in 1829 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 04 20:35:31.292763 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3278770e-9fe0-4f74-8469-58178feecadd tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:31.294588 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3278770e-9fe0-4f74-8469-58178feecadd tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:31.312536 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3278770e-9fe0-4f74-8469-58178feecadd tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.314205 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3278770e-9fe0-4f74-8469-58178feecadd tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.315055 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3278770e-9fe0-4f74-8469-58178feecadd tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.316672 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3278770e-9fe0-4f74-8469-58178feecadd tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.317638 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3278770e-9fe0-4f74-8469-58178feecadd tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.318619 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3278770e-9fe0-4f74-8469-58178feecadd tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.406768 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-69e9a280-b4ff-4e4c-b027-a16d337dffd9 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:31.436515 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-69e9a280-b4ff-4e4c-b027-a16d337dffd9 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1467 microversion: 2.1 time: 1.038341 Oct 04 20:35:31.438449 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 348/707] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:30 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1467 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:31.452526 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-995e785a-924d-4cf9-b6a2-7b8d161e4135 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:31.595492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-3278770e-9fe0-4f74-8469-58178feecadd tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:31.630291 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-995e785a-924d-4cf9-b6a2-7b8d161e4135 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/3dd9b571-606f-4449-973e-3afbb6686838" status: 202 len: 0 microversion: 2.1 time: 0.187850 Oct 04 20:35:31.633072 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 349/708] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:31 2022] DELETE /compute/v2.1/flavors/3dd9b571-606f-4449-973e-3afbb6686838 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:31.652984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d7529ee4-397a-4a0f-b088-dde248ba56ed tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] Calling method '.version_select at 0x7f77ef9b9dc0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:31.677540 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3278770e-9fe0-4f74-8469-58178feecadd tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.426769 Oct 04 20:35:31.699486 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 360/709] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:31 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:31.738819 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e264ef28-9a26-433e-901a-f8479f45ad29 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:31.743609 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e264ef28-9a26-433e-901a-f8479f45ad29 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:31.754385 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e264ef28-9a26-433e-901a-f8479f45ad29 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.759028 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e264ef28-9a26-433e-901a-f8479f45ad29 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.763901 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e264ef28-9a26-433e-901a-f8479f45ad29 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.765671 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e264ef28-9a26-433e-901a-f8479f45ad29 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.775117 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e264ef28-9a26-433e-901a-f8479f45ad29 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.776623 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e264ef28-9a26-433e-901a-f8479f45ad29 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.849233 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d7529ee4-397a-4a0f-b088-dde248ba56ed tempest-LiveAutoBlockMigrationV225Test-1439487668 tempest-LiveAutoBlockMigrationV225Test-1439487668-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058594534" status: 204 len: 0 microversion: 2.25 time: 0.212997 Oct 04 20:35:31.851231 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 350/710] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:35:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058594534 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:35:31.874241 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c644c5dc-b53e-4857-afa2-81dbb0ecdfe1 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:31.938540 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c644c5dc-b53e-4857-afa2-81dbb0ecdfe1 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078335 Oct 04 20:35:31.947463 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 351/711] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:35:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:31.991461 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:32.003348 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:32.035687 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.035687 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.036313 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.037940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.038987 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.040065 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e264ef28-9a26-433e-901a-f8479f45ad29 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:32.040797 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.074033 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e264ef28-9a26-433e-901a-f8479f45ad29 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1277 microversion: 2.1 time: 0.366321 Oct 04 20:35:32.087438 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 361/712] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:31 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1277 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1b1c724d-00ad-45d9-af4c-254daa177a49) Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:35:32.306997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:35:32.309075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:35:32.311527 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1b1c724d-00ad-45d9-af4c-254daa177a49) Oct 04 20:35:32.314069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.323022 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:32.323022 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Request method failure captured: Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201/action HTTP/1.1 Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 32 Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJiNhV16z4nc9-dvgN1oYsetPABmQ80TjNNMdhys6K47SL84YUPJDpCiDufhH6v6wucCeWAWpWRlL3sBxgSgOzZxFtoEU5iSlSP7PSv8nRhInko8xxLPpv2dozhhyMkCcqR6fHIamFhrC5KfY_KiAl6N23PBq4pT47eDAlx7uY-2aSk Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 74eef3bf938c491d8a2f5192ba598c19 Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-MigrationsAdminTest-1386345839 Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:35:32.327990 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74eef3bf938c491d8a2f5192ba598c19", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74eef3bf938c491d8a2f5192ba598c19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74eef3bf938c491d8a2f5192ba598c19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74eef3bf938c491d8a2f5192ba598c19"}]}] Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-MigrationsAdminTest-1386345839 Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 74eef3bf938c491d8a2f5192ba598c19 Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-MigrationsAdminTest-1386345839 Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-MigrationsAdminTest-1386345839-project Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 4360a08eed56405b99333776285fef3a Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-MigrationsAdminTest-1386345839-project Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: {"resize": {"flavorRef": "451"}} Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:35:32.331471 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '0f57f25a-23a5-469a-bdab-c55a3d3a7201', 'body': {'resize': {'flavorRef': '451'}}} Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:35:32.333738 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:32.344442 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:35:32.357811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1b1c724d-00ad-45d9-af4c-254daa177a49) Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:32.360065 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:35:32.362860 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:32.364971 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-86fe2d8c-8c64-4d90-9645-667a12757377 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "POST /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201/action" status: 500 len: 214 microversion: 2.1 time: 0.358224 Oct 04 20:35:32.364971 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 352/713] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:31 2022] POST /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201/action => generated 214 bytes in 366 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:35:32.371295 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3b36c77e-08bd-4d01-852b-53f74e269dc5 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:32.385852 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-3b36c77e-08bd-4d01-852b-53f74e269dc5 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] HTTP exception thrown: Flavor 3dd9b571-606f-4449-973e-3afbb6686838 could not be found. Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3b36c77e-08bd-4d01-852b-53f74e269dc5 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Request method failure captured: Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/flavors/3dd9b571-606f-4449-973e-3afbb6686838 HTTP/1.1 Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJiToJYI4MASBN3dVdiVSjJtqQQXHEIdNXKsar7Xqdo4a4L5ZJGqyoYIfqTCIEhEWacD1Ek7WmusfBBeX_McaNVQxK4iPeCreBVpBgDAOK0RXR_36nno6EfyrlCNjifGKJCqmTTxd93E9PS1_2OlCJHA-TyBmPr6g5X_iymTr1vEw9w Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 7c51aa34a4434d0a931063ba18400be8 Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-MigrationsAdminTest-609424741 Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:35:32.394243 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:35:32.396858 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c51aa34a4434d0a931063ba18400be8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c51aa34a4434d0a931063ba18400be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c51aa34a4434d0a931063ba18400be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c51aa34a4434d0a931063ba18400be8"}]}] Oct 04 20:35:32.396858 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-MigrationsAdminTest-609424741 Oct 04 20:35:32.396858 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 7c51aa34a4434d0a931063ba18400be8 Oct 04 20:35:32.396858 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-MigrationsAdminTest-609424741 Oct 04 20:35:32.396858 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-MigrationsAdminTest-609424741-project-admin Oct 04 20:35:32.396858 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:35:32.396858 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:35:32.396858 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 2e3ada01045e4d4b9295b266315e2cd1 Oct 04 20:35:32.396858 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-MigrationsAdminTest-609424741-project-admin Oct 04 20:35:32.396858 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:35:32.396858 n-d-852085-12 devstack@n-api.service[123539]: exception: Flavor 3dd9b571-606f-4449-973e-3afbb6686838 could not be found. Oct 04 20:35:32.396858 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '3dd9b571-606f-4449-973e-3afbb6686838'} Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 3dd9b571-606f-4449-973e-3afbb6686838 could not be found. Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:32.398908 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 3dd9b571-606f-4449-973e-3afbb6686838 could not be found. Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 3dd9b571-606f-4449-973e-3afbb6686838 could not be found. Oct 04 20:35:32.402995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:32.410497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3b36c77e-08bd-4d01-852b-53f74e269dc5 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Returning 404 to user: Flavor 3dd9b571-606f-4449-973e-3afbb6686838 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:32.413201 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3b36c77e-08bd-4d01-852b-53f74e269dc5 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/3dd9b571-606f-4449-973e-3afbb6686838" status: 404 len: 109 microversion: 2.1 time: 0.060334 Oct 04 20:35:32.415081 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 362/714] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:32 2022] DELETE /compute/v2.1/flavors/3dd9b571-606f-4449-973e-3afbb6686838 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:32.490689 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-25e6f659-f113-4cc4-a421-fd7d8376b17b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:32.491966 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-25e6f659-f113-4cc4-a421-fd7d8376b17b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:32.515470 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25e6f659-f113-4cc4-a421-fd7d8376b17b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.516508 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25e6f659-f113-4cc4-a421-fd7d8376b17b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.517919 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25e6f659-f113-4cc4-a421-fd7d8376b17b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.519332 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25e6f659-f113-4cc4-a421-fd7d8376b17b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.526612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25e6f659-f113-4cc4-a421-fd7d8376b17b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.527685 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-25e6f659-f113-4cc4-a421-fd7d8376b17b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.738826 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-64ca1fe9-a2ed-415f-8d98-25939fb4a963 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:32.744707 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-64ca1fe9-a2ed-415f-8d98-25939fb4a963 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:32.771950 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-64ca1fe9-a2ed-415f-8d98-25939fb4a963 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.774307 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-64ca1fe9-a2ed-415f-8d98-25939fb4a963 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.775892 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-64ca1fe9-a2ed-415f-8d98-25939fb4a963 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.788995 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-64ca1fe9-a2ed-415f-8d98-25939fb4a963 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.790479 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-64ca1fe9-a2ed-415f-8d98-25939fb4a963 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.792110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-64ca1fe9-a2ed-415f-8d98-25939fb4a963 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:33.002076 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:33.100507 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-64ca1fe9-a2ed-415f-8d98-25939fb4a963 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:33.185000 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-64ca1fe9-a2ed-415f-8d98-25939fb4a963 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.456004 Oct 04 20:35:33.187634 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 363/715] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:32 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:35:33.213831 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-883495521", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:33.459129 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:35:34.024548 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-25e6f659-f113-4cc4-a421-fd7d8376b17b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:34.091309 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-25e6f659-f113-4cc4-a421-fd7d8376b17b tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1467 microversion: 2.1 time: 1.609569 Oct 04 20:35:34.096457 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 353/716] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:32 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1467 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:34.122496 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0db0979b-a763-4f30-a3c5-89aac8a4028e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:34.131449 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0db0979b-a763-4f30-a3c5-89aac8a4028e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:34.162512 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0db0979b-a763-4f30-a3c5-89aac8a4028e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.164222 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0db0979b-a763-4f30-a3c5-89aac8a4028e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.166769 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0db0979b-a763-4f30-a3c5-89aac8a4028e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.174702 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0db0979b-a763-4f30-a3c5-89aac8a4028e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.176337 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0db0979b-a763-4f30-a3c5-89aac8a4028e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.179344 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0db0979b-a763-4f30-a3c5-89aac8a4028e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.491813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:35.493064 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:35.494108 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:35.496578 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:35.504874 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:35.548684 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.550296 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.552267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.558543 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.560272 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.561645 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.635856 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Getting quotas for project 74eef3bf938c491d8a2f5192ba598c19. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:35.644449 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Getting quotas for user 4360a08eed56405b99333776285fef3a and project 74eef3bf938c491d8a2f5192ba598c19. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:35.659110 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0db0979b-a763-4f30-a3c5-89aac8a4028e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:35.676873 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0db0979b-a763-4f30-a3c5-89aac8a4028e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1319 microversion: 2.1 time: 1.576059 Oct 04 20:35:35.676873 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 354/717] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:34 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1319 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:35.691482 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-edd9e061-7fe4-4720-8b4d-c3ef200992b7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:35.692669 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-edd9e061-7fe4-4720-8b4d-c3ef200992b7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:35.699485 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:35:35.702704 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:35.712113 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-edd9e061-7fe4-4720-8b4d-c3ef200992b7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.712113 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-edd9e061-7fe4-4720-8b4d-c3ef200992b7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.712113 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-edd9e061-7fe4-4720-8b4d-c3ef200992b7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.712113 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-edd9e061-7fe4-4720-8b4d-c3ef200992b7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.712485 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-edd9e061-7fe4-4720-8b4d-c3ef200992b7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.712485 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-edd9e061-7fe4-4720-8b4d-c3ef200992b7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.866873 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-436e56f3-c032-4b4e-9149-4c834c472cf2 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.676041 Oct 04 20:35:35.871257 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 364/718] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:35:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:35:35.876620 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-db1988bd-3589-48ba-90b2-98baa3bdadd5 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:35.877522 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-db1988bd-3589-48ba-90b2-98baa3bdadd5 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:35.917669 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-db1988bd-3589-48ba-90b2-98baa3bdadd5 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.923822 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-db1988bd-3589-48ba-90b2-98baa3bdadd5 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.925241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-db1988bd-3589-48ba-90b2-98baa3bdadd5 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.928341 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-db1988bd-3589-48ba-90b2-98baa3bdadd5 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.933339 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-db1988bd-3589-48ba-90b2-98baa3bdadd5 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.934584 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-db1988bd-3589-48ba-90b2-98baa3bdadd5 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:36.054648 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-edd9e061-7fe4-4720-8b4d-c3ef200992b7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:36.114932 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-edd9e061-7fe4-4720-8b4d-c3ef200992b7 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.437871 Oct 04 20:35:36.117400 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 355/719] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:35 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:36.128277 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-d6dd1db1-45c5-42af-a722-ddd89960bf92 req-626f11c3-a8f0-47c8-b680-bb920e918140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa10127f-3488-4ff2-ac91-5411815abde8", "name": "network-vif-deleted", "tag": "e2b12abe-be90-4826-bd13-1dc771ab7219"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:36.178683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-d6dd1db1-45c5-42af-a722-ddd89960bf92 req-626f11c3-a8f0-47c8-b680-bb920e918140 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:36.184194 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-d6dd1db1-45c5-42af-a722-ddd89960bf92 req-626f11c3-a8f0-47c8-b680-bb920e918140 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:36.189209 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-d6dd1db1-45c5-42af-a722-ddd89960bf92 req-626f11c3-a8f0-47c8-b680-bb920e918140 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:36.228926 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-d6dd1db1-45c5-42af-a722-ddd89960bf92 req-626f11c3-a8f0-47c8-b680-bb920e918140 service nova] Creating event network-vif-deleted:e2b12abe-be90-4826-bd13-1dc771ab7219 for instance aa10127f-3488-4ff2-ac91-5411815abde8 on n-h1-852085-12 Oct 04 20:35:36.246057 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-d6dd1db1-45c5-42af-a722-ddd89960bf92 req-626f11c3-a8f0-47c8-b680-bb920e918140 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125747 Oct 04 20:35:36.249184 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 356/720] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:36.284825 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a33fe9f0-a0ed-410b-87af-6e78305d8817 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:36.293132 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a33fe9f0-a0ed-410b-87af-6e78305d8817 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:37.060004 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-db1988bd-3589-48ba-90b2-98baa3bdadd5 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:37.088184 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-db1988bd-3589-48ba-90b2-98baa3bdadd5 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 200 len: 1425 microversion: 2.1 time: 1.217245 Oct 04 20:35:37.095381 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 365/721] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:35 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 1425 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:37.116920 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6f65090e-9384-4e52-8d37-9dec8089407d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:37.118494 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6f65090e-9384-4e52-8d37-9dec8089407d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:37.149690 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6f65090e-9384-4e52-8d37-9dec8089407d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.150478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6f65090e-9384-4e52-8d37-9dec8089407d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.151634 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6f65090e-9384-4e52-8d37-9dec8089407d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.153191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6f65090e-9384-4e52-8d37-9dec8089407d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.154351 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6f65090e-9384-4e52-8d37-9dec8089407d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.155493 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6f65090e-9384-4e52-8d37-9dec8089407d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.155683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a33fe9f0-a0ed-410b-87af-6e78305d8817 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:37.190478 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a33fe9f0-a0ed-410b-87af-6e78305d8817 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1212 microversion: 2.1 time: 0.924001 Oct 04 20:35:37.191421 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 357/722] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:36 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1212 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:37.280542 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1956925f-6333-4302-b09f-cb40fa907d17 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:37.289411 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1956925f-6333-4302-b09f-cb40fa907d17 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:37.315934 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1956925f-6333-4302-b09f-cb40fa907d17 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.325367 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1956925f-6333-4302-b09f-cb40fa907d17 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.325367 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1956925f-6333-4302-b09f-cb40fa907d17 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.327962 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1956925f-6333-4302-b09f-cb40fa907d17 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.329888 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1956925f-6333-4302-b09f-cb40fa907d17 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.330934 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1956925f-6333-4302-b09f-cb40fa907d17 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.721520 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-1956925f-6333-4302-b09f-cb40fa907d17 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:37.789198 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1956925f-6333-4302-b09f-cb40fa907d17 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.535348 Oct 04 20:35:37.791081 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 358/723] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:37 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:38.070470 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6f65090e-9384-4e52-8d37-9dec8089407d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:38.091446 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6f65090e-9384-4e52-8d37-9dec8089407d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1319 microversion: 2.1 time: 0.993084 Oct 04 20:35:38.102646 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 366/724] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:37 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1319 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:38.137515 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-30ed1f07-1715-4c94-94a3-c2e9dcd2a937 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:38.139070 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-30ed1f07-1715-4c94-94a3-c2e9dcd2a937 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: aa10127f-3488-4ff2-ac91-5411815abde8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:38.154474 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-30ed1f07-1715-4c94-94a3-c2e9dcd2a937 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.155341 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-30ed1f07-1715-4c94-94a3-c2e9dcd2a937 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.156244 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-30ed1f07-1715-4c94-94a3-c2e9dcd2a937 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.158435 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-30ed1f07-1715-4c94-94a3-c2e9dcd2a937 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.159607 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-30ed1f07-1715-4c94-94a3-c2e9dcd2a937 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.160382 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-30ed1f07-1715-4c94-94a3-c2e9dcd2a937 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.193574 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-30ed1f07-1715-4c94-94a3-c2e9dcd2a937 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] HTTP exception thrown: Instance aa10127f-3488-4ff2-ac91-5411815abde8 could not be found. Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-30ed1f07-1715-4c94-94a3-c2e9dcd2a937 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Request method failure captured: Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 HTTP/1.1 Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJimTHDQ2n_IMc7D9b3nHx_xqqV8TkGrOA0daJr-LYdy_3t71I2eLJ24qgWAkynqH4-iEUiwZcW-2vzseTNQkC7acx-YqeO3oLsDhS_pOn4Bu_NQ6S81YCA6wotyVrV2ggvEjhyo3w-m-EwjB6h6hk0oiFU6oOzYbpRSGozqRzTgAeg Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 7e024c248dfa402e9aa19677dd749c9f Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-564248376 Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:35:38.197119 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:35:38.200035 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7e024c248dfa402e9aa19677dd749c9f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e024c248dfa402e9aa19677dd749c9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e024c248dfa402e9aa19677dd749c9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7e024c248dfa402e9aa19677dd749c9f"}]}] Oct 04 20:35:38.200035 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersAdminNegativeTestJSON-564248376 Oct 04 20:35:38.200035 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 7e024c248dfa402e9aa19677dd749c9f Oct 04 20:35:38.200035 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-564248376 Oct 04 20:35:38.200035 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersAdminNegativeTestJSON-564248376-project Oct 04 20:35:38.200035 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:35:38.200035 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:35:38.200035 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 7caebe70d8da45aebdeeae629801512c Oct 04 20:35:38.200035 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersAdminNegativeTestJSON-564248376-project Oct 04 20:35:38.200035 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:35:38.200035 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance aa10127f-3488-4ff2-ac91-5411815abde8 could not be found. Oct 04 20:35:38.200035 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'aa10127f-3488-4ff2-ac91-5411815abde8'} Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa10127f-3488-4ff2-ac91-5411815abde8 could not be found. Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:38.201771 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa10127f-3488-4ff2-ac91-5411815abde8 could not be found. Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa10127f-3488-4ff2-ac91-5411815abde8 could not be found. Oct 04 20:35:38.204721 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:38.213626 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-30ed1f07-1715-4c94-94a3-c2e9dcd2a937 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Returning 404 to user: Instance aa10127f-3488-4ff2-ac91-5411815abde8 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:38.213626 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-30ed1f07-1715-4c94-94a3-c2e9dcd2a937 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8" status: 404 len: 111 microversion: 2.1 time: 0.085040 Oct 04 20:35:38.216186 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 359/725] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:38 2022] GET /compute/v2.1/servers/aa10127f-3488-4ff2-ac91-5411815abde8 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:38.229611 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-707d79aa-6de4-4b18-a24e-0720e1aa5dea tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:38.230492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-707d79aa-6de4-4b18-a24e-0720e1aa5dea tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:38.242123 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-707d79aa-6de4-4b18-a24e-0720e1aa5dea tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.243015 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-707d79aa-6de4-4b18-a24e-0720e1aa5dea tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.243818 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-707d79aa-6de4-4b18-a24e-0720e1aa5dea tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.245141 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-707d79aa-6de4-4b18-a24e-0720e1aa5dea tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.246002 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-707d79aa-6de4-4b18-a24e-0720e1aa5dea tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.246806 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-707d79aa-6de4-4b18-a24e-0720e1aa5dea tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.264649 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-78c02c01-915a-48a8-8c65-32c8386aaa2a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:38.267751 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-78c02c01-915a-48a8-8c65-32c8386aaa2a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:38.291731 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78c02c01-915a-48a8-8c65-32c8386aaa2a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.293612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78c02c01-915a-48a8-8c65-32c8386aaa2a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.294945 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78c02c01-915a-48a8-8c65-32c8386aaa2a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.299805 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78c02c01-915a-48a8-8c65-32c8386aaa2a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.301120 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78c02c01-915a-48a8-8c65-32c8386aaa2a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.302366 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78c02c01-915a-48a8-8c65-32c8386aaa2a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.324804 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-707d79aa-6de4-4b18-a24e-0720e1aa5dea tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:35:38.486511 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-78c02c01-915a-48a8-8c65-32c8386aaa2a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:38.503827 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-78c02c01-915a-48a8-8c65-32c8386aaa2a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1216 microversion: 2.1 time: 0.264332 Oct 04 20:35:38.519948 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 360/726] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:38 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1216 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:38.837297 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-707d79aa-6de4-4b18-a24e-0720e1aa5dea tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 204 len: 0 microversion: 2.1 time: 0.610145 Oct 04 20:35:38.839168 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 367/727] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:38 2022] DELETE /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:35:38.882747 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-34c2ba2c-9a52-4f6e-bdce-e3be6a050741 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:38.894940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-34c2ba2c-9a52-4f6e-bdce-e3be6a050741 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:38.930359 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4ed89585-7d18-44cb-8c3c-fb6ab9d3dec9 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:38.935018 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-34c2ba2c-9a52-4f6e-bdce-e3be6a050741 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.935983 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-34c2ba2c-9a52-4f6e-bdce-e3be6a050741 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.936921 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-34c2ba2c-9a52-4f6e-bdce-e3be6a050741 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.938339 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-34c2ba2c-9a52-4f6e-bdce-e3be6a050741 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.939230 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4ed89585-7d18-44cb-8c3c-fb6ab9d3dec9 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:38.955294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-34c2ba2c-9a52-4f6e-bdce-e3be6a050741 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.956389 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-34c2ba2c-9a52-4f6e-bdce-e3be6a050741 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.990442 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ed89585-7d18-44cb-8c3c-fb6ab9d3dec9 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.997437 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ed89585-7d18-44cb-8c3c-fb6ab9d3dec9 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.003865 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ed89585-7d18-44cb-8c3c-fb6ab9d3dec9 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.006641 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ed89585-7d18-44cb-8c3c-fb6ab9d3dec9 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.008239 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ed89585-7d18-44cb-8c3c-fb6ab9d3dec9 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.010239 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ed89585-7d18-44cb-8c3c-fb6ab9d3dec9 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.564560 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-4ed89585-7d18-44cb-8c3c-fb6ab9d3dec9 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:39.636803 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:39.671385 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4ed89585-7d18-44cb-8c3c-fb6ab9d3dec9 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.808386 Oct 04 20:35:39.676009 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 368/728] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:38 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:39.707556 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9346ddde-5db5-4a8b-a5f0-9a2408eba2ad tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:39.711547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9346ddde-5db5-4a8b-a5f0-9a2408eba2ad tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:39.738800 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9346ddde-5db5-4a8b-a5f0-9a2408eba2ad tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.743207 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9346ddde-5db5-4a8b-a5f0-9a2408eba2ad tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.744396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9346ddde-5db5-4a8b-a5f0-9a2408eba2ad tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.748393 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9346ddde-5db5-4a8b-a5f0-9a2408eba2ad tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.751335 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9346ddde-5db5-4a8b-a5f0-9a2408eba2ad tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.760451 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9346ddde-5db5-4a8b-a5f0-9a2408eba2ad tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.760928 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-34c2ba2c-9a52-4f6e-bdce-e3be6a050741 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:39.799732 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-34c2ba2c-9a52-4f6e-bdce-e3be6a050741 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1477 microversion: 2.1 time: 0.949877 Oct 04 20:35:39.813967 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 361/729] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:38 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1477 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:39.845890 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1e8177a6-9cca-47ae-b3ef-4b06e488d10f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:39.848986 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1e8177a6-9cca-47ae-b3ef-4b06e488d10f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:39.876611 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:39.879632 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e8177a6-9cca-47ae-b3ef-4b06e488d10f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.880549 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e8177a6-9cca-47ae-b3ef-4b06e488d10f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.898042 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e8177a6-9cca-47ae-b3ef-4b06e488d10f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.898042 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e8177a6-9cca-47ae-b3ef-4b06e488d10f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.898042 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e8177a6-9cca-47ae-b3ef-4b06e488d10f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.898042 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e8177a6-9cca-47ae-b3ef-4b06e488d10f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:40.285175 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1e8177a6-9cca-47ae-b3ef-4b06e488d10f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:40.312732 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1e8177a6-9cca-47ae-b3ef-4b06e488d10f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1264 microversion: 2.1 time: 0.496789 Oct 04 20:35:40.325852 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 362/730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:39 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1264 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:40.733650 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-96bb2992-3925-40c5-9d44-faf1e6c73353 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:40.734574 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-96bb2992-3925-40c5-9d44-faf1e6c73353 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:40.752164 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9346ddde-5db5-4a8b-a5f0-9a2408eba2ad tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:40.778356 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-96bb2992-3925-40c5-9d44-faf1e6c73353 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:40.779205 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9346ddde-5db5-4a8b-a5f0-9a2408eba2ad tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1319 microversion: 2.1 time: 1.098004 Oct 04 20:35:40.780418 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 369/731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:39 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1319 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:40.780681 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-96bb2992-3925-40c5-9d44-faf1e6c73353 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:40.781751 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-96bb2992-3925-40c5-9d44-faf1e6c73353 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:40.792640 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-96bb2992-3925-40c5-9d44-faf1e6c73353 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:40.793795 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-96bb2992-3925-40c5-9d44-faf1e6c73353 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:40.795538 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-96bb2992-3925-40c5-9d44-faf1e6c73353 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:40.855727 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-89b4641f-a4fe-4ab4-81a2-ade5371d16e8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:40.859170 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-89b4641f-a4fe-4ab4-81a2-ade5371d16e8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:40.883772 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-89b4641f-a4fe-4ab4-81a2-ade5371d16e8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:40.888509 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-89b4641f-a4fe-4ab4-81a2-ade5371d16e8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:40.892744 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-89b4641f-a4fe-4ab4-81a2-ade5371d16e8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:40.894337 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-89b4641f-a4fe-4ab4-81a2-ade5371d16e8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:40.906322 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-89b4641f-a4fe-4ab4-81a2-ade5371d16e8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:40.907896 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-89b4641f-a4fe-4ab4-81a2-ade5371d16e8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:41.086093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-96bb2992-3925-40c5-9d44-faf1e6c73353 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:41.200077 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-96bb2992-3925-40c5-9d44-faf1e6c73353 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1927 microversion: 2.75 time: 0.470847 Oct 04 20:35:41.202524 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 363/732] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:40 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1927 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:35:41.363725 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-951e1ffd-ba13-472d-8269-35bd56994bfd tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:41.364955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-951e1ffd-ba13-472d-8269-35bd56994bfd tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:41.395615 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-951e1ffd-ba13-472d-8269-35bd56994bfd tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:41.396564 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-951e1ffd-ba13-472d-8269-35bd56994bfd tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:41.402553 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-951e1ffd-ba13-472d-8269-35bd56994bfd tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:41.405108 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-951e1ffd-ba13-472d-8269-35bd56994bfd tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:41.405292 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-951e1ffd-ba13-472d-8269-35bd56994bfd tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:41.408168 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-951e1ffd-ba13-472d-8269-35bd56994bfd tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:41.900236 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-951e1ffd-ba13-472d-8269-35bd56994bfd tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:41.951088 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-951e1ffd-ba13-472d-8269-35bd56994bfd tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1264 microversion: 2.1 time: 0.594237 Oct 04 20:35:41.972254 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 364/733] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:41 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1264 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:41.997557 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-35d3b626-7c71-40ab-a32e-552c1f37c870 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:42.001643 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-35d3b626-7c71-40ab-a32e-552c1f37c870 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:42.027085 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-35d3b626-7c71-40ab-a32e-552c1f37c870 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.027661 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-35d3b626-7c71-40ab-a32e-552c1f37c870 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.028102 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-35d3b626-7c71-40ab-a32e-552c1f37c870 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.028866 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-35d3b626-7c71-40ab-a32e-552c1f37c870 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.029327 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-35d3b626-7c71-40ab-a32e-552c1f37c870 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.029753 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-35d3b626-7c71-40ab-a32e-552c1f37c870 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.415294 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-89b4641f-a4fe-4ab4-81a2-ade5371d16e8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:42.442549 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-89b4641f-a4fe-4ab4-81a2-ade5371d16e8 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1477 microversion: 2.1 time: 1.591314 Oct 04 20:35:42.444151 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 370/734] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:40 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1477 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:42.467479 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-281a2bbf-ca7c-4e74-a1dd-0d048de9197d tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:42.468525 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-281a2bbf-ca7c-4e74-a1dd-0d048de9197d tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:42.503102 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-281a2bbf-ca7c-4e74-a1dd-0d048de9197d tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.504218 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-281a2bbf-ca7c-4e74-a1dd-0d048de9197d tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.505184 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-281a2bbf-ca7c-4e74-a1dd-0d048de9197d tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.506706 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-281a2bbf-ca7c-4e74-a1dd-0d048de9197d tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.507987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-281a2bbf-ca7c-4e74-a1dd-0d048de9197d tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.508987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-281a2bbf-ca7c-4e74-a1dd-0d048de9197d tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.107272 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-281a2bbf-ca7c-4e74-a1dd-0d048de9197d tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:43.179430 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-281a2bbf-ca7c-4e74-a1dd-0d048de9197d tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1933 microversion: 2.75 time: 0.732097 Oct 04 20:35:43.186788 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 371/735] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:42 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1933 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:43.194813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-69a38386-0cfc-47a1-8ece-c0b9c80f3f7a req-147abee5-9481-49a5-8013-b831cb70d4be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d937ec04-8d81-4926-a578-27ca4e58ca63", "tag": "f5495aac-c2d7-419a-9cc9-79e9ec72c16c"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:43.224958 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-69a38386-0cfc-47a1-8ece-c0b9c80f3f7a req-147abee5-9481-49a5-8013-b831cb70d4be service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.226192 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-69a38386-0cfc-47a1-8ece-c0b9c80f3f7a req-147abee5-9481-49a5-8013-b831cb70d4be service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.226903 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-69a38386-0cfc-47a1-8ece-c0b9c80f3f7a req-147abee5-9481-49a5-8013-b831cb70d4be service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.255676 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-69a38386-0cfc-47a1-8ece-c0b9c80f3f7a req-147abee5-9481-49a5-8013-b831cb70d4be service nova] Creating event network-changed:f5495aac-c2d7-419a-9cc9-79e9ec72c16c for instance d937ec04-8d81-4926-a578-27ca4e58ca63 on n-h1-852085-12 Oct 04 20:35:43.277862 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-69a38386-0cfc-47a1-8ece-c0b9c80f3f7a req-147abee5-9481-49a5-8013-b831cb70d4be service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088192 Oct 04 20:35:43.279529 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 372/736] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:43.307806 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9aa678ec-5d72-4c37-b2e4-6aa704d41d5b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:43.310081 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9aa678ec-5d72-4c37-b2e4-6aa704d41d5b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:43.327020 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9aa678ec-5d72-4c37-b2e4-6aa704d41d5b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.327020 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9aa678ec-5d72-4c37-b2e4-6aa704d41d5b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.328140 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9aa678ec-5d72-4c37-b2e4-6aa704d41d5b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.330794 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9aa678ec-5d72-4c37-b2e4-6aa704d41d5b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.332095 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9aa678ec-5d72-4c37-b2e4-6aa704d41d5b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.333152 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9aa678ec-5d72-4c37-b2e4-6aa704d41d5b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.761431 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9aa678ec-5d72-4c37-b2e4-6aa704d41d5b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:43.772698 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-35d3b626-7c71-40ab-a32e-552c1f37c870 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:43.785990 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9aa678ec-5d72-4c37-b2e4-6aa704d41d5b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1272 microversion: 2.1 time: 0.504042 Oct 04 20:35:43.790678 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 373/737] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:43 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1272 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:43.805294 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ad020755-4cc6-49b0-9d93-8ffeb8197269 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:43.807716 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ad020755-4cc6-49b0-9d93-8ffeb8197269 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:43.826624 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ad020755-4cc6-49b0-9d93-8ffeb8197269 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.828497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ad020755-4cc6-49b0-9d93-8ffeb8197269 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.830691 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ad020755-4cc6-49b0-9d93-8ffeb8197269 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.833130 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ad020755-4cc6-49b0-9d93-8ffeb8197269 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.834570 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ad020755-4cc6-49b0-9d93-8ffeb8197269 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.834777 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-35d3b626-7c71-40ab-a32e-552c1f37c870 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1319 microversion: 2.1 time: 1.859903 Oct 04 20:35:43.835813 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 365/738] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:41 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1319 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:43.836444 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ad020755-4cc6-49b0-9d93-8ffeb8197269 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.244086 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-baa6522b-6da8-49ab-b132-3a98419d1bac req-207e47d5-b5a6-491d-8b72-07027cfa6b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74855781-6009-4525-8bdc-cad56a09a352", "tag": "f1539adb-7984-4760-843a-2936f8ddf173"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:44.288794 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-baa6522b-6da8-49ab-b132-3a98419d1bac req-207e47d5-b5a6-491d-8b72-07027cfa6b5a service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.290936 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-baa6522b-6da8-49ab-b132-3a98419d1bac req-207e47d5-b5a6-491d-8b72-07027cfa6b5a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.292982 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-baa6522b-6da8-49ab-b132-3a98419d1bac req-207e47d5-b5a6-491d-8b72-07027cfa6b5a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.347102 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-baa6522b-6da8-49ab-b132-3a98419d1bac req-207e47d5-b5a6-491d-8b72-07027cfa6b5a service nova] Creating event network-changed:f1539adb-7984-4760-843a-2936f8ddf173 for instance 74855781-6009-4525-8bdc-cad56a09a352 on n-h2-852085-12 Oct 04 20:35:44.368078 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-baa6522b-6da8-49ab-b132-3a98419d1bac req-207e47d5-b5a6-491d-8b72-07027cfa6b5a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136642 Oct 04 20:35:44.383393 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 366/739] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:44.383393 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0190540c-5fdb-45f8-b48d-689c1b35dceb tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:44.383393 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0190540c-5fdb-45f8-b48d-689c1b35dceb tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:44.418782 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0190540c-5fdb-45f8-b48d-689c1b35dceb tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.421943 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0190540c-5fdb-45f8-b48d-689c1b35dceb tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.424447 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0190540c-5fdb-45f8-b48d-689c1b35dceb tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.426595 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0190540c-5fdb-45f8-b48d-689c1b35dceb tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.433078 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0190540c-5fdb-45f8-b48d-689c1b35dceb tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.436255 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0190540c-5fdb-45f8-b48d-689c1b35dceb tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.750325 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-0190540c-5fdb-45f8-b48d-689c1b35dceb tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:44.797300 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0190540c-5fdb-45f8-b48d-689c1b35dceb tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1933 microversion: 2.75 time: 0.423872 Oct 04 20:35:44.815739 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 367/740] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:44 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1933 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:44.852409 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1d696616-4ccd-4cd1-b2d5-07960fb5412d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:44.854048 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1d696616-4ccd-4cd1-b2d5-07960fb5412d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:44.867944 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d696616-4ccd-4cd1-b2d5-07960fb5412d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.869626 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d696616-4ccd-4cd1-b2d5-07960fb5412d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.870875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d696616-4ccd-4cd1-b2d5-07960fb5412d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.872693 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d696616-4ccd-4cd1-b2d5-07960fb5412d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.873912 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d696616-4ccd-4cd1-b2d5-07960fb5412d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.875294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d696616-4ccd-4cd1-b2d5-07960fb5412d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.936009 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=100 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:45.249842 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1d696616-4ccd-4cd1-b2d5-07960fb5412d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:45.270825 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1d696616-4ccd-4cd1-b2d5-07960fb5412d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1272 microversion: 2.1 time: 0.433399 Oct 04 20:35:45.272680 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 368/741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:44 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1272 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:45.288361 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b0a54bd6-720b-4d5a-8056-f2052c202062 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:45.290089 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b0a54bd6-720b-4d5a-8056-f2052c202062 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:45.303937 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0a54bd6-720b-4d5a-8056-f2052c202062 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.305891 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0a54bd6-720b-4d5a-8056-f2052c202062 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.307181 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0a54bd6-720b-4d5a-8056-f2052c202062 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.309587 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0a54bd6-720b-4d5a-8056-f2052c202062 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.313485 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0a54bd6-720b-4d5a-8056-f2052c202062 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.315095 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0a54bd6-720b-4d5a-8056-f2052c202062 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.608056 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:45.661927 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ad020755-4cc6-49b0-9d93-8ffeb8197269 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:45.668429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=6 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:45.700052 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ad020755-4cc6-49b0-9d93-8ffeb8197269 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1477 microversion: 2.1 time: 1.906638 Oct 04 20:35:45.704874 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 374/742] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:43 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1477 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:45.860719 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-67456492-c967-48bd-9989-39699875a267 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:45.862270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-67456492-c967-48bd-9989-39699875a267 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:45.874993 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-67456492-c967-48bd-9989-39699875a267 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.876699 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-67456492-c967-48bd-9989-39699875a267 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.877794 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-67456492-c967-48bd-9989-39699875a267 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.879254 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-67456492-c967-48bd-9989-39699875a267 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.880764 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-67456492-c967-48bd-9989-39699875a267 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.883636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-67456492-c967-48bd-9989-39699875a267 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.132485 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-67456492-c967-48bd-9989-39699875a267 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:46.202638 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b0a54bd6-720b-4d5a-8056-f2052c202062 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:46.203984 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-67456492-c967-48bd-9989-39699875a267 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1933 microversion: 2.75 time: 0.350938 Oct 04 20:35:46.204934 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 375/743] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:45 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1933 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:35:46.225570 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b0a54bd6-720b-4d5a-8056-f2052c202062 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1319 microversion: 2.1 time: 0.949866 Oct 04 20:35:46.243186 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 369/744] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:45 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1319 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:46.324339 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-850fa27d-c707-403e-80ff-ab81a82103ff tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:46.325928 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-850fa27d-c707-403e-80ff-ab81a82103ff tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:46.338885 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-850fa27d-c707-403e-80ff-ab81a82103ff tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.340457 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-850fa27d-c707-403e-80ff-ab81a82103ff tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.341258 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-850fa27d-c707-403e-80ff-ab81a82103ff tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.343190 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-850fa27d-c707-403e-80ff-ab81a82103ff tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.344503 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-850fa27d-c707-403e-80ff-ab81a82103ff tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.345295 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-850fa27d-c707-403e-80ff-ab81a82103ff tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.586730 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-850fa27d-c707-403e-80ff-ab81a82103ff tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:46.622099 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-850fa27d-c707-403e-80ff-ab81a82103ff tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1270 microversion: 2.1 time: 0.305760 Oct 04 20:35:46.651420 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 376/745] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:46 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1270 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:46.728565 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-8c2daad9-f798-4e68-bc37-c7ae9a34f18d req-bdfda0b3-1774-49a0-95b2-c8bd81abdcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9bfdee0-1a5d-4f35-b3be-ea3017b41442", "name": "network-vif-deleted", "tag": "4f6676f8-f93e-43e5-81f8-b66d1444428a"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:46.750053 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-8c2daad9-f798-4e68-bc37-c7ae9a34f18d req-bdfda0b3-1774-49a0-95b2-c8bd81abdcf6 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.751502 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-8c2daad9-f798-4e68-bc37-c7ae9a34f18d req-bdfda0b3-1774-49a0-95b2-c8bd81abdcf6 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.752784 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-8c2daad9-f798-4e68-bc37-c7ae9a34f18d req-bdfda0b3-1774-49a0-95b2-c8bd81abdcf6 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.758214 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-20263713-e1c2-4ddb-b5e4-66da564515e1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:46.760196 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-20263713-e1c2-4ddb-b5e4-66da564515e1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:46.773902 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20263713-e1c2-4ddb-b5e4-66da564515e1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.774917 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20263713-e1c2-4ddb-b5e4-66da564515e1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.775748 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20263713-e1c2-4ddb-b5e4-66da564515e1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.777101 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20263713-e1c2-4ddb-b5e4-66da564515e1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.778530 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20263713-e1c2-4ddb-b5e4-66da564515e1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.779512 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20263713-e1c2-4ddb-b5e4-66da564515e1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.821393 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-8c2daad9-f798-4e68-bc37-c7ae9a34f18d req-bdfda0b3-1774-49a0-95b2-c8bd81abdcf6 service nova] Creating event network-vif-deleted:4f6676f8-f93e-43e5-81f8-b66d1444428a for instance b9bfdee0-1a5d-4f35-b3be-ea3017b41442 on n-h1-852085-12 Oct 04 20:35:46.843523 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-8c2daad9-f798-4e68-bc37-c7ae9a34f18d req-bdfda0b3-1774-49a0-95b2-c8bd81abdcf6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115282 Oct 04 20:35:46.845491 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 370/746] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:47.090820 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-20263713-e1c2-4ddb-b5e4-66da564515e1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:47.118609 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-20263713-e1c2-4ddb-b5e4-66da564515e1 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1435 microversion: 2.1 time: 0.372938 Oct 04 20:35:47.128894 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 377/747] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:46 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1435 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:47.272406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cfb1211f-813f-4185-bad3-d79017c45962 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.279243 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-cfb1211f-813f-4185-bad3-d79017c45962 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:47.282502 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3ca5358f-e30f-407c-b8ac-81b915986af5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.283371 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3ca5358f-e30f-407c-b8ac-81b915986af5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:47.293633 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:47.307345 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3ca5358f-e30f-407c-b8ac-81b915986af5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.307635 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cfb1211f-813f-4185-bad3-d79017c45962 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.309251 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3ca5358f-e30f-407c-b8ac-81b915986af5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.310210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3ca5358f-e30f-407c-b8ac-81b915986af5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.311594 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3ca5358f-e30f-407c-b8ac-81b915986af5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.313945 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3ca5358f-e30f-407c-b8ac-81b915986af5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.315600 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3ca5358f-e30f-407c-b8ac-81b915986af5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.319501 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cfb1211f-813f-4185-bad3-d79017c45962 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.321911 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cfb1211f-813f-4185-bad3-d79017c45962 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.323567 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cfb1211f-813f-4185-bad3-d79017c45962 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.324302 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cfb1211f-813f-4185-bad3-d79017c45962 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.333487 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cfb1211f-813f-4185-bad3-d79017c45962 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.745314 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-cfb1211f-813f-4185-bad3-d79017c45962 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:47.795449 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cfb1211f-813f-4185-bad3-d79017c45962 tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1933 microversion: 2.75 time: 0.534025 Oct 04 20:35:47.808860 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 371/748] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1933 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:47.810295 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a0e4ab3c-b882-48b9-92bb-7856ebf7ce4f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.812129 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a0e4ab3c-b882-48b9-92bb-7856ebf7ce4f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:47.826093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a0e4ab3c-b882-48b9-92bb-7856ebf7ce4f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.828973 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a0e4ab3c-b882-48b9-92bb-7856ebf7ce4f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.831829 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a0e4ab3c-b882-48b9-92bb-7856ebf7ce4f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.834274 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a0e4ab3c-b882-48b9-92bb-7856ebf7ce4f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.837462 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a0e4ab3c-b882-48b9-92bb-7856ebf7ce4f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.839597 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a0e4ab3c-b882-48b9-92bb-7856ebf7ce4f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.142288 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a0e4ab3c-b882-48b9-92bb-7856ebf7ce4f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:48.164220 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a0e4ab3c-b882-48b9-92bb-7856ebf7ce4f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1270 microversion: 2.1 time: 0.363455 Oct 04 20:35:48.165398 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 372/749] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1270 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:48.185944 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:48.188761 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:48.201960 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:48.202606 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:48.203090 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.204922 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:48.206014 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:48.206796 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.279785 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:48.290934 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:48.292830 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.294111 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lazy-loading 'fault' on Instance uuid b9bfdee0-1a5d-4f35-b3be-ea3017b41442 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:48.503105 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3ca5358f-e30f-407c-b8ac-81b915986af5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:48.523025 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3ca5358f-e30f-407c-b8ac-81b915986af5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1319 microversion: 2.1 time: 1.244990 Oct 04 20:35:48.524116 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 378/750] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1319 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:48.733347 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:48.756731 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-62c9042e-68bf-4e54-bae8-8e7f0e47d9f0 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1311 microversion: 2.1 time: 0.579814 Oct 04 20:35:48.762619 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 373/751] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:48 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1311 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:48.877904 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f6861678-2d61-4ea8-bb09-9f670f5d1f2e tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:48.882374 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f6861678-2d61-4ea8-bb09-9f670f5d1f2e tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:48.898787 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6861678-2d61-4ea8-bb09-9f670f5d1f2e tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:48.900755 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6861678-2d61-4ea8-bb09-9f670f5d1f2e tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:48.902080 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6861678-2d61-4ea8-bb09-9f670f5d1f2e tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.906081 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6861678-2d61-4ea8-bb09-9f670f5d1f2e tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:48.909409 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6861678-2d61-4ea8-bb09-9f670f5d1f2e tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:48.911045 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6861678-2d61-4ea8-bb09-9f670f5d1f2e tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.204138 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cb5a9136-a3d2-49ad-9ad0-c555c86e8e82 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:49.205148 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-cb5a9136-a3d2-49ad-9ad0-c555c86e8e82 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:49.216043 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb5a9136-a3d2-49ad-9ad0-c555c86e8e82 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.216883 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb5a9136-a3d2-49ad-9ad0-c555c86e8e82 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.217944 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb5a9136-a3d2-49ad-9ad0-c555c86e8e82 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.219805 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb5a9136-a3d2-49ad-9ad0-c555c86e8e82 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.220966 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb5a9136-a3d2-49ad-9ad0-c555c86e8e82 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.221726 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb5a9136-a3d2-49ad-9ad0-c555c86e8e82 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.455674 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-f6861678-2d61-4ea8-bb09-9f670f5d1f2e tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] Lazy-loading 'services' on Instance uuid ccb6a102-8cc0-4764-98b0-5b6e0796bc35 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:49.496136 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:49.502204 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f6861678-2d61-4ea8-bb09-9f670f5d1f2e tempest-ServersAdmin275Test-1729090410 tempest-ServersAdmin275Test-1729090410-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1918 microversion: 2.75 time: 0.646616 Oct 04 20:35:49.514259 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 379/752] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:48 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1918 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:49.541645 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-cb5a9136-a3d2-49ad-9ad0-c555c86e8e82 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:49.574703 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f33eef0f-b806-4a5a-b759-65535600e60b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:49.576100 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f33eef0f-b806-4a5a-b759-65535600e60b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:49.589539 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f33eef0f-b806-4a5a-b759-65535600e60b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.590435 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f33eef0f-b806-4a5a-b759-65535600e60b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.599119 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cb5a9136-a3d2-49ad-9ad0-c555c86e8e82 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1270 microversion: 2.1 time: 0.392122 Oct 04 20:35:49.599399 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f33eef0f-b806-4a5a-b759-65535600e60b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.599399 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f33eef0f-b806-4a5a-b759-65535600e60b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.599399 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f33eef0f-b806-4a5a-b759-65535600e60b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.599399 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f33eef0f-b806-4a5a-b759-65535600e60b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.605360 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 374/753] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:49 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1270 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:49.616020 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-086e3e12-969f-43c0-9500-462e761f57cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:49.617891 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-086e3e12-969f-43c0-9500-462e761f57cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:49.631000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-086e3e12-969f-43c0-9500-462e761f57cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.632450 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-086e3e12-969f-43c0-9500-462e761f57cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.634519 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-086e3e12-969f-43c0-9500-462e761f57cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.636707 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-086e3e12-969f-43c0-9500-462e761f57cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.638048 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-086e3e12-969f-43c0-9500-462e761f57cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.639344 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-086e3e12-969f-43c0-9500-462e761f57cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.703283 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f33eef0f-b806-4a5a-b759-65535600e60b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:35:50.257738 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-086e3e12-969f-43c0-9500-462e761f57cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:50.276537 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-086e3e12-969f-43c0-9500-462e761f57cd tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1319 microversion: 2.1 time: 0.668522 Oct 04 20:35:50.303229 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 375/754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:49 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1319 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:50.309245 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f33eef0f-b806-4a5a-b759-65535600e60b tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 204 len: 0 microversion: 2.75 time: 0.749878 Oct 04 20:35:50.317583 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 380/755] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:35:49 2022] DELETE /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:35:50.327565 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:50.329203 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:50.340844 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c1933952-fa6a-482b-8ca1-4e82f3eabff3 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:50.341987 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.342333 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c1933952-fa6a-482b-8ca1-4e82f3eabff3 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:50.344433 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.346003 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.347873 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.349179 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.350330 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.367308 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c1933952-fa6a-482b-8ca1-4e82f3eabff3 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.372988 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c1933952-fa6a-482b-8ca1-4e82f3eabff3 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.374929 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c1933952-fa6a-482b-8ca1-4e82f3eabff3 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.377116 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c1933952-fa6a-482b-8ca1-4e82f3eabff3 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.378416 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c1933952-fa6a-482b-8ca1-4e82f3eabff3 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.379321 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c1933952-fa6a-482b-8ca1-4e82f3eabff3 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.511191 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.512070 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.512988 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.513992 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lazy-loading 'fault' on Instance uuid b9bfdee0-1a5d-4f35-b3be-ea3017b41442 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:50.675050 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caebe70d8da45aebdeeae629801512c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e024c248dfa402e9aa19677dd749c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:50.697427 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-957e76b1-3580-49de-8fb6-b3a3c5be27e4 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 200 len: 1311 microversion: 2.1 time: 0.391558 Oct 04 20:35:50.750498 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 376/756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:50 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 1311 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:50.772658 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4725934e-15bd-4441-8fa9-4d2c2d8dddc3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:50.773110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c1933952-fa6a-482b-8ca1-4e82f3eabff3 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:50.777793 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4725934e-15bd-4441-8fa9-4d2c2d8dddc3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:50.826052 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c1933952-fa6a-482b-8ca1-4e82f3eabff3 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:50.827856 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4725934e-15bd-4441-8fa9-4d2c2d8dddc3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.829454 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4725934e-15bd-4441-8fa9-4d2c2d8dddc3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.843024 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c1933952-fa6a-482b-8ca1-4e82f3eabff3 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:50.844045 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4725934e-15bd-4441-8fa9-4d2c2d8dddc3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.848791 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4725934e-15bd-4441-8fa9-4d2c2d8dddc3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.852728 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4725934e-15bd-4441-8fa9-4d2c2d8dddc3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.854249 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4725934e-15bd-4441-8fa9-4d2c2d8dddc3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.868741 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c1933952-fa6a-482b-8ca1-4e82f3eabff3 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1442 microversion: 2.75 time: 0.547859 Oct 04 20:35:50.883751 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 381/757] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:50 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1442 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:51.339298 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e8ae872a-e9e4-4c67-87e9-db60b7a18559 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:51.341029 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e8ae872a-e9e4-4c67-87e9-db60b7a18559 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:51.354761 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8ae872a-e9e4-4c67-87e9-db60b7a18559 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:51.356442 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8ae872a-e9e4-4c67-87e9-db60b7a18559 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:51.357691 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8ae872a-e9e4-4c67-87e9-db60b7a18559 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:51.359571 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8ae872a-e9e4-4c67-87e9-db60b7a18559 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:51.361339 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8ae872a-e9e4-4c67-87e9-db60b7a18559 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:51.362466 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8ae872a-e9e4-4c67-87e9-db60b7a18559 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.569666 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e8ae872a-e9e4-4c67-87e9-db60b7a18559 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:52.606341 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4725934e-15bd-4441-8fa9-4d2c2d8dddc3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:52.648368 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e8ae872a-e9e4-4c67-87e9-db60b7a18559 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1319 microversion: 2.1 time: 1.318542 Oct 04 20:35:52.651039 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4725934e-15bd-4441-8fa9-4d2c2d8dddc3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1312 microversion: 2.1 time: 1.898060 Oct 04 20:35:52.651656 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 382/758] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:51 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1319 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:52.655117 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 377/759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:50 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1312 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:52.677344 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-83996aaf-5904-45df-9d08-1e00d40e8c90 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:52.681615 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-83996aaf-5904-45df-9d08-1e00d40e8c90 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] [instance: b9bfdee0-1a5d-4f35-b3be-ea3017b41442] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:52.697860 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9cfce6ae-a56f-489d-9790-7f921f7a5687 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:52.707042 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9cfce6ae-a56f-489d-9790-7f921f7a5687 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:52.713606 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83996aaf-5904-45df-9d08-1e00d40e8c90 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.714481 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83996aaf-5904-45df-9d08-1e00d40e8c90 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.717596 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83996aaf-5904-45df-9d08-1e00d40e8c90 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.719778 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83996aaf-5904-45df-9d08-1e00d40e8c90 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.725495 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9cfce6ae-a56f-489d-9790-7f921f7a5687 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.739263 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9cfce6ae-a56f-489d-9790-7f921f7a5687 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.739589 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83996aaf-5904-45df-9d08-1e00d40e8c90 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.739928 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83996aaf-5904-45df-9d08-1e00d40e8c90 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.740998 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9cfce6ae-a56f-489d-9790-7f921f7a5687 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.743342 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9cfce6ae-a56f-489d-9790-7f921f7a5687 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.744674 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9cfce6ae-a56f-489d-9790-7f921f7a5687 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.753254 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9cfce6ae-a56f-489d-9790-7f921f7a5687 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.822848 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-83996aaf-5904-45df-9d08-1e00d40e8c90 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] HTTP exception thrown: Instance b9bfdee0-1a5d-4f35-b3be-ea3017b41442 could not be found. Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-83996aaf-5904-45df-9d08-1e00d40e8c90 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Request method failure captured: Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 HTTP/1.1 Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJimTHDQ2n_IMc7D9b3nHx_xqqV8TkGrOA0daJr-LYdy_3t71I2eLJ24qgWAkynqH4-iEUiwZcW-2vzseTNQkC7acx-YqeO3oLsDhS_pOn4Bu_NQ6S81YCA6wotyVrV2ggvEjhyo3w-m-EwjB6h6hk0oiFU6oOzYbpRSGozqRzTgAeg Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 7e024c248dfa402e9aa19677dd749c9f Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-564248376 Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:35:52.826965 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:35:52.830181 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7e024c248dfa402e9aa19677dd749c9f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e024c248dfa402e9aa19677dd749c9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e024c248dfa402e9aa19677dd749c9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7e024c248dfa402e9aa19677dd749c9f"}]}] Oct 04 20:35:52.830181 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersAdminNegativeTestJSON-564248376 Oct 04 20:35:52.830181 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 7e024c248dfa402e9aa19677dd749c9f Oct 04 20:35:52.830181 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-564248376 Oct 04 20:35:52.830181 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersAdminNegativeTestJSON-564248376-project Oct 04 20:35:52.830181 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:35:52.830181 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:35:52.830181 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 7caebe70d8da45aebdeeae629801512c Oct 04 20:35:52.830181 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersAdminNegativeTestJSON-564248376-project Oct 04 20:35:52.830181 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:35:52.830181 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance b9bfdee0-1a5d-4f35-b3be-ea3017b41442 could not be found. Oct 04 20:35:52.830181 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'b9bfdee0-1a5d-4f35-b3be-ea3017b41442'} Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9bfdee0-1a5d-4f35-b3be-ea3017b41442 could not be found. Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:52.832155 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9bfdee0-1a5d-4f35-b3be-ea3017b41442 could not be found. Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9bfdee0-1a5d-4f35-b3be-ea3017b41442 could not be found. Oct 04 20:35:52.834882 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:35:52.839339 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-83996aaf-5904-45df-9d08-1e00d40e8c90 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] Returning 404 to user: Instance b9bfdee0-1a5d-4f35-b3be-ea3017b41442 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:52.841370 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-83996aaf-5904-45df-9d08-1e00d40e8c90 tempest-ServersAdminNegativeTestJSON-564248376 tempest-ServersAdminNegativeTestJSON-564248376-project] 10.222.0.78 "GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442" status: 404 len: 111 microversion: 2.1 time: 0.182146 Oct 04 20:35:52.849259 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 378/760] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:52 2022] GET /compute/v2.1/servers/b9bfdee0-1a5d-4f35-b3be-ea3017b41442 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:52.898415 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:53.281334 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9cfce6ae-a56f-489d-9790-7f921f7a5687 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:53.311785 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9cfce6ae-a56f-489d-9790-7f921f7a5687 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:53.320780 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9cfce6ae-a56f-489d-9790-7f921f7a5687 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '386f857786474effa6df298d43738c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526ce79b3ad7461eb974329c1e567568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:53.332439 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9cfce6ae-a56f-489d-9790-7f921f7a5687 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 200 len: 1442 microversion: 2.75 time: 0.667734 Oct 04 20:35:53.334729 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 383/761] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:52 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 1442 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:53.699945 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c8bbfdc7-962c-4eea-9a3a-d1dcc9be9086 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:53.702268 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c9649372-f6c1-4741-b16d-e4e679c39a25 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:53.703059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c8bbfdc7-962c-4eea-9a3a-d1dcc9be9086 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:53.703521 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c9649372-f6c1-4741-b16d-e4e679c39a25 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:53.733715 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c9649372-f6c1-4741-b16d-e4e679c39a25 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:53.735214 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c9649372-f6c1-4741-b16d-e4e679c39a25 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:53.736389 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c9649372-f6c1-4741-b16d-e4e679c39a25 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:53.746123 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c8bbfdc7-962c-4eea-9a3a-d1dcc9be9086 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:53.746991 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c8bbfdc7-962c-4eea-9a3a-d1dcc9be9086 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:53.747706 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c8bbfdc7-962c-4eea-9a3a-d1dcc9be9086 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:53.748832 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c9649372-f6c1-4741-b16d-e4e679c39a25 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:53.749059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c8bbfdc7-962c-4eea-9a3a-d1dcc9be9086 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:53.749808 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c8bbfdc7-962c-4eea-9a3a-d1dcc9be9086 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:53.750907 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c9649372-f6c1-4741-b16d-e4e679c39a25 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:53.751190 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c8bbfdc7-962c-4eea-9a3a-d1dcc9be9086 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:53.751787 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c9649372-f6c1-4741-b16d-e4e679c39a25 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:57.513847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c8bbfdc7-962c-4eea-9a3a-d1dcc9be9086 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:57.564961 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c9649372-f6c1-4741-b16d-e4e679c39a25 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:57.573041 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c8bbfdc7-962c-4eea-9a3a-d1dcc9be9086 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1319 microversion: 2.1 time: 3.859014 Oct 04 20:35:57.576627 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 384/762] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:53 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1319 bytes in 3884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:57.608024 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-da6cfc94-6cdb-40bf-b71a-73dcea66a730 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:57.610805 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-da6cfc94-6cdb-40bf-b71a-73dcea66a730 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] [instance: ccb6a102-8cc0-4764-98b0-5b6e0796bc35] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:57.631089 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c9649372-f6c1-4741-b16d-e4e679c39a25 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1312 microversion: 2.1 time: 3.928756 Oct 04 20:35:57.632662 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 379/763] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:53 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1312 bytes in 3940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:57.651067 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-da6cfc94-6cdb-40bf-b71a-73dcea66a730 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:57.654725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-da6cfc94-6cdb-40bf-b71a-73dcea66a730 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:57.654725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-da6cfc94-6cdb-40bf-b71a-73dcea66a730 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:57.656643 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-da6cfc94-6cdb-40bf-b71a-73dcea66a730 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:57.657807 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-da6cfc94-6cdb-40bf-b71a-73dcea66a730 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:57.659256 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-da6cfc94-6cdb-40bf-b71a-73dcea66a730 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:57.662424 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-789c676b-da0c-4596-932e-43edb8403e0b req-e7b66ae7-5882-4edf-bc16-dcdc375fac61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d937ec04-8d81-4926-a578-27ca4e58ca63", "name": "network-vif-plugged", "status": "completed", "tag": "f5495aac-c2d7-419a-9cc9-79e9ec72c16c"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:57.709097 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-789c676b-da0c-4596-932e-43edb8403e0b req-e7b66ae7-5882-4edf-bc16-dcdc375fac61 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:57.709859 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-789c676b-da0c-4596-932e-43edb8403e0b req-e7b66ae7-5882-4edf-bc16-dcdc375fac61 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:57.710500 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-789c676b-da0c-4596-932e-43edb8403e0b req-e7b66ae7-5882-4edf-bc16-dcdc375fac61 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:57.736617 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-da6cfc94-6cdb-40bf-b71a-73dcea66a730 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] HTTP exception thrown: Instance ccb6a102-8cc0-4764-98b0-5b6e0796bc35 could not be found. Oct 04 20:35:57.743960 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-789c676b-da0c-4596-932e-43edb8403e0b req-e7b66ae7-5882-4edf-bc16-dcdc375fac61 service nova] Creating event network-vif-plugged:f5495aac-c2d7-419a-9cc9-79e9ec72c16c for instance d937ec04-8d81-4926-a578-27ca4e58ca63 on n-h1-852085-12 Oct 04 20:35:57.759173 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-789c676b-da0c-4596-932e-43edb8403e0b req-e7b66ae7-5882-4edf-bc16-dcdc375fac61 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120314 Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-da6cfc94-6cdb-40bf-b71a-73dcea66a730 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Request method failure captured: Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 HTTP/1.1 Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJjC7H9fl1VH3nhhRzMzCMvKQ2CB2fjE5k8-wmZw0rGrivtu00TCLduepJq8iOAP0n7uwnzZUMlN4MbJbA86b7rnRqqAWvXVve-TFgQU2rEhcQ_Bx07vVlkiz2IvfLIM12F_znwiJAVP_wtLJRBraW2279MtFBReu8MABf4dCQZfyco Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: X-Openstack-Nova-Api-Version: 2.75 Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 526ce79b3ad7461eb974329c1e567568 Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersAdmin275Test-160193449 Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:35:57.760405 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:35:57.777239 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_526ce79b3ad7461eb974329c1e567568", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/526ce79b3ad7461eb974329c1e567568"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/526ce79b3ad7461eb974329c1e567568"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/526ce79b3ad7461eb974329c1e567568"}]}] Oct 04 20:35:57.777239 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersAdmin275Test-160193449 Oct 04 20:35:57.777239 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 526ce79b3ad7461eb974329c1e567568 Oct 04 20:35:57.777239 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersAdmin275Test-160193449 Oct 04 20:35:57.777239 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersAdmin275Test-160193449-project Oct 04 20:35:57.777239 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:35:57.777239 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:35:57.777239 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 386f857786474effa6df298d43738c92 Oct 04 20:35:57.777239 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersAdmin275Test-160193449-project Oct 04 20:35:57.777239 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:35:57.777239 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance ccb6a102-8cc0-4764-98b0-5b6e0796bc35 could not be found. Oct 04 20:35:57.777239 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'ccb6a102-8cc0-4764-98b0-5b6e0796bc35'} Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccb6a102-8cc0-4764-98b0-5b6e0796bc35 could not be found. Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:57.786280 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccb6a102-8cc0-4764-98b0-5b6e0796bc35 could not be found. Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccb6a102-8cc0-4764-98b0-5b6e0796bc35 could not be found. Oct 04 20:35:57.789036 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:35:57.791681 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-da6cfc94-6cdb-40bf-b71a-73dcea66a730 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] Returning 404 to user: Instance ccb6a102-8cc0-4764-98b0-5b6e0796bc35 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:57.791681 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-da6cfc94-6cdb-40bf-b71a-73dcea66a730 tempest-ServersAdmin275Test-160193449 tempest-ServersAdmin275Test-160193449-project] 10.222.0.78 "GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35" status: 404 len: 111 microversion: 2.75 time: 0.184806 Oct 04 20:35:57.791681 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 385/764] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:57 2022] GET /compute/v2.1/servers/ccb6a102-8cc0-4764-98b0-5b6e0796bc35 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:57.792147 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 380/765] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:58.629444 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bcee257e-f55a-41b8-821e-bd9a210234ff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:58.630876 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-bcee257e-f55a-41b8-821e-bd9a210234ff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:58.660110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bcee257e-f55a-41b8-821e-bd9a210234ff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:58.661228 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bcee257e-f55a-41b8-821e-bd9a210234ff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:58.662147 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bcee257e-f55a-41b8-821e-bd9a210234ff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:58.663559 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bcee257e-f55a-41b8-821e-bd9a210234ff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:58.664946 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bcee257e-f55a-41b8-821e-bd9a210234ff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:58.666129 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bcee257e-f55a-41b8-821e-bd9a210234ff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:58.707850 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bdc6a16a-c983-4796-b637-dd18437c97fe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:58.707850 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-bdc6a16a-c983-4796-b637-dd18437c97fe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:58.738627 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bdc6a16a-c983-4796-b637-dd18437c97fe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:58.741446 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bdc6a16a-c983-4796-b637-dd18437c97fe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:58.744502 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bdc6a16a-c983-4796-b637-dd18437c97fe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:58.748562 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bdc6a16a-c983-4796-b637-dd18437c97fe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:58.749603 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bdc6a16a-c983-4796-b637-dd18437c97fe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:58.751358 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bdc6a16a-c983-4796-b637-dd18437c97fe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:00.269496 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-bdc6a16a-c983-4796-b637-dd18437c97fe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:00.331628 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bdc6a16a-c983-4796-b637-dd18437c97fe tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1312 microversion: 2.1 time: 1.645921 Oct 04 20:36:00.337040 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 381/766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:58 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1312 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:00.348503 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-78d2cab5-ea0f-4bf1-b750-371f4fe81b91 req-e5b5a75e-0705-4479-9f36-5a1afcdf3960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74855781-6009-4525-8bdc-cad56a09a352", "name": "network-vif-plugged", "status": "completed", "tag": "f1539adb-7984-4760-843a-2936f8ddf173"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:00.393642 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-78d2cab5-ea0f-4bf1-b750-371f4fe81b91 req-e5b5a75e-0705-4479-9f36-5a1afcdf3960 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:00.394634 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-78d2cab5-ea0f-4bf1-b750-371f4fe81b91 req-e5b5a75e-0705-4479-9f36-5a1afcdf3960 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:00.395447 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-78d2cab5-ea0f-4bf1-b750-371f4fe81b91 req-e5b5a75e-0705-4479-9f36-5a1afcdf3960 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:00.440299 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-78d2cab5-ea0f-4bf1-b750-371f4fe81b91 req-e5b5a75e-0705-4479-9f36-5a1afcdf3960 service nova] Creating event network-vif-plugged:f1539adb-7984-4760-843a-2936f8ddf173 for instance 74855781-6009-4525-8bdc-cad56a09a352 on n-h2-852085-12 Oct 04 20:36:00.455709 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-78d2cab5-ea0f-4bf1-b750-371f4fe81b91 req-e5b5a75e-0705-4479-9f36-5a1afcdf3960 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116103 Oct 04 20:36:00.458461 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 382/767] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:00.766736 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-ffb0470a-d669-4b5f-9724-4277525ebd7b req-821b10e4-c573-412e-a600-23e4575cf60f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cbd24d1-c9b9-4e54-a25f-c8553d279e56", "tag": "1611f154-8d2e-4661-a90c-96f5a6d2c5f8"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:00.768223 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:36:00.769637 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 20:36:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 (ip 10.222.0.78) !!! Oct 04 20:36:00.812814 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-ffb0470a-d669-4b5f-9724-4277525ebd7b req-821b10e4-c573-412e-a600-23e4575cf60f service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:00.814659 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-ffb0470a-d669-4b5f-9724-4277525ebd7b req-821b10e4-c573-412e-a600-23e4575cf60f service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:00.815884 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-ffb0470a-d669-4b5f-9724-4277525ebd7b req-821b10e4-c573-412e-a600-23e4575cf60f service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:00.816215 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bcee257e-f55a-41b8-821e-bd9a210234ff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:00.839174 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-ffb0470a-d669-4b5f-9724-4277525ebd7b req-821b10e4-c573-412e-a600-23e4575cf60f service nova] Creating event network-changed:1611f154-8d2e-4661-a90c-96f5a6d2c5f8 for instance 3cbd24d1-c9b9-4e54-a25f-c8553d279e56 on n-h1-852085-12 Oct 04 20:36:00.849386 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-ffb0470a-d669-4b5f-9724-4277525ebd7b req-821b10e4-c573-412e-a600-23e4575cf60f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093072 Oct 04 20:36:00.851428 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 383/768] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:00.881279 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bcee257e-f55a-41b8-821e-bd9a210234ff tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1319 microversion: 2.1 time: 2.255601 Oct 04 20:36:00.897299 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 386/769] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:58 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1319 bytes in 2276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:01.389595 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4e457260-96fd-49b3-9ab1-a36e8bbbb5a4 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:01.395484 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4e457260-96fd-49b3-9ab1-a36e8bbbb5a4 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:01.426428 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e457260-96fd-49b3-9ab1-a36e8bbbb5a4 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:01.427387 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e457260-96fd-49b3-9ab1-a36e8bbbb5a4 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:01.428214 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e457260-96fd-49b3-9ab1-a36e8bbbb5a4 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:01.429581 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e457260-96fd-49b3-9ab1-a36e8bbbb5a4 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:01.430471 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e457260-96fd-49b3-9ab1-a36e8bbbb5a4 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:01.449581 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e457260-96fd-49b3-9ab1-a36e8bbbb5a4 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:01.946601 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c4002934-77b8-4a12-9677-8296f3a0a36e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:01.949332 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c4002934-77b8-4a12-9677-8296f3a0a36e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:01.977542 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c4002934-77b8-4a12-9677-8296f3a0a36e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:01.978593 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c4002934-77b8-4a12-9677-8296f3a0a36e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:01.979740 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c4002934-77b8-4a12-9677-8296f3a0a36e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:01.981383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c4002934-77b8-4a12-9677-8296f3a0a36e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:01.984558 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c4002934-77b8-4a12-9677-8296f3a0a36e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:01.987803 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c4002934-77b8-4a12-9677-8296f3a0a36e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:02.502934 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4e457260-96fd-49b3-9ab1-a36e8bbbb5a4 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:02.534715 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4e457260-96fd-49b3-9ab1-a36e8bbbb5a4 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1312 microversion: 2.1 time: 1.157348 Oct 04 20:36:02.537035 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 384/770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:01 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1312 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:03.596873 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6afe53eb-deb1-4909-ae07-ba68d9ad5c61 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:03.599599 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-6afe53eb-deb1-4909-ae07-ba68d9ad5c61 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:03.629086 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6afe53eb-deb1-4909-ae07-ba68d9ad5c61 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:03.630395 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6afe53eb-deb1-4909-ae07-ba68d9ad5c61 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:03.634875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6afe53eb-deb1-4909-ae07-ba68d9ad5c61 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:03.637479 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6afe53eb-deb1-4909-ae07-ba68d9ad5c61 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:03.638534 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6afe53eb-deb1-4909-ae07-ba68d9ad5c61 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:03.639450 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6afe53eb-deb1-4909-ae07-ba68d9ad5c61 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:03.881149 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c4002934-77b8-4a12-9677-8296f3a0a36e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:03.911005 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c4002934-77b8-4a12-9677-8296f3a0a36e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1319 microversion: 2.1 time: 1.976068 Oct 04 20:36:03.912917 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 387/771] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:01 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1319 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:04.973188 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b5f91ec4-6cb8-4ffe-b9c3-86e59af9340f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:04.979912 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b5f91ec4-6cb8-4ffe-b9c3-86e59af9340f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:05.010693 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b5f91ec4-6cb8-4ffe-b9c3-86e59af9340f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:05.011628 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b5f91ec4-6cb8-4ffe-b9c3-86e59af9340f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:05.012437 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b5f91ec4-6cb8-4ffe-b9c3-86e59af9340f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:05.013839 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b5f91ec4-6cb8-4ffe-b9c3-86e59af9340f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:05.014989 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b5f91ec4-6cb8-4ffe-b9c3-86e59af9340f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:05.017598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b5f91ec4-6cb8-4ffe-b9c3-86e59af9340f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:05.682610 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b5f91ec4-6cb8-4ffe-b9c3-86e59af9340f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:05.707736 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b5f91ec4-6cb8-4ffe-b9c3-86e59af9340f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1469 microversion: 2.1 time: 0.748278 Oct 04 20:36:05.709209 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 388/772] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:04 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1469 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:05.837535 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-6afe53eb-deb1-4909-ae07-ba68d9ad5c61 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:05.854144 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6afe53eb-deb1-4909-ae07-ba68d9ad5c61 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1312 microversion: 2.1 time: 2.273498 Oct 04 20:36:05.855738 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 385/773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:03 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1312 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:05.864609 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-698ff2e4-a467-4486-9e7b-5a832270408f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:05.866260 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-698ff2e4-a467-4486-9e7b-5a832270408f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: d937ec04-8d81-4926-a578-27ca4e58ca63] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:05.895762 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-698ff2e4-a467-4486-9e7b-5a832270408f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:05.896313 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-698ff2e4-a467-4486-9e7b-5a832270408f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:05.897056 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-698ff2e4-a467-4486-9e7b-5a832270408f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:05.898158 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-698ff2e4-a467-4486-9e7b-5a832270408f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:05.898809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-698ff2e4-a467-4486-9e7b-5a832270408f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:05.907675 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-698ff2e4-a467-4486-9e7b-5a832270408f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:06.055256 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ff380223-9116-49f0-a5c2-75c5d9a78f87 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] 10.222.0.78 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.341207 Oct 04 20:36:06.055992 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 389/774] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 4 20:36:05 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 20:36:06.102433 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-535869f2-928e-447b-9f38-bf020fc7de01 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Calling method '.version_select at 0x7f77ef66e430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:06.198623 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-535869f2-928e-447b-9f38-bf020fc7de01 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] HTTP exception thrown: Image not found. Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-535869f2-928e-447b-9f38-bf020fc7de01 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Request method failure captured: Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJk13fE0dn4YkmNG9RJITVmpB2HJ6MMbuBOYlbJwCDJWOP9k6Q85_CWhrnc3icwKyLME0dbmzfjPiZ8RQ74WxpGH3N5DaoUw1f9AXTnFK0sTabhf99C2a4xT57ZXPZoIQ9bstupRKb3Rs24Hgu33k32R38tObs2Hvm8S4szaaqUbDXw Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 890619f020cf40eb8b6a3ffe4f61d5de Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:36:06.207493 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_890619f020cf40eb8b6a3ffe4f61d5de", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/890619f020cf40eb8b6a3ffe4f61d5de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/890619f020cf40eb8b6a3ffe4f61d5de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/890619f020cf40eb8b6a3ffe4f61d5de"}]}] Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 890619f020cf40eb8b6a3ffe4f61d5de Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesDeleteNegativeTestJSON-732570018-project Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 0fbd20cf13d042c6a4ff01cd7dbfee13 Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-732570018-project Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: exception: Image not found. Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '-1'} Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:06.210407 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.213345 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:06.217415 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:36:06.219995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:36:06.219995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:36:06.219995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.219995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.219995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.219995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.219995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:06.219995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:06.219995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:06.219995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:06.219995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:36:06.219995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.232540 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-535869f2-928e-447b-9f38-bf020fc7de01 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Returning 404 to user: Image not found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:06.232540 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-535869f2-928e-447b-9f38-bf020fc7de01 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] 10.222.0.78 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.158219 Oct 04 20:36:06.233409 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 390/775] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 4 20:36:06 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:36:06.253134 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6883a5ac-8f63-4679-985f-6f8632c744b9 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Calling method '.version_select at 0x7f77ef1623a0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:06.313570 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-6883a5ac-8f63-4679-985f-6f8632c744b9 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] HTTP exception thrown: Image not found. Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6883a5ac-8f63-4679-985f-6f8632c744b9 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Request method failure captured: Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/images/8912eb83-505e-4d55-abbf-aca57a956a8j HTTP/1.1 Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJk13fE0dn4YkmNG9RJITVmpB2HJ6MMbuBOYlbJwCDJWOP9k6Q85_CWhrnc3icwKyLME0dbmzfjPiZ8RQ74WxpGH3N5DaoUw1f9AXTnFK0sTabhf99C2a4xT57ZXPZoIQ9bstupRKb3Rs24Hgu33k32R38tObs2Hvm8S4szaaqUbDXw Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 890619f020cf40eb8b6a3ffe4f61d5de Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:36:06.319208 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_890619f020cf40eb8b6a3ffe4f61d5de", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/890619f020cf40eb8b6a3ffe4f61d5de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/890619f020cf40eb8b6a3ffe4f61d5de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/890619f020cf40eb8b6a3ffe4f61d5de"}]}] Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 890619f020cf40eb8b6a3ffe4f61d5de Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesDeleteNegativeTestJSON-732570018-project Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 0fbd20cf13d042c6a4ff01cd7dbfee13 Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-732570018-project Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: exception: Image not found. Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '8912eb83-505e-4d55-abbf-aca57a956a8j'} Oct 04 20:36:06.321876 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8912eb83-505e-4d55-abbf-aca57a956a8j to delete Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.323594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8912eb83-505e-4d55-abbf-aca57a956a8j could not be found. Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:06.326761 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6883a5ac-8f63-4679-985f-6f8632c744b9 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Returning 404 to user: Image not found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:06.331264 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6883a5ac-8f63-4679-985f-6f8632c744b9 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] 10.222.0.78 "DELETE /compute/v2.1/images/8912eb83-505e-4d55-abbf-aca57a956a8j" status: 404 len: 62 microversion: 2.1 time: 0.079138 Oct 04 20:36:06.333454 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 391/776] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:06 2022] DELETE /compute/v2.1/images/8912eb83-505e-4d55-abbf-aca57a956a8j => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:36:06.349714 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1217ffa3-599b-4f44-b34d-aa798cc34fb6 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Calling method '.version_select at 0x7f77ef78a310>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:06.380543 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-1217ffa3-599b-4f44-b34d-aa798cc34fb6 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] HTTP exception thrown: Image not found. Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1217ffa3-599b-4f44-b34d-aa798cc34fb6 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Request method failure captured: Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/images/fd07f1a4-d331-4213-a8d1-92170654a1401 HTTP/1.1 Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJk13fE0dn4YkmNG9RJITVmpB2HJ6MMbuBOYlbJwCDJWOP9k6Q85_CWhrnc3icwKyLME0dbmzfjPiZ8RQ74WxpGH3N5DaoUw1f9AXTnFK0sTabhf99C2a4xT57ZXPZoIQ9bstupRKb3Rs24Hgu33k32R38tObs2Hvm8S4szaaqUbDXw Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 890619f020cf40eb8b6a3ffe4f61d5de Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:36:06.383502 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_890619f020cf40eb8b6a3ffe4f61d5de", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/890619f020cf40eb8b6a3ffe4f61d5de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/890619f020cf40eb8b6a3ffe4f61d5de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/890619f020cf40eb8b6a3ffe4f61d5de"}]}] Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 890619f020cf40eb8b6a3ffe4f61d5de Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesDeleteNegativeTestJSON-732570018-project Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 0fbd20cf13d042c6a4ff01cd7dbfee13 Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-732570018-project Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: exception: Image not found. Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'fd07f1a4-d331-4213-a8d1-92170654a1401'} Oct 04 20:36:06.385417 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fd07f1a4-d331-4213-a8d1-92170654a1401 to delete Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.386608 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fd07f1a4-d331-4213-a8d1-92170654a1401 could not be found. Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:06.389151 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:36:06.392932 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.397705 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1217ffa3-599b-4f44-b34d-aa798cc34fb6 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Returning 404 to user: Image not found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:06.400625 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1217ffa3-599b-4f44-b34d-aa798cc34fb6 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] 10.222.0.78 "DELETE /compute/v2.1/images/fd07f1a4-d331-4213-a8d1-92170654a1401" status: 404 len: 62 microversion: 2.1 time: 0.068331 Oct 04 20:36:06.402888 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 392/777] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:06 2022] DELETE /compute/v2.1/images/fd07f1a4-d331-4213-a8d1-92170654a1401 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:36:06.418738 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4a32bf77-3df2-42c4-a024-6e933193c972 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Calling method '.version_select at 0x7f77ef3c7b80>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:06.468910 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-4a32bf77-3df2-42c4-a024-6e933193c972 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] HTTP exception thrown: Image not found. Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4a32bf77-3df2-42c4-a024-6e933193c972 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Request method failure captured: Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/images/tempest-invalid-1417153293 HTTP/1.1 Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJk13fE0dn4YkmNG9RJITVmpB2HJ6MMbuBOYlbJwCDJWOP9k6Q85_CWhrnc3icwKyLME0dbmzfjPiZ8RQ74WxpGH3N5DaoUw1f9AXTnFK0sTabhf99C2a4xT57ZXPZoIQ9bstupRKb3Rs24Hgu33k32R38tObs2Hvm8S4szaaqUbDXw Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 890619f020cf40eb8b6a3ffe4f61d5de Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:36:06.473366 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_890619f020cf40eb8b6a3ffe4f61d5de", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/890619f020cf40eb8b6a3ffe4f61d5de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/890619f020cf40eb8b6a3ffe4f61d5de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/890619f020cf40eb8b6a3ffe4f61d5de"}]}] Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 890619f020cf40eb8b6a3ffe4f61d5de Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesDeleteNegativeTestJSON-732570018-project Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 0fbd20cf13d042c6a4ff01cd7dbfee13 Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-732570018-project Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: exception: Image not found. Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'tempest-invalid-1417153293'} Oct 04 20:36:06.476085 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1417153293 to delete Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.490460 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1417153293 could not be found. Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:06.493344 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4a32bf77-3df2-42c4-a024-6e933193c972 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Returning 404 to user: Image not found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:06.496026 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4a32bf77-3df2-42c4-a024-6e933193c972 tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] 10.222.0.78 "DELETE /compute/v2.1/images/tempest-invalid-1417153293" status: 404 len: 62 microversion: 2.1 time: 0.064526 Oct 04 20:36:06.497725 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 393/778] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 4 20:36:06 2022] DELETE /compute/v2.1/images/tempest-invalid-1417153293 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:36:06.497725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-424a5b28-1d30-4c51-a24a-4d30d601794b tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Calling method '.version_select at 0x7f77ef139700>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:06.542141 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-424a5b28-1d30-4c51-a24a-4d30d601794b tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] HTTP exception thrown: Image not found. Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-424a5b28-1d30-4c51-a24a-4d30d601794b tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Request method failure captured: Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/images/f7edadb5-b259-49bd-ac8f-042bb620bea5 HTTP/1.1 Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJk13fE0dn4YkmNG9RJITVmpB2HJ6MMbuBOYlbJwCDJWOP9k6Q85_CWhrnc3icwKyLME0dbmzfjPiZ8RQ74WxpGH3N5DaoUw1f9AXTnFK0sTabhf99C2a4xT57ZXPZoIQ9bstupRKb3Rs24Hgu33k32R38tObs2Hvm8S4szaaqUbDXw Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 890619f020cf40eb8b6a3ffe4f61d5de Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:36:06.545702 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_890619f020cf40eb8b6a3ffe4f61d5de", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/890619f020cf40eb8b6a3ffe4f61d5de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/890619f020cf40eb8b6a3ffe4f61d5de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/890619f020cf40eb8b6a3ffe4f61d5de"}]}] Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 890619f020cf40eb8b6a3ffe4f61d5de Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-732570018 Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesDeleteNegativeTestJSON-732570018-project Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 0fbd20cf13d042c6a4ff01cd7dbfee13 Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-732570018-project Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: exception: Image not found. Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'f7edadb5-b259-49bd-ac8f-042bb620bea5'} Oct 04 20:36:06.548410 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f7edadb5-b259-49bd-ac8f-042bb620bea5 to delete Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.549397 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f7edadb5-b259-49bd-ac8f-042bb620bea5 could not be found. Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:06.551351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-424a5b28-1d30-4c51-a24a-4d30d601794b tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] Returning 404 to user: Image not found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:06.553551 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-424a5b28-1d30-4c51-a24a-4d30d601794b tempest-ImagesDeleteNegativeTestJSON-732570018 tempest-ImagesDeleteNegativeTestJSON-732570018-project] 10.222.0.78 "DELETE /compute/v2.1/images/f7edadb5-b259-49bd-ac8f-042bb620bea5" status: 404 len: 62 microversion: 2.1 time: 0.063046 Oct 04 20:36:06.555539 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 394/779] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:06 2022] DELETE /compute/v2.1/images/f7edadb5-b259-49bd-ac8f-042bb620bea5 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:36:06.701075 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-698ff2e4-a467-4486-9e7b-5a832270408f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:06.736402 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-698ff2e4-a467-4486-9e7b-5a832270408f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63" status: 200 len: 1469 microversion: 2.1 time: 0.878582 Oct 04 20:36:06.739669 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 386/780] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:05 2022] GET /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63 => generated 1469 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:06.785151 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:06.817183 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:06.821635 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Searching by: {'reservation_id': 'r-x0dtrtj1', 'deleted': False, 'project_id': '70436b8b504e43dc882f5ee434ecf443'} {{(pid=123539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:36:06.847421 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:06.847421 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:06.850386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:06.856087 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:06.860446 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:06.861844 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:06.924837 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d0a0e988-6bf5-4abb-ad7d-9100a4d46171 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:06.931882 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d0a0e988-6bf5-4abb-ad7d-9100a4d46171 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:06.948660 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0a0e988-6bf5-4abb-ad7d-9100a4d46171 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:06.955899 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0a0e988-6bf5-4abb-ad7d-9100a4d46171 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:06.955899 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0a0e988-6bf5-4abb-ad7d-9100a4d46171 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:06.955899 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0a0e988-6bf5-4abb-ad7d-9100a4d46171 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:06.955899 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0a0e988-6bf5-4abb-ad7d-9100a4d46171 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:06.956963 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0a0e988-6bf5-4abb-ad7d-9100a4d46171 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.007272 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=100 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:07.200439 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.multi_cell_list [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:36:07.388870 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:07.403410 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.404200 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.405075 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:08.121144 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-d0a0e988-6bf5-4abb-ad7d-9100a4d46171 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:08.148178 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d0a0e988-6bf5-4abb-ad7d-9100a4d46171 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1312 microversion: 2.1 time: 1.250630 Oct 04 20:36:08.149758 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 387/781] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:06 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1312 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:08.826314 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7ae8e7ec-9477-4f69-abf3-7d13a7fa59dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?reservation_id=r-x0dtrtj1" status: 200 len: 2931 microversion: 2.1 time: 2.056298 Oct 04 20:36:08.848849 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 395/782] 10.222.0.78 () {58 vars in 1197 bytes} [Tue Oct 4 20:36:06 2022] GET /compute/v2.1/servers/detail?reservation_id=r-x0dtrtj1 => generated 2931 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:08.894682 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e1c19478-ad27-46ee-ba1d-ef388dabcffc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:08.948996 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.compute.server_groups [None req-e1c19478-ad27-46ee-ba1d-ef388dabcffc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Querying cell 8c6f5a8f-3e7f-4559-98c8-58d2585358de(cell1) for 2 instances {{(pid=123540) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 20:36:08.953035 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e1c19478-ad27-46ee-ba1d-ef388dabcffc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:08.954444 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e1c19478-ad27-46ee-ba1d-ef388dabcffc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:08.956838 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e1c19478-ad27-46ee-ba1d-ef388dabcffc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.084690 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e1c19478-ad27-46ee-ba1d-ef388dabcffc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/f8f639ea-6302-42b9-87dc-b2de964d9733" status: 200 len: 271 microversion: 2.1 time: 0.200371 Oct 04 20:36:09.085770 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 388/783] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:36:08 2022] GET /compute/v2.1/os-server-groups/f8f639ea-6302-42b9-87dc-b2de964d9733 => generated 271 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:09.115649 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-14b0bb66-6dde-4556-bbc3-bdbaba882694 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:09.121277 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-14b0bb66-6dde-4556-bbc3-bdbaba882694 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:09.151197 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14b0bb66-6dde-4556-bbc3-bdbaba882694 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:09.158961 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14b0bb66-6dde-4556-bbc3-bdbaba882694 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:09.160129 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14b0bb66-6dde-4556-bbc3-bdbaba882694 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.161651 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14b0bb66-6dde-4556-bbc3-bdbaba882694 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:09.165687 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14b0bb66-6dde-4556-bbc3-bdbaba882694 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:09.166706 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14b0bb66-6dde-4556-bbc3-bdbaba882694 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.198334 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-02e51f8c-5073-4ec3-83fb-c12082fcfaa0 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:09.199814 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-02e51f8c-5073-4ec3-83fb-c12082fcfaa0 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:09.220482 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-02e51f8c-5073-4ec3-83fb-c12082fcfaa0 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:09.226997 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-02e51f8c-5073-4ec3-83fb-c12082fcfaa0 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:09.231305 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-02e51f8c-5073-4ec3-83fb-c12082fcfaa0 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.233255 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-02e51f8c-5073-4ec3-83fb-c12082fcfaa0 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:09.236510 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-02e51f8c-5073-4ec3-83fb-c12082fcfaa0 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:09.240341 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-02e51f8c-5073-4ec3-83fb-c12082fcfaa0 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:11.366397 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-02e51f8c-5073-4ec3-83fb-c12082fcfaa0 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:11.425820 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-02e51f8c-5073-4ec3-83fb-c12082fcfaa0 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1312 microversion: 2.1 time: 2.234877 Oct 04 20:36:11.426494 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 389/784] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:09 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1312 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:11.606879 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-14b0bb66-6dde-4556-bbc3-bdbaba882694 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 200 len: 1622 microversion: 2.1 time: 2.483197 Oct 04 20:36:11.612278 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 396/785] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:09 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 1622 bytes in 2512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:11.666363 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9154202e-607e-4d33-822d-51fe97137c60 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:11.675382 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9154202e-607e-4d33-822d-51fe97137c60 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] [instance: d937ec04-8d81-4926-a578-27ca4e58ca63] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:11.705822 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=68 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:11.714074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9154202e-607e-4d33-822d-51fe97137c60 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:11.715431 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9154202e-607e-4d33-822d-51fe97137c60 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:11.718554 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9154202e-607e-4d33-822d-51fe97137c60 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:11.732803 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9154202e-607e-4d33-822d-51fe97137c60 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:11.734216 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9154202e-607e-4d33-822d-51fe97137c60 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:11.735050 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9154202e-607e-4d33-822d-51fe97137c60 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:12.477368 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-abd949d9-eeb4-4ae9-89c1-e46d253f0b15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:12.478513 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-abd949d9-eeb4-4ae9-89c1-e46d253f0b15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:12.507106 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-abd949d9-eeb4-4ae9-89c1-e46d253f0b15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:12.509591 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-abd949d9-eeb4-4ae9-89c1-e46d253f0b15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:12.511214 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-abd949d9-eeb4-4ae9-89c1-e46d253f0b15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:12.513209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-abd949d9-eeb4-4ae9-89c1-e46d253f0b15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:12.514690 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-abd949d9-eeb4-4ae9-89c1-e46d253f0b15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:12.516294 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-abd949d9-eeb4-4ae9-89c1-e46d253f0b15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:14.308956 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9154202e-607e-4d33-822d-51fe97137c60 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63" status: 200 len: 1622 microversion: 2.1 time: 2.649481 Oct 04 20:36:14.315251 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 390/786] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:11 2022] GET /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63 => generated 1622 bytes in 2657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:14.552066 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-abd949d9-eeb4-4ae9-89c1-e46d253f0b15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:14.585767 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-abd949d9-eeb4-4ae9-89c1-e46d253f0b15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1312 microversion: 2.1 time: 2.117068 Oct 04 20:36:14.586816 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 397/787] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:12 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1312 bytes in 2120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:15.007255 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-da418811-5275-47fb-bf69-acaa194ec731 req-5fb8baac-91b1-4de3-aeb0-e252d4ad24d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cbd24d1-c9b9-4e54-a25f-c8553d279e56", "name": "network-vif-plugged", "status": "completed", "tag": "1611f154-8d2e-4661-a90c-96f5a6d2c5f8"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:15.058218 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-da418811-5275-47fb-bf69-acaa194ec731 req-5fb8baac-91b1-4de3-aeb0-e252d4ad24d5 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.064771 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-da418811-5275-47fb-bf69-acaa194ec731 req-5fb8baac-91b1-4de3-aeb0-e252d4ad24d5 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.070217 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-da418811-5275-47fb-bf69-acaa194ec731 req-5fb8baac-91b1-4de3-aeb0-e252d4ad24d5 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.118836 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-da418811-5275-47fb-bf69-acaa194ec731 req-5fb8baac-91b1-4de3-aeb0-e252d4ad24d5 service nova] Creating event network-vif-plugged:1611f154-8d2e-4661-a90c-96f5a6d2c5f8 for instance 3cbd24d1-c9b9-4e54-a25f-c8553d279e56 on n-h1-852085-12 Oct 04 20:36:15.143513 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-da418811-5275-47fb-bf69-acaa194ec731 req-5fb8baac-91b1-4de3-aeb0-e252d4ad24d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138581 Oct 04 20:36:15.143513 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 398/788] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:36:15.153201 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-705951756", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "50c29121-e094-4132-8ef4-b4c28da9df8a"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:15.532015 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:15.575983 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2314d49f-fd9a-4f2d-a2c1-cae0b21b9565 tempest-TenantUsagesNegativeTestJSON-1495008388 tempest-TenantUsagesNegativeTestJSON-1495008388-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T20%3A36%3A13.408555&end=2022-10-05T20%3A36%3A13.408555" status: 404 len: 112 microversion: - time: 1.257538 Oct 04 20:36:15.581201 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 391/789] 10.222.0.78 () {58 vars in 1316 bytes} [Tue Oct 4 20:36:14 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T20%3A36%3A13.408555&end=2022-10-05T20%3A36%3A13.408555 => generated 112 bytes in 1264 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 20:36:15.624849 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d4ed0f77-ec36-487a-b586-4dcbc47a278e tempest-TenantUsagesNegativeTestJSON-1495008388 tempest-TenantUsagesNegativeTestJSON-1495008388-project-admin] Calling method '.version_select at 0x7f77ef82bdc0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:15.670186 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-d4ed0f77-ec36-487a-b586-4dcbc47a278e tempest-TenantUsagesNegativeTestJSON-1495008388 tempest-TenantUsagesNegativeTestJSON-1495008388-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d4ed0f77-ec36-487a-b586-4dcbc47a278e tempest-TenantUsagesNegativeTestJSON-1495008388 tempest-TenantUsagesNegativeTestJSON-1495008388-project-admin] Request method failure captured: Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-simple-tenant-usage/3d9a7348e41447b4a6c5faaef16ac431?start=2022-10-05T20%3A36%3A13.408555&end=2022-10-03T20%3A36%3A13.408555 HTTP/1.1 Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJk96xMZfaVEL5q5Hj1lTQMNZoI6BK7KTN474TFbmrFn2Q9r7jeB-v5mIbslfqmK1_Lav1iH56h3ZI9y6kaxEPx_ocvVoGP9liZONoAe4Q6mvJ2YZeREJXHsUHvgUr6T0DN68UgssbX9jPNCjANnlqMB7W512evvBWQ901SkkuGuqXM Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: de42762f81684f95b592497ddd4e1422 Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1495008388 Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:36:15.685006 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:36:15.690775 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_de42762f81684f95b592497ddd4e1422", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/de42762f81684f95b592497ddd4e1422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/de42762f81684f95b592497ddd4e1422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/de42762f81684f95b592497ddd4e1422"}]}] Oct 04 20:36:15.690775 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1495008388 Oct 04 20:36:15.690775 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: de42762f81684f95b592497ddd4e1422 Oct 04 20:36:15.690775 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1495008388 Oct 04 20:36:15.690775 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TenantUsagesNegativeTestJSON-1495008388-project-admin Oct 04 20:36:15.690775 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:36:15.690775 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:36:15.690775 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 7b0506fe672a45bc8bbad160bd09780c Oct 04 20:36:15.690775 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1495008388-project-admin Oct 04 20:36:15.690775 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:36:15.690775 n-d-852085-12 devstack@n-api.service[123540]: exception: Invalid start time. The start time cannot occur after the end time. Oct 04 20:36:15.690775 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '3d9a7348e41447b4a6c5faaef16ac431'} Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 20:36:15.698541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 04 20:36:15.703460 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.703460 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:15.703460 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.703460 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:15.703460 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:15.703460 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:15.703460 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:15.703460 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:15.703460 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 04 20:36:15.703460 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.703460 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d4ed0f77-ec36-487a-b586-4dcbc47a278e tempest-TenantUsagesNegativeTestJSON-1495008388 tempest-TenantUsagesNegativeTestJSON-1495008388-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:15.703460 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d4ed0f77-ec36-487a-b586-4dcbc47a278e tempest-TenantUsagesNegativeTestJSON-1495008388 tempest-TenantUsagesNegativeTestJSON-1495008388-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/3d9a7348e41447b4a6c5faaef16ac431?start=2022-10-05T20%3A36%3A13.408555&end=2022-10-03T20%3A36%3A13.408555" status: 400 len: 111 microversion: 2.1 time: 0.108395 Oct 04 20:36:15.708421 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 392/790] 10.222.0.78 () {58 vars in 1412 bytes} [Tue Oct 4 20:36:15 2022] GET /compute/v2.1/os-simple-tenant-usage/3d9a7348e41447b4a6c5faaef16ac431?start=2022-10-05T20%3A36%3A13.408555&end=2022-10-03T20%3A36%3A13.408555 => generated 111 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:36:15.737990 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3371f77e-fceb-4755-908a-824c9a4016d1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:15.737990 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3371f77e-fceb-4755-908a-824c9a4016d1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:15.774984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3371f77e-fceb-4755-908a-824c9a4016d1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.776464 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3371f77e-fceb-4755-908a-824c9a4016d1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.777724 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3371f77e-fceb-4755-908a-824c9a4016d1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.800824 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3371f77e-fceb-4755-908a-824c9a4016d1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.800824 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3371f77e-fceb-4755-908a-824c9a4016d1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.800824 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3371f77e-fceb-4755-908a-824c9a4016d1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:16.997952 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:17.382074 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:18.172328 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3371f77e-fceb-4755-908a-824c9a4016d1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:18.197803 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3371f77e-fceb-4755-908a-824c9a4016d1 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1312 microversion: 2.1 time: 2.490508 Oct 04 20:36:18.212924 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 393/791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:15 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1312 bytes in 2505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:18.578375 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:18.579425 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:18.584742 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:18.587103 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:18.588343 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:18.618180 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:18.624658 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:18.624658 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:18.627087 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:18.628061 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:18.632143 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:18.717169 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:18.725795 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:18.773650 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:36:18.773930 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-66595ba1-26b2-4e28-87ba-dcff1866d13e tempest-TenantUsagesNegativeTestJSON-1877571834 tempest-TenantUsagesNegativeTestJSON-1877571834-project] Calling method '.version_select at 0x7f77ef7b69d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-66595ba1-26b2-4e28-87ba-dcff1866d13e tempest-TenantUsagesNegativeTestJSON-1877571834 tempest-TenantUsagesNegativeTestJSON-1877571834-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '6e4d613ca8ce4da0a9b073f49597a002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9a7348e41447b4a6c5faaef16ac431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-66595ba1-26b2-4e28-87ba-dcff1866d13e tempest-TenantUsagesNegativeTestJSON-1877571834 tempest-TenantUsagesNegativeTestJSON-1877571834-project] Request method failure captured: Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A36%3A13.408555&end=2022-10-05T20%3A36%3A13.408555&detailed=1 HTTP/1.1 Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:19.075123 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJk54E4Qi13I0xYX-27vUJ7RtXSxBtD5pMUXPOYkzbgbJt_GtCkcs8mAJZImIxStkXqeG19SaxwxuiNMPmkZzc_3UDu16bvgaIcXzygcRlHnxeF5Yn0gAoV3tX7saL9xNpQH6Y4UWhpgObQ1Vgk-sklefll_QGtwG1o-xWZ1MhoTbTI Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 3d9a7348e41447b4a6c5faaef16ac431 Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1877571834 Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3d9a7348e41447b4a6c5faaef16ac431", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3d9a7348e41447b4a6c5faaef16ac431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3d9a7348e41447b4a6c5faaef16ac431"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3d9a7348e41447b4a6c5faaef16ac431"}]}] Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1877571834 Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 3d9a7348e41447b4a6c5faaef16ac431 Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1877571834 Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TenantUsagesNegativeTestJSON-1877571834-project Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:36:19.077197 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 6e4d613ca8ce4da0a9b073f49597a002 Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1877571834-project Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: action_args: {} Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 04 20:36:19.079950 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:19.081741 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:19.083038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:36:19.083038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:36:19.083038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 20:36:19.083038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:19.083038 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-66595ba1-26b2-4e28-87ba-dcff1866d13e tempest-TenantUsagesNegativeTestJSON-1877571834 tempest-TenantUsagesNegativeTestJSON-1877571834-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:19.083038 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-66595ba1-26b2-4e28-87ba-dcff1866d13e tempest-TenantUsagesNegativeTestJSON-1877571834 tempest-TenantUsagesNegativeTestJSON-1877571834-project] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A36%3A13.408555&end=2022-10-05T20%3A36%3A13.408555&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.845350 Oct 04 20:36:19.083038 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 394/792] 10.222.0.78 () {58 vars in 1335 bytes} [Tue Oct 4 20:36:18 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A36%3A13.408555&end=2022-10-05T20%3A36%3A13.408555&detailed=1 => generated 123 bytes in 847 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:19.093659 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-77f335e6-ab1a-4e15-8a29-300768cb0024 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.948234 Oct 04 20:36:19.096090 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 399/793] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:36:19.116951 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3de6c164-d15f-4679-b857-1217746e3d76 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:19.128411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3de6c164-d15f-4679-b857-1217746e3d76 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:19.555765 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f5e165e0-733b-44ab-a418-536eb8e9b308 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Action: 'create', calling method: .version_select at 0x7f77ef5d9430>, body: {"keypair": {"name": "tempest-keypair-1615002176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK3Nscet5coM2hHtYVh+XUFIsxAoRsgo3V1MKdx8TdzAtsp2mXkfF0PkrKlPIEiYYJAE+Ka/M68ysxkNsRy14+1cdVCvemZkCG+gpRJuJ8bFWIkW+kvfyPsK+TTpA9VrQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:19.632433 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3de6c164-d15f-4679-b857-1217746e3d76 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:19.664093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-f5e165e0-733b-44ab-a418-536eb8e9b308 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Getting quotas for project 5eab98ddbb994a599add8e65758bb605. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:19.700371 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-f5e165e0-733b-44ab-a418-536eb8e9b308 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Getting quotas for user 175f671de1ae4c82959a1d7cda74e70e and project 5eab98ddbb994a599add8e65758bb605. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:19.718625 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3de6c164-d15f-4679-b857-1217746e3d76 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1216 microversion: 2.1 time: 0.608762 Oct 04 20:36:19.757153 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 400/794] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:19 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1216 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:19.785174 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4da50ec8-86b3-4b77-ba08-bc2ef2d9c738 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:19.787035 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4da50ec8-86b3-4b77-ba08-bc2ef2d9c738 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:19.806026 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4da50ec8-86b3-4b77-ba08-bc2ef2d9c738 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:19.808859 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4da50ec8-86b3-4b77-ba08-bc2ef2d9c738 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:19.810023 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4da50ec8-86b3-4b77-ba08-bc2ef2d9c738 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:19.812787 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4da50ec8-86b3-4b77-ba08-bc2ef2d9c738 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:19.815049 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4da50ec8-86b3-4b77-ba08-bc2ef2d9c738 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:19.820062 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4da50ec8-86b3-4b77-ba08-bc2ef2d9c738 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:19.905088 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f5e165e0-733b-44ab-a418-536eb8e9b308 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.841611 Oct 04 20:36:19.917178 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 395/795] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:36:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:19.930208 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1f87fd23-f218-4d6d-aa42-571dcdcc2e3c tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Calling method '.version_select at 0x7f77ef75dee0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:20.005446 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1f87fd23-f218-4d6d-aa42-571dcdcc2e3c tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-1615002176" status: 200 len: 497 microversion: 2.1 time: 0.070945 Oct 04 20:36:20.019371 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 396/796] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 4 20:36:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1615002176 => generated 497 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:20.069090 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4e688cf1-e5c3-43dd-94e9-15a0dec7542a tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Calling method '.version_select at 0x7f77ef8603a0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:20.301714 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4e688cf1-e5c3-43dd-94e9-15a0dec7542a tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615002176" status: 202 len: 0 microversion: 2.1 time: 0.270743 Oct 04 20:36:20.302731 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 397/797] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:36:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615002176 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:20.322153 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8b089f7e-cd12-4afe-b8de-d2e125204828 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Action: 'create', calling method: .version_select at 0x7f77ef4d95e0>, body: {"keypair": {"name": "tempest-keypair-1479035656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBiU+YsQGuYpAXFs5v18dY7gadZsFgSaoLrRGywvIcNZf7z34rAIGifI+AaMUPs4eKUXYDOnS8WuvloglBGAxF2AGYQ2hMf8Wj37t1dMzff1J5haH73kZ9WNxMdccqZsQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:20.392354 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-8b089f7e-cd12-4afe-b8de-d2e125204828 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Getting quotas for project 5eab98ddbb994a599add8e65758bb605. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:20.407687 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-8b089f7e-cd12-4afe-b8de-d2e125204828 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Getting quotas for user 175f671de1ae4c82959a1d7cda74e70e and project 5eab98ddbb994a599add8e65758bb605. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:20.582556 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8b089f7e-cd12-4afe-b8de-d2e125204828 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.269001 Oct 04 20:36:20.591765 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 398/798] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:36:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:20.604960 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fb9e66da-94b6-4865-99df-e7f01914a0e3 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Calling method '.version_select at 0x7f77ef4d00d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:20.767087 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fb9e66da-94b6-4865-99df-e7f01914a0e3 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479035656" status: 202 len: 0 microversion: 2.1 time: 0.172677 Oct 04 20:36:20.779625 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 399/799] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:36:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479035656 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:20.788830 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-56ec514a-4a48-490d-b6fb-f4e2ab57ca55 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:20.789970 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-56ec514a-4a48-490d-b6fb-f4e2ab57ca55 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:21.288684 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4da50ec8-86b3-4b77-ba08-bc2ef2d9c738 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:21.289517 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-56ec514a-4a48-490d-b6fb-f4e2ab57ca55 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:21.316058 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-56ec514a-4a48-490d-b6fb-f4e2ab57ca55 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1216 microversion: 2.1 time: 0.539912 Oct 04 20:36:21.317077 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 400/800] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:20 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1216 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:21.346219 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-02e28a7f-ad8d-49d0-aa1c-71ba76c58f0a tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Action: 'create', calling method: .version_select at 0x7f77efaecdc0>, body: {"keypair": {"name": "tempest-keypair-1092304746", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:21.386142 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4da50ec8-86b3-4b77-ba08-bc2ef2d9c738 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1312 microversion: 2.1 time: 1.620081 Oct 04 20:36:21.418392 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-02e28a7f-ad8d-49d0-aa1c-71ba76c58f0a tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Getting quotas for project 5eab98ddbb994a599add8e65758bb605. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:21.440572 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 401/801] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:19 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1312 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:21.440914 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-02e28a7f-ad8d-49d0-aa1c-71ba76c58f0a tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Getting quotas for user 175f671de1ae4c82959a1d7cda74e70e and project 5eab98ddbb994a599add8e65758bb605. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:21.653070 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-02e28a7f-ad8d-49d0-aa1c-71ba76c58f0a tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.331975 Oct 04 20:36:21.655753 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 401/802] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:36:21 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:21.676352 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-85e3aeb1-8368-40a4-8aff-c2bbd394a9d9 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Calling method '.version_select at 0x7f77ef0350d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:21.747068 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:22.009331 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-85e3aeb1-8368-40a4-8aff-c2bbd394a9d9 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1092304746" status: 202 len: 0 microversion: 2.1 time: 0.334119 Oct 04 20:36:22.009331 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 402/803] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:36:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1092304746 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:22.043712 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-247d921e-532d-48eb-83f6-de6de8e347f5 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Action: 'create', calling method: .version_select at 0x7f77ef681700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1298241421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPN4/tlYYdKK4qCh3toWhItkVcTs+A/jhsMjh/HrlucBn5OfbXUWNYwthVl467SF1VSgQdRk5mINznXFyR1tJlpiAd5FZ80gbEmacdue/7fFvG8dLBtcNIyUud0OjGRGA=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:22.123051 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-247d921e-532d-48eb-83f6-de6de8e347f5 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Getting quotas for project 5eab98ddbb994a599add8e65758bb605. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:22.133298 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-247d921e-532d-48eb-83f6-de6de8e347f5 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Getting quotas for user 175f671de1ae4c82959a1d7cda74e70e and project 5eab98ddbb994a599add8e65758bb605. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:22.362843 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-247d921e-532d-48eb-83f6-de6de8e347f5 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.325127 Oct 04 20:36:22.385135 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7f378a9c-c7d8-414f-8feb-4e045083429c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:22.386230 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 402/804] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:36:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:22.407073 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7f378a9c-c7d8-414f-8feb-4e045083429c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:22.448956 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f70e074a-ded2-4ab9-a21c-70756b764836 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Action: 'create', calling method: .version_select at 0x7f77ef5d9ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1458125577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHm8bChyvXq4BVttcg1jy7L/z/KNUyAv7+YjRRMab0ZRvF7hUVjl1h/WgvzJ48CNVwyhMJsd4+Dta//3/aAMBjF5wt9bolUXDlGg4YB0HDFCOqdH/s64WqYrZVk07GigJQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:22.482880 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7f378a9c-c7d8-414f-8feb-4e045083429c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.484088 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7f378a9c-c7d8-414f-8feb-4e045083429c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.485010 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7f378a9c-c7d8-414f-8feb-4e045083429c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.486244 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7f378a9c-c7d8-414f-8feb-4e045083429c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.487057 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7f378a9c-c7d8-414f-8feb-4e045083429c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.495920 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7f378a9c-c7d8-414f-8feb-4e045083429c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.514019 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-f70e074a-ded2-4ab9-a21c-70756b764836 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Getting quotas for project 5eab98ddbb994a599add8e65758bb605. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:22.541702 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-f70e074a-ded2-4ab9-a21c-70756b764836 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Getting quotas for user 175f671de1ae4c82959a1d7cda74e70e and project 5eab98ddbb994a599add8e65758bb605. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:22.819746 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f70e074a-ded2-4ab9-a21c-70756b764836 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.430846 Oct 04 20:36:22.848901 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7f378a9c-c7d8-414f-8feb-4e045083429c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:22.854118 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 403/805] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:36:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:22.898000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4af86f0f-f04c-4225-9f52-3dbb2634c88a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:22.902336 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4af86f0f-f04c-4225-9f52-3dbb2634c88a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:22.910339 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7f378a9c-c7d8-414f-8feb-4e045083429c tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1220 microversion: 2.1 time: 0.544938 Oct 04 20:36:22.914371 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 403/806] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:22 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1220 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:22.931067 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0fd3bb62-bdff-4eb5-a39d-91f777d0d191 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Action: 'create', calling method: .version_select at 0x7f77ef07fa60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-728223906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNrIhZQgXmCuqOxFbLJHcyl8NAXpMKOBO7tV8zxNoAFSypZBb5kpavyc6Ws8eamVVufHjrAqxakSwDZTBnVCnytQI5s5TUbta0ljxXfkiiqEPO1jtj8cwvRfLRmsRWUCQ=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:22.948346 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4af86f0f-f04c-4225-9f52-3dbb2634c88a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.949592 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4af86f0f-f04c-4225-9f52-3dbb2634c88a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.950504 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4af86f0f-f04c-4225-9f52-3dbb2634c88a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.960228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4af86f0f-f04c-4225-9f52-3dbb2634c88a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.961380 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4af86f0f-f04c-4225-9f52-3dbb2634c88a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.961867 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4af86f0f-f04c-4225-9f52-3dbb2634c88a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:23.011181 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-0fd3bb62-bdff-4eb5-a39d-91f777d0d191 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Getting quotas for project 5eab98ddbb994a599add8e65758bb605. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:23.033594 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-0fd3bb62-bdff-4eb5-a39d-91f777d0d191 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Getting quotas for user 175f671de1ae4c82959a1d7cda74e70e and project 5eab98ddbb994a599add8e65758bb605. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:23.332690 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0fd3bb62-bdff-4eb5-a39d-91f777d0d191 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.415951 Oct 04 20:36:23.341766 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 404/807] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:36:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:23.358959 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-79b3aa56-e114-4d27-a0b7-0475c45c32f0 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Calling method '.version_select at 0x7f77ef13aa60>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:23.374579 n-d-852085-12 devstack@n-api.service[123539]: WARNING oslo_db.sqlalchemy.utils [None req-79b3aa56-e114-4d27-a0b7-0475c45c32f0 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:36:23.410506 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-79b3aa56-e114-4d27-a0b7-0475c45c32f0 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.066227 Oct 04 20:36:23.422103 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 405/808] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:36:23 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:23.440596 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a6046ca6-814d-4849-80b9-65ccc6839426 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Calling method '.version_select at 0x7f77ef1689d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:23.622533 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a6046ca6-814d-4849-80b9-65ccc6839426 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-728223906" status: 202 len: 0 microversion: 2.1 time: 0.198327 Oct 04 20:36:23.624088 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 406/809] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 4 20:36:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-728223906 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:23.647575 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c9469b3e-73b3-4b98-ad9b-9ae61db9e32e tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Calling method '.version_select at 0x7f77ef13ae50>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:23.789150 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4af86f0f-f04c-4225-9f52-3dbb2634c88a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:23.802080 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c9469b3e-73b3-4b98-ad9b-9ae61db9e32e tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1458125577" status: 202 len: 0 microversion: 2.1 time: 0.168485 Oct 04 20:36:23.809863 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 407/810] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 4 20:36:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1458125577 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:23.827278 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-62bcbd8c-0aa9-4edb-aef9-13aaa3bab4b5 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] Calling method '.version_select at 0x7f77ef03e0d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:23.835225 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4af86f0f-f04c-4225-9f52-3dbb2634c88a tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1462 microversion: 2.1 time: 0.977076 Oct 04 20:36:23.844325 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 404/811] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:22 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1462 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:23.883196 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c01712a0-9376-46c9-8aa0-ea1cdea9fa28 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:23.884337 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c01712a0-9376-46c9-8aa0-ea1cdea9fa28 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:23.902254 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c01712a0-9376-46c9-8aa0-ea1cdea9fa28 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:23.910408 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c01712a0-9376-46c9-8aa0-ea1cdea9fa28 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:23.911943 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c01712a0-9376-46c9-8aa0-ea1cdea9fa28 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:23.913837 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c01712a0-9376-46c9-8aa0-ea1cdea9fa28 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:23.915073 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c01712a0-9376-46c9-8aa0-ea1cdea9fa28 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:23.916217 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c01712a0-9376-46c9-8aa0-ea1cdea9fa28 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.088489 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-62bcbd8c-0aa9-4edb-aef9-13aaa3bab4b5 tempest-KeyPairsV2TestJSON-1489159379 tempest-KeyPairsV2TestJSON-1489159379-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1298241421" status: 202 len: 0 microversion: 2.1 time: 0.277144 Oct 04 20:36:24.092044 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 408/812] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 4 20:36:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1298241421 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:24.144188 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-62b9066d-0ecc-495b-ac16-24bc80eb6621 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:24.146502 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-62b9066d-0ecc-495b-ac16-24bc80eb6621 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:24.180435 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62b9066d-0ecc-495b-ac16-24bc80eb6621 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.184022 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62b9066d-0ecc-495b-ac16-24bc80eb6621 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.187486 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62b9066d-0ecc-495b-ac16-24bc80eb6621 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.193509 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62b9066d-0ecc-495b-ac16-24bc80eb6621 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.196902 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62b9066d-0ecc-495b-ac16-24bc80eb6621 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.199297 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-62b9066d-0ecc-495b-ac16-24bc80eb6621 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.216053 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=68 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:24.952493 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-62b9066d-0ecc-495b-ac16-24bc80eb6621 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:25.025883 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-62b9066d-0ecc-495b-ac16-24bc80eb6621 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1268 microversion: 2.1 time: 0.933308 Oct 04 20:36:25.029026 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 409/813] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:24 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1268 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:25.361684 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c01712a0-9376-46c9-8aa0-ea1cdea9fa28 tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1615 microversion: 2.1 time: 1.486225 Oct 04 20:36:25.370855 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 405/814] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:23 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1615 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:25.431518 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:25.436461 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:25.463446 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:25.468515 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:25.470718 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:25.473590 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:25.478460 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:25.481312 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-244762a0-a433-4688-814c-744a375d25ed) Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:36:25.955614 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:25.958306 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:36:25.963360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:36:25.966889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:36:25.966889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:36:25.966889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:36:25.966889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:36:25.966889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:36:25.966889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:36:25.966889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:36:25.966889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:36:25.966889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:36:25.966889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:36:25.966889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-244762a0-a433-4688-814c-744a375d25ed) Oct 04 20:36:25.966889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:25.972843 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:36:25.972843 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Request method failure captured: Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56/action HTTP/1.1 Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 15 Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJiToJYI4MASBN3dVdiVSjJtqQQXHEIdNXKsar7Xqdo4a4L5ZJGqyoYIfqTCIEhEWacD1Ek7WmusfBBeX_McaNVQxK4iPeCreBVpBgDAOK0RXR_36nno6EfyrlCNjifGKJCqmTTxd93E9PS1_2OlCJHA-TyBmPr6g5X_iymTr1vEw9w Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 7c51aa34a4434d0a931063ba18400be8 Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-MigrationsAdminTest-609424741 Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 20:36:25.997977 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c51aa34a4434d0a931063ba18400be8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c51aa34a4434d0a931063ba18400be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c51aa34a4434d0a931063ba18400be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c51aa34a4434d0a931063ba18400be8"}]}] Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-MigrationsAdminTest-609424741 Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 7c51aa34a4434d0a931063ba18400be8 Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-MigrationsAdminTest-609424741 Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-MigrationsAdminTest-609424741-project-admin Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 2e3ada01045e4d4b9295b266315e2cd1 Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-MigrationsAdminTest-609424741-project-admin Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: {"migrate": {}} Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:36:26.001574 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '3cbd24d1-c9b9-4e54-a25f-c8553d279e56', 'body': {'migrate': {}}} Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:36:26.002827 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:36:26.005917 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:36:26.009688 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-244762a0-a433-4688-814c-744a375d25ed) Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:36:26.013711 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:36:26.017491 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:26.018463 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1baecfa5-1c57-4155-a348-64259545591a tempest-MigrationsAdminTest-609424741 tempest-MigrationsAdminTest-609424741-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56/action" status: 500 len: 214 microversion: 2.1 time: 0.590057 Oct 04 20:36:26.018463 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 410/815] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:36:25 2022] POST /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56/action => generated 214 bytes in 593 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:36:26.034741 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-31aad1f6-5fda-498c-b985-5ec4ed314319 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:26.038913 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-31aad1f6-5fda-498c-b985-5ec4ed314319 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:26.068437 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-31aad1f6-5fda-498c-b985-5ec4ed314319 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:26.069394 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-31aad1f6-5fda-498c-b985-5ec4ed314319 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:26.079647 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-af9c501f-54eb-4311-a55a-bde98f572f81 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:26.080729 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-af9c501f-54eb-4311-a55a-bde98f572f81 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:26.085758 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-31aad1f6-5fda-498c-b985-5ec4ed314319 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:26.087450 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-31aad1f6-5fda-498c-b985-5ec4ed314319 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:26.088973 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-31aad1f6-5fda-498c-b985-5ec4ed314319 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:26.100910 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-31aad1f6-5fda-498c-b985-5ec4ed314319 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:26.128793 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af9c501f-54eb-4311-a55a-bde98f572f81 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:26.134765 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af9c501f-54eb-4311-a55a-bde98f572f81 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:26.134765 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af9c501f-54eb-4311-a55a-bde98f572f81 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:26.134765 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af9c501f-54eb-4311-a55a-bde98f572f81 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:26.134765 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af9c501f-54eb-4311-a55a-bde98f572f81 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:26.135588 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af9c501f-54eb-4311-a55a-bde98f572f81 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:26.182362 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-31aad1f6-5fda-498c-b985-5ec4ed314319 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:36:26.785385 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-af9c501f-54eb-4311-a55a-bde98f572f81 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:26.804862 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-af9c501f-54eb-4311-a55a-bde98f572f81 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1276 microversion: 2.1 time: 0.732502 Oct 04 20:36:26.817567 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 411/816] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:26 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1276 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:26.969388 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-31aad1f6-5fda-498c-b985-5ec4ed314319 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 204 len: 0 microversion: 2.1 time: 0.940299 Oct 04 20:36:26.973918 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 406/817] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:26 2022] DELETE /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 0 bytes in 946 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:36:26.984770 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3bfea458-3865-4abe-9715-f38f0bdc0fa7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:26.987800 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3bfea458-3865-4abe-9715-f38f0bdc0fa7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:27.026267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3bfea458-3865-4abe-9715-f38f0bdc0fa7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:27.027662 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3bfea458-3865-4abe-9715-f38f0bdc0fa7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:27.028836 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3bfea458-3865-4abe-9715-f38f0bdc0fa7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:27.031057 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3bfea458-3865-4abe-9715-f38f0bdc0fa7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:27.033505 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3bfea458-3865-4abe-9715-f38f0bdc0fa7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:27.035291 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3bfea458-3865-4abe-9715-f38f0bdc0fa7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:27.885789 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-de76e5ad-5cb0-4c1d-944e-fcce8a669e2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:27.891007 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-de76e5ad-5cb0-4c1d-944e-fcce8a669e2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:27.896491 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-de76e5ad-5cb0-4c1d-944e-fcce8a669e2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:27.897311 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-de76e5ad-5cb0-4c1d-944e-fcce8a669e2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:27.897898 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-de76e5ad-5cb0-4c1d-944e-fcce8a669e2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:27.898996 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-de76e5ad-5cb0-4c1d-944e-fcce8a669e2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:27.899604 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-de76e5ad-5cb0-4c1d-944e-fcce8a669e2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:27.900250 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-de76e5ad-5cb0-4c1d-944e-fcce8a669e2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:28.267117 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-de76e5ad-5cb0-4c1d-944e-fcce8a669e2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:28.289425 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-de76e5ad-5cb0-4c1d-944e-fcce8a669e2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1274 microversion: 2.1 time: 0.416800 Oct 04 20:36:28.291720 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 407/818] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:27 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1274 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:28.410036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3bfea458-3865-4abe-9715-f38f0bdc0fa7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:28.492141 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3bfea458-3865-4abe-9715-f38f0bdc0fa7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1468 microversion: 2.1 time: 1.513782 Oct 04 20:36:28.493740 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 412/819] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:26 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1468 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:29.331636 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-af2890fb-201d-4692-b033-3c31d1501e99 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:29.333081 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-af2890fb-201d-4692-b033-3c31d1501e99 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:29.352738 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-af2890fb-201d-4692-b033-3c31d1501e99 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:29.354800 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-af2890fb-201d-4692-b033-3c31d1501e99 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:29.354800 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-af2890fb-201d-4692-b033-3c31d1501e99 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:29.354800 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-af2890fb-201d-4692-b033-3c31d1501e99 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:29.373313 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-af2890fb-201d-4692-b033-3c31d1501e99 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:29.374361 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-af2890fb-201d-4692-b033-3c31d1501e99 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:29.536541 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-14a3773b-4b95-48a1-9c76-fec3069bd89c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:29.537413 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-14a3773b-4b95-48a1-9c76-fec3069bd89c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:29.563606 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:29.572928 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14a3773b-4b95-48a1-9c76-fec3069bd89c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:29.573802 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14a3773b-4b95-48a1-9c76-fec3069bd89c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:29.574595 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14a3773b-4b95-48a1-9c76-fec3069bd89c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:29.576041 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14a3773b-4b95-48a1-9c76-fec3069bd89c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:29.576999 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14a3773b-4b95-48a1-9c76-fec3069bd89c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:29.577742 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-14a3773b-4b95-48a1-9c76-fec3069bd89c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:31.639953 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-14a3773b-4b95-48a1-9c76-fec3069bd89c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:31.674678 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-14a3773b-4b95-48a1-9c76-fec3069bd89c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1468 microversion: 2.1 time: 2.141787 Oct 04 20:36:31.678741 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-af2890fb-201d-4692-b033-3c31d1501e99 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:31.679795 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 413/820] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:29 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1468 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:31.737913 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-af2890fb-201d-4692-b033-3c31d1501e99 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1316 microversion: 2.1 time: 2.409364 Oct 04 20:36:31.769689 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 408/821] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:29 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1316 bytes in 2432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:32.722167 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c0be6361-d745-4702-bdbf-3abd2e52143f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:32.733831 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c0be6361-d745-4702-bdbf-3abd2e52143f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:32.746848 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=22 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:32.769041 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-06125801-7212-4d79-a1cb-5ce38ad7ba6b tempest-ImagesOneServerNegativeTestJSON-1403018646 tempest-ImagesOneServerNegativeTestJSON-1403018646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-641433228", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "df2b7da7-6013-4113-a882-eeb499a29518"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:32.789022 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c0be6361-d745-4702-bdbf-3abd2e52143f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:32.789956 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c0be6361-d745-4702-bdbf-3abd2e52143f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:32.794989 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c0be6361-d745-4702-bdbf-3abd2e52143f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:32.808393 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c0be6361-d745-4702-bdbf-3abd2e52143f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:32.809817 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c0be6361-d745-4702-bdbf-3abd2e52143f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:32.811606 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c0be6361-d745-4702-bdbf-3abd2e52143f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:32.992900 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-06125801-7212-4d79-a1cb-5ce38ad7ba6b tempest-ImagesOneServerNegativeTestJSON-1403018646 tempest-ImagesOneServerNegativeTestJSON-1403018646-project] validate_networks() for [('df2b7da7-6013-4113-a882-eeb499a29518', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:33.099686 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=12 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:33.295718 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c0be6361-d745-4702-bdbf-3abd2e52143f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:33.330242 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c0be6361-d745-4702-bdbf-3abd2e52143f tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 200 len: 1426 microversion: 2.1 time: 0.615727 Oct 04 20:36:33.331312 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 409/822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:32 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 1426 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:33.377784 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1b59930f-7c96-4020-ad43-e5b39b28c228 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:33.379713 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1b59930f-7c96-4020-ad43-e5b39b28c228 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:33.398107 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b59930f-7c96-4020-ad43-e5b39b28c228 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:33.400996 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b59930f-7c96-4020-ad43-e5b39b28c228 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:33.407913 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b59930f-7c96-4020-ad43-e5b39b28c228 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:33.407913 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b59930f-7c96-4020-ad43-e5b39b28c228 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:33.407913 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b59930f-7c96-4020-ad43-e5b39b28c228 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:33.407913 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b59930f-7c96-4020-ad43-e5b39b28c228 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.934402 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1b59930f-7c96-4020-ad43-e5b39b28c228 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:35.965502 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1b59930f-7c96-4020-ad43-e5b39b28c228 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1316 microversion: 2.1 time: 2.616696 Oct 04 20:36:35.970161 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 410/823] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:33 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1316 bytes in 2637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:36.510248 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-f6745bf2-5603-4dea-ad71-f68c66cf13fd req-e92ddaaf-10c1-4e0a-a00d-a3a55ddec779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cbd24d1-c9b9-4e54-a25f-c8553d279e56", "name": "network-vif-deleted", "tag": "1611f154-8d2e-4661-a90c-96f5a6d2c5f8"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:36.564787 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-f6745bf2-5603-4dea-ad71-f68c66cf13fd req-e92ddaaf-10c1-4e0a-a00d-a3a55ddec779 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.565711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-f6745bf2-5603-4dea-ad71-f68c66cf13fd req-e92ddaaf-10c1-4e0a-a00d-a3a55ddec779 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.566589 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-f6745bf2-5603-4dea-ad71-f68c66cf13fd req-e92ddaaf-10c1-4e0a-a00d-a3a55ddec779 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.624728 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-f6745bf2-5603-4dea-ad71-f68c66cf13fd req-e92ddaaf-10c1-4e0a-a00d-a3a55ddec779 service nova] Creating event network-vif-deleted:1611f154-8d2e-4661-a90c-96f5a6d2c5f8 for instance 3cbd24d1-c9b9-4e54-a25f-c8553d279e56 on n-h1-852085-12 Oct 04 20:36:36.652781 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-f6745bf2-5603-4dea-ad71-f68c66cf13fd req-e92ddaaf-10c1-4e0a-a00d-a3a55ddec779 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.679733 Oct 04 20:36:36.657225 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 411/824] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:36.683410 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bc032fda-7f7e-4717-b28f-c5b255e6c0ec tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:36.689683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-bc032fda-7f7e-4717-b28f-c5b255e6c0ec tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 3cbd24d1-c9b9-4e54-a25f-c8553d279e56] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:36.714120 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:36.723813 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc032fda-7f7e-4717-b28f-c5b255e6c0ec tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.730272 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc032fda-7f7e-4717-b28f-c5b255e6c0ec tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.730272 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc032fda-7f7e-4717-b28f-c5b255e6c0ec tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.733181 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc032fda-7f7e-4717-b28f-c5b255e6c0ec tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.736813 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc032fda-7f7e-4717-b28f-c5b255e6c0ec tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.738231 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc032fda-7f7e-4717-b28f-c5b255e6c0ec tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.802633 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-bc032fda-7f7e-4717-b28f-c5b255e6c0ec tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] HTTP exception thrown: Instance 3cbd24d1-c9b9-4e54-a25f-c8553d279e56 could not be found. Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bc032fda-7f7e-4717-b28f-c5b255e6c0ec tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Request method failure captured: Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 HTTP/1.1 Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJiNhV16z4nc9-dvgN1oYsetPABmQ80TjNNMdhys6K47SL84YUPJDpCiDufhH6v6wucCeWAWpWRlL3sBxgSgOzZxFtoEU5iSlSP7PSv8nRhInko8xxLPpv2dozhhyMkCcqR6fHIamFhrC5KfY_KiAl6N23PBq4pT47eDAlx7uY-2aSk Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 74eef3bf938c491d8a2f5192ba598c19 Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-MigrationsAdminTest-1386345839 Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:36:36.808728 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:36:36.812580 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74eef3bf938c491d8a2f5192ba598c19", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74eef3bf938c491d8a2f5192ba598c19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74eef3bf938c491d8a2f5192ba598c19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74eef3bf938c491d8a2f5192ba598c19"}]}] Oct 04 20:36:36.812580 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-MigrationsAdminTest-1386345839 Oct 04 20:36:36.812580 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 74eef3bf938c491d8a2f5192ba598c19 Oct 04 20:36:36.812580 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-MigrationsAdminTest-1386345839 Oct 04 20:36:36.812580 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-MigrationsAdminTest-1386345839-project Oct 04 20:36:36.812580 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:36:36.812580 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:36:36.812580 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 4360a08eed56405b99333776285fef3a Oct 04 20:36:36.812580 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-MigrationsAdminTest-1386345839-project Oct 04 20:36:36.812580 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:36:36.812580 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 3cbd24d1-c9b9-4e54-a25f-c8553d279e56 could not be found. Oct 04 20:36:36.812580 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '3cbd24d1-c9b9-4e54-a25f-c8553d279e56'} Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cbd24d1-c9b9-4e54-a25f-c8553d279e56 could not be found. Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:36.814405 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cbd24d1-c9b9-4e54-a25f-c8553d279e56 could not be found. Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cbd24d1-c9b9-4e54-a25f-c8553d279e56 could not be found. Oct 04 20:36:36.820897 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.831955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bc032fda-7f7e-4717-b28f-c5b255e6c0ec tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Returning 404 to user: Instance 3cbd24d1-c9b9-4e54-a25f-c8553d279e56 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:36.839126 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bc032fda-7f7e-4717-b28f-c5b255e6c0ec tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56" status: 404 len: 111 microversion: 2.1 time: 0.171083 Oct 04 20:36:36.842354 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 412/825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:36 2022] GET /compute/v2.1/servers/3cbd24d1-c9b9-4e54-a25f-c8553d279e56 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-06125801-7212-4d79-a1cb-5ce38ad7ba6b tempest-ImagesOneServerNegativeTestJSON-1403018646 tempest-ImagesOneServerNegativeTestJSON-1403018646-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f77a886f-61f0-46bf-8ad5-f5e959186314) Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:36:36.851875 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.855048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:36:36.857630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:36:36.861404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f77a886f-61f0-46bf-8ad5-f5e959186314) Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-06125801-7212-4d79-a1cb-5ce38ad7ba6b tempest-ImagesOneServerNegativeTestJSON-1403018646 tempest-ImagesOneServerNegativeTestJSON-1403018646-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-06125801-7212-4d79-a1cb-5ce38ad7ba6b tempest-ImagesOneServerNegativeTestJSON-1403018646 tempest-ImagesOneServerNegativeTestJSON-1403018646-project] Request method failure captured: Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 216 Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJlNIc5dV9M0_SPdZkclvjkR9qxi6gmMxoK34TsLGaWaYbrbqbW2GrvkMOGDbfqwCicjh0d41m7FOExNxdrTn0vSVmke6qqiAvjrfHsYaTushHRnRWHiHyxLnr-mLVIC7iyDEOpi0OvEnaru1yzXPeIi7iUCJz2Xhi4o7KSlR25bCtw Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 0f91c2932cc340f485c55568d70fe0b0 Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1403018646 Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:36:36.863854 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:36:36.870460 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0f91c2932cc340f485c55568d70fe0b0", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0f91c2932cc340f485c55568d70fe0b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0f91c2932cc340f485c55568d70fe0b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0f91c2932cc340f485c55568d70fe0b0"}]}] Oct 04 20:36:36.870460 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1403018646 Oct 04 20:36:36.870460 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 0f91c2932cc340f485c55568d70fe0b0 Oct 04 20:36:36.870460 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1403018646 Oct 04 20:36:36.870460 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesOneServerNegativeTestJSON-1403018646-project Oct 04 20:36:36.870460 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:36:36.870460 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:36:36.870460 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: cc67cd38dc584936b88d4f0185f3e8a0 Oct 04 20:36:36.870460 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1403018646-project Oct 04 20:36:36.870460 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:36:36.870460 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-641433228", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "df2b7da7-6013-4113-a882-eeb499a29518"}]}} Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ImagesOneServerNegativeTestJSON-server-641433228', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'df2b7da7-6013-4113-a882-eeb499a29518'}]}}} Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:36:36.874424 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.877070 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:36:36.879877 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:36:36.886712 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f77a886f-61f0-46bf-8ad5-f5e959186314) Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:36.889903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:36.892845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:36.892845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:36.892845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:36:36.892845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.892845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.892845 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-06125801-7212-4d79-a1cb-5ce38ad7ba6b tempest-ImagesOneServerNegativeTestJSON-1403018646 tempest-ImagesOneServerNegativeTestJSON-1403018646-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:36:36.892845 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:36.892845 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-06125801-7212-4d79-a1cb-5ce38ad7ba6b tempest-ImagesOneServerNegativeTestJSON-1403018646 tempest-ImagesOneServerNegativeTestJSON-1403018646-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 5.179097 Oct 04 20:36:36.892845 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 414/826] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:31 2022] POST /compute/v2.1/servers => generated 214 bytes in 5203 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:36:36.900356 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-78f04ed9-856c-49c8-b9a9-fecccc430286 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:36.914885 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-78f04ed9-856c-49c8-b9a9-fecccc430286 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:36.927187 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78f04ed9-856c-49c8-b9a9-fecccc430286 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.928555 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78f04ed9-856c-49c8-b9a9-fecccc430286 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.929652 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78f04ed9-856c-49c8-b9a9-fecccc430286 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.931594 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78f04ed9-856c-49c8-b9a9-fecccc430286 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.932769 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78f04ed9-856c-49c8-b9a9-fecccc430286 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.933803 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78f04ed9-856c-49c8-b9a9-fecccc430286 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:37.014489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-78f04ed9-856c-49c8-b9a9-fecccc430286 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:36:37.022165 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4a797e83-ae27-464f-92d8-295a5a35fee5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:37.023866 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4a797e83-ae27-464f-92d8-295a5a35fee5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:37.053708 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4a797e83-ae27-464f-92d8-295a5a35fee5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:37.057225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4a797e83-ae27-464f-92d8-295a5a35fee5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:37.059289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4a797e83-ae27-464f-92d8-295a5a35fee5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:37.062991 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4a797e83-ae27-464f-92d8-295a5a35fee5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:37.065106 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4a797e83-ae27-464f-92d8-295a5a35fee5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:37.065923 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4a797e83-ae27-464f-92d8-295a5a35fee5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:37.593158 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-78f04ed9-856c-49c8-b9a9-fecccc430286 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 204 len: 0 microversion: 2.1 time: 0.742767 Oct 04 20:36:37.595585 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 413/827] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:36 2022] DELETE /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:36:37.613929 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5db5f43b-ba46-421d-9e6a-190c45164d15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:37.624070 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-5db5f43b-ba46-421d-9e6a-190c45164d15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:37.665351 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5db5f43b-ba46-421d-9e6a-190c45164d15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:37.672895 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5db5f43b-ba46-421d-9e6a-190c45164d15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:37.682154 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5db5f43b-ba46-421d-9e6a-190c45164d15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:37.685463 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5db5f43b-ba46-421d-9e6a-190c45164d15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:37.690479 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5db5f43b-ba46-421d-9e6a-190c45164d15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:37.691592 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5db5f43b-ba46-421d-9e6a-190c45164d15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:37.710049 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:38.900158 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4a797e83-ae27-464f-92d8-295a5a35fee5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:38.939177 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4a797e83-ae27-464f-92d8-295a5a35fee5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1316 microversion: 2.1 time: 1.933898 Oct 04 20:36:38.953317 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 415/828] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:37 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1316 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:39.190823 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-5db5f43b-ba46-421d-9e6a-190c45164d15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:39.251203 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5db5f43b-ba46-421d-9e6a-190c45164d15 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1534 microversion: 2.1 time: 1.648479 Oct 04 20:36:39.253253 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 414/829] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:37 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1534 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:39.819051 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-97157b32-b9c7-4ec4-a94f-081c6b303fc5 req-ae51007b-0515-45b4-9025-e6342aecf2ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73277283-dff3-403d-a03b-b44ab89b63c8", "tag": "4d3acb0b-9db4-4859-841b-32026dc92298"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:39.867352 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-97157b32-b9c7-4ec4-a94f-081c6b303fc5 req-ae51007b-0515-45b4-9025-e6342aecf2ce service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:39.868258 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-97157b32-b9c7-4ec4-a94f-081c6b303fc5 req-ae51007b-0515-45b4-9025-e6342aecf2ce service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:39.869293 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-97157b32-b9c7-4ec4-a94f-081c6b303fc5 req-ae51007b-0515-45b4-9025-e6342aecf2ce service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:39.911953 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-97157b32-b9c7-4ec4-a94f-081c6b303fc5 req-ae51007b-0515-45b4-9025-e6342aecf2ce service nova] Creating event network-changed:4d3acb0b-9db4-4859-841b-32026dc92298 for instance 73277283-dff3-403d-a03b-b44ab89b63c8 on n-h1-852085-12 Oct 04 20:36:39.936643 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-97157b32-b9c7-4ec4-a94f-081c6b303fc5 req-ae51007b-0515-45b4-9025-e6342aecf2ce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125320 Oct 04 20:36:39.943365 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 416/830] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:36:39.992270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7d5b010f-a2bf-4638-81db-f86aeffb40e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:39.997530 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7d5b010f-a2bf-4638-81db-f86aeffb40e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:40.023314 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7d5b010f-a2bf-4638-81db-f86aeffb40e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.024857 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7d5b010f-a2bf-4638-81db-f86aeffb40e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.026096 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7d5b010f-a2bf-4638-81db-f86aeffb40e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.031603 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7d5b010f-a2bf-4638-81db-f86aeffb40e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.033103 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7d5b010f-a2bf-4638-81db-f86aeffb40e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.039538 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7d5b010f-a2bf-4638-81db-f86aeffb40e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.313842 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4495e9d9-e539-4b81-ac57-2191f5d82a2c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:40.315386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4495e9d9-e539-4b81-ac57-2191f5d82a2c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:40.427559 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4495e9d9-e539-4b81-ac57-2191f5d82a2c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.428982 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4495e9d9-e539-4b81-ac57-2191f5d82a2c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.429948 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4495e9d9-e539-4b81-ac57-2191f5d82a2c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.431495 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4495e9d9-e539-4b81-ac57-2191f5d82a2c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.432379 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4495e9d9-e539-4b81-ac57-2191f5d82a2c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.433455 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4495e9d9-e539-4b81-ac57-2191f5d82a2c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:41.601146 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7d5b010f-a2bf-4638-81db-f86aeffb40e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:41.633257 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7d5b010f-a2bf-4638-81db-f86aeffb40e6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1316 microversion: 2.1 time: 1.650152 Oct 04 20:36:41.641336 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 415/831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:39 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1316 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:42.226461 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4495e9d9-e539-4b81-ac57-2191f5d82a2c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:42.245939 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4495e9d9-e539-4b81-ac57-2191f5d82a2c tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1534 microversion: 2.1 time: 1.949627 Oct 04 20:36:42.278511 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 417/832] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:40 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1534 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:42.693812 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e806e1c1-7e1e-4a11-887c-81f04a8d3a97 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:42.698497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e806e1c1-7e1e-4a11-887c-81f04a8d3a97 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:42.724494 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bbe4db8e-ad26-4767-bd28-f5a7fb1f3dd5 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] Action: 'create', calling method: .version_select at 0x7f77ef4d9790>, body: {"keypair": {"name": "tempest-keypair-843262235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNxb/TumkPeF1P/Gw2CVe8iStYXy2lJMuYveFumpL+X1rSaQjG+YHRxJzdAuizv48W3H2muvGNqRITAq5pT5iZQOPmjWCa4c5SqyrvlwaARsLT6LPrk/r6HsIloO3A3NA=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:42.726684 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e806e1c1-7e1e-4a11-887c-81f04a8d3a97 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:42.730479 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e806e1c1-7e1e-4a11-887c-81f04a8d3a97 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:42.734900 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e806e1c1-7e1e-4a11-887c-81f04a8d3a97 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:42.734900 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e806e1c1-7e1e-4a11-887c-81f04a8d3a97 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:42.734900 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e806e1c1-7e1e-4a11-887c-81f04a8d3a97 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:42.734900 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e806e1c1-7e1e-4a11-887c-81f04a8d3a97 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:42.792172 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-bbe4db8e-ad26-4767-bd28-f5a7fb1f3dd5 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] Getting quotas for project 0184f3fdbd854adf9751ab0ef77bdb2a. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:42.809753 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-bbe4db8e-ad26-4767-bd28-f5a7fb1f3dd5 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] Getting quotas for user 803f3ac2d73740ad9ab92cef252f07e6 and project 0184f3fdbd854adf9751ab0ef77bdb2a. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:43.011807 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bbe4db8e-ad26-4767-bd28-f5a7fb1f3dd5 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.977043 Oct 04 20:36:43.014251 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 416/833] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:36:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:43.294225 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3b733197-272b-4876-9d51-15db453cf3c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:43.296029 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3b733197-272b-4876-9d51-15db453cf3c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:43.346435 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b733197-272b-4876-9d51-15db453cf3c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:43.350924 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b733197-272b-4876-9d51-15db453cf3c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:43.352071 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b733197-272b-4876-9d51-15db453cf3c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:43.354664 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b733197-272b-4876-9d51-15db453cf3c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:43.360133 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b733197-272b-4876-9d51-15db453cf3c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:43.361072 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b733197-272b-4876-9d51-15db453cf3c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.228726 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3b733197-272b-4876-9d51-15db453cf3c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:44.271613 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3b733197-272b-4876-9d51-15db453cf3c3 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1492 microversion: 2.1 time: 0.982882 Oct 04 20:36:44.292995 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 417/834] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:43 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1492 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:44.370847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e806e1c1-7e1e-4a11-887c-81f04a8d3a97 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:44.423011 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e806e1c1-7e1e-4a11-887c-81f04a8d3a97 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1316 microversion: 2.1 time: 1.739768 Oct 04 20:36:44.436167 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 418/835] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:42 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1316 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:44.964296 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-54212263-83f3-4556-9434-ad6f5eaf4870 req-7a26d36c-e188-4d37-899d-7c8384e7e022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f57f25a-23a5-469a-bdab-c55a3d3a7201", "name": "network-vif-deleted", "tag": "0c7adf8c-2e14-4eaa-bfab-9dbb2f275d44"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:45.025074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-54212263-83f3-4556-9434-ad6f5eaf4870 req-7a26d36c-e188-4d37-899d-7c8384e7e022 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.038852 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-54212263-83f3-4556-9434-ad6f5eaf4870 req-7a26d36c-e188-4d37-899d-7c8384e7e022 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.040690 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-54212263-83f3-4556-9434-ad6f5eaf4870 req-7a26d36c-e188-4d37-899d-7c8384e7e022 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.105888 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-54212263-83f3-4556-9434-ad6f5eaf4870 req-7a26d36c-e188-4d37-899d-7c8384e7e022 service nova] Creating event network-vif-deleted:0c7adf8c-2e14-4eaa-bfab-9dbb2f275d44 for instance 0f57f25a-23a5-469a-bdab-c55a3d3a7201 on n-h2-852085-12 Oct 04 20:36:45.132707 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-54212263-83f3-4556-9434-ad6f5eaf4870 req-7a26d36c-e188-4d37-899d-7c8384e7e022 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.837056 Oct 04 20:36:45.141918 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 418/836] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:45.326894 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:45.333837 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:45.359098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.360037 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.369757 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.372082 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.385389 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.386846 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.491675 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d938a4de-906d-4d5d-ba7b-d68b9faef474 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:45.493008 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d938a4de-906d-4d5d-ba7b-d68b9faef474 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:45.536451 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d938a4de-906d-4d5d-ba7b-d68b9faef474 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.537656 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d938a4de-906d-4d5d-ba7b-d68b9faef474 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.541171 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d938a4de-906d-4d5d-ba7b-d68b9faef474 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.543015 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d938a4de-906d-4d5d-ba7b-d68b9faef474 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.550538 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d938a4de-906d-4d5d-ba7b-d68b9faef474 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.551750 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d938a4de-906d-4d5d-ba7b-d68b9faef474 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.585876 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.586845 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.592136 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.593153 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lazy-loading 'fault' on Instance uuid 0f57f25a-23a5-469a-bdab-c55a3d3a7201 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:36:46.089426 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:46.120513 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-25a2351a-94cc-49d8-a9c2-5a5d1ffeeba6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 200 len: 1369 microversion: 2.1 time: 0.796451 Oct 04 20:36:46.126908 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 419/837] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:45 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 1369 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:46.747636 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-d938a4de-906d-4d5d-ba7b-d68b9faef474 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:46.785974 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d938a4de-906d-4d5d-ba7b-d68b9faef474 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1316 microversion: 2.1 time: 1.298295 Oct 04 20:36:46.789390 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 419/838] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:45 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1316 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:47.205481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c17dbaad-5eb9-404f-a84f-9bfcacab7ec6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:47.205481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c17dbaad-5eb9-404f-a84f-9bfcacab7ec6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: 0f57f25a-23a5-469a-bdab-c55a3d3a7201] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:47.224492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c17dbaad-5eb9-404f-a84f-9bfcacab7ec6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.225473 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c17dbaad-5eb9-404f-a84f-9bfcacab7ec6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.226497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c17dbaad-5eb9-404f-a84f-9bfcacab7ec6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:47.228181 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c17dbaad-5eb9-404f-a84f-9bfcacab7ec6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.235075 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c17dbaad-5eb9-404f-a84f-9bfcacab7ec6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.236509 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c17dbaad-5eb9-404f-a84f-9bfcacab7ec6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:47.313544 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-c17dbaad-5eb9-404f-a84f-9bfcacab7ec6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] HTTP exception thrown: Instance 0f57f25a-23a5-469a-bdab-c55a3d3a7201 could not be found. Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c17dbaad-5eb9-404f-a84f-9bfcacab7ec6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Request method failure captured: Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 HTTP/1.1 Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJiNhV16z4nc9-dvgN1oYsetPABmQ80TjNNMdhys6K47SL84YUPJDpCiDufhH6v6wucCeWAWpWRlL3sBxgSgOzZxFtoEU5iSlSP7PSv8nRhInko8xxLPpv2dozhhyMkCcqR6fHIamFhrC5KfY_KiAl6N23PBq4pT47eDAlx7uY-2aSk Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 74eef3bf938c491d8a2f5192ba598c19 Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-MigrationsAdminTest-1386345839 Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:36:47.317497 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:36:47.320417 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74eef3bf938c491d8a2f5192ba598c19", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74eef3bf938c491d8a2f5192ba598c19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74eef3bf938c491d8a2f5192ba598c19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74eef3bf938c491d8a2f5192ba598c19"}]}] Oct 04 20:36:47.320417 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-MigrationsAdminTest-1386345839 Oct 04 20:36:47.320417 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 74eef3bf938c491d8a2f5192ba598c19 Oct 04 20:36:47.320417 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-MigrationsAdminTest-1386345839 Oct 04 20:36:47.320417 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-MigrationsAdminTest-1386345839-project Oct 04 20:36:47.320417 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:36:47.320417 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:36:47.320417 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 4360a08eed56405b99333776285fef3a Oct 04 20:36:47.320417 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-MigrationsAdminTest-1386345839-project Oct 04 20:36:47.320417 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:36:47.320417 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 0f57f25a-23a5-469a-bdab-c55a3d3a7201 could not be found. Oct 04 20:36:47.320417 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '0f57f25a-23a5-469a-bdab-c55a3d3a7201'} Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f57f25a-23a5-469a-bdab-c55a3d3a7201 could not be found. Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:47.322895 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f57f25a-23a5-469a-bdab-c55a3d3a7201 could not be found. Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f57f25a-23a5-469a-bdab-c55a3d3a7201 could not be found. Oct 04 20:36:47.325579 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:36:47.348238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c17dbaad-5eb9-404f-a84f-9bfcacab7ec6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Returning 404 to user: Instance 0f57f25a-23a5-469a-bdab-c55a3d3a7201 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:47.348238 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c17dbaad-5eb9-404f-a84f-9bfcacab7ec6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201" status: 404 len: 111 microversion: 2.1 time: 0.168789 Oct 04 20:36:47.351700 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 420/839] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:47 2022] GET /compute/v2.1/servers/0f57f25a-23a5-469a-bdab-c55a3d3a7201 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:47.360812 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7bbc4955-561e-4abe-a805-bf3af326f646 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:47.370981 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7bbc4955-561e-4abe-a805-bf3af326f646 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:47.397829 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7bbc4955-561e-4abe-a805-bf3af326f646 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.398889 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7bbc4955-561e-4abe-a805-bf3af326f646 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.405761 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7bbc4955-561e-4abe-a805-bf3af326f646 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:47.407082 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7bbc4955-561e-4abe-a805-bf3af326f646 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.411609 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7bbc4955-561e-4abe-a805-bf3af326f646 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.415092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7bbc4955-561e-4abe-a805-bf3af326f646 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:47.548340 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7bbc4955-561e-4abe-a805-bf3af326f646 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:36:47.837178 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-22cb3865-b796-49ab-9233-4d1aa9e801ee tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:47.838319 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-22cb3865-b796-49ab-9233-4d1aa9e801ee tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:47.862378 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-22cb3865-b796-49ab-9233-4d1aa9e801ee tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.863766 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-22cb3865-b796-49ab-9233-4d1aa9e801ee tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.868398 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-22cb3865-b796-49ab-9233-4d1aa9e801ee tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:47.879372 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-22cb3865-b796-49ab-9233-4d1aa9e801ee tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.880890 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-22cb3865-b796-49ab-9233-4d1aa9e801ee tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.882735 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-22cb3865-b796-49ab-9233-4d1aa9e801ee tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:48.394540 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7bbc4955-561e-4abe-a805-bf3af326f646 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 204 len: 0 microversion: 2.1 time: 1.035504 Oct 04 20:36:48.399718 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 420/840] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:47 2022] DELETE /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 0 bytes in 1049 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:36:48.446864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1b5bd4fb-5ad2-4aad-ae24-f96a25c4bf08 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:48.450534 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1b5bd4fb-5ad2-4aad-ae24-f96a25c4bf08 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:48.468432 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b5bd4fb-5ad2-4aad-ae24-f96a25c4bf08 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:48.471236 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b5bd4fb-5ad2-4aad-ae24-f96a25c4bf08 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:48.473893 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b5bd4fb-5ad2-4aad-ae24-f96a25c4bf08 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:48.475731 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b5bd4fb-5ad2-4aad-ae24-f96a25c4bf08 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:48.478525 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b5bd4fb-5ad2-4aad-ae24-f96a25c4bf08 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:48.483302 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1b5bd4fb-5ad2-4aad-ae24-f96a25c4bf08 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:49.998843 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1b5bd4fb-5ad2-4aad-ae24-f96a25c4bf08 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:50.022440 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1b5bd4fb-5ad2-4aad-ae24-f96a25c4bf08 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 200 len: 1467 microversion: 2.1 time: 1.610501 Oct 04 20:36:50.041145 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 421/841] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:48 2022] GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 1467 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:50.582170 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6a321230-b822-4685-b71e-d9362280ae84 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Calling method '.version_select at 0x7f77ef4d0700>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:50.839180 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-22cb3865-b796-49ab-9233-4d1aa9e801ee tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:50.953563 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-22cb3865-b796-49ab-9233-4d1aa9e801ee tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1316 microversion: 2.1 time: 3.123262 Oct 04 20:36:50.972478 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 421/842] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:47 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1316 bytes in 3144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:51.056688 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6a321230-b822-4685-b71e-d9362280ae84 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb" status: 200 len: 371 microversion: 2.1 time: 0.987806 Oct 04 20:36:51.080748 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-46c24349-7c73-495d-b739-b011e046a587 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:51.081776 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 422/843] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:36:50 2022] GET /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb => generated 371 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:51.088498 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-46c24349-7c73-495d-b739-b011e046a587 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:51.110630 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b6484efd-a2a3-4c03-9f86-2c5bf01a75c6 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef4d9790>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:51.124518 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-46c24349-7c73-495d-b739-b011e046a587 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:51.131447 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-46c24349-7c73-495d-b739-b011e046a587 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:51.132403 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-46c24349-7c73-495d-b739-b011e046a587 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:51.135372 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-46c24349-7c73-495d-b739-b011e046a587 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:51.136376 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-46c24349-7c73-495d-b739-b011e046a587 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:51.137144 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-46c24349-7c73-495d-b739-b011e046a587 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:51.499770 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b6484efd-a2a3-4c03-9f86-2c5bf01a75c6 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:51.508148 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b6484efd-a2a3-4c03-9f86-2c5bf01a75c6 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:51.508148 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b6484efd-a2a3-4c03-9f86-2c5bf01a75c6 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:51.508148 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b6484efd-a2a3-4c03-9f86-2c5bf01a75c6 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:51.508148 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b6484efd-a2a3-4c03-9f86-2c5bf01a75c6 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:51.509131 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b6484efd-a2a3-4c03-9f86-2c5bf01a75c6 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:51.825252 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b6484efd-a2a3-4c03-9f86-2c5bf01a75c6 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb" status: 200 len: 328 microversion: 2.1 time: 0.729539 Oct 04 20:36:51.835310 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 423/844] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:36:51 2022] PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb => generated 328 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:52.018455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-36e5bc8c-194c-4b07-bb36-8265d972b104 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:52.037303 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-36e5bc8c-194c-4b07-bb36-8265d972b104 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:52.081792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-36e5bc8c-194c-4b07-bb36-8265d972b104 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:52.087030 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-36e5bc8c-194c-4b07-bb36-8265d972b104 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:52.091340 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-36e5bc8c-194c-4b07-bb36-8265d972b104 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:52.093001 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-36e5bc8c-194c-4b07-bb36-8265d972b104 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:52.096330 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-36e5bc8c-194c-4b07-bb36-8265d972b104 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:52.097547 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-36e5bc8c-194c-4b07-bb36-8265d972b104 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.808655 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-36e5bc8c-194c-4b07-bb36-8265d972b104 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:53.857286 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-36e5bc8c-194c-4b07-bb36-8265d972b104 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1316 microversion: 2.1 time: 1.830106 Oct 04 20:36:53.877913 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 424/845] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:52 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1316 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:54.065552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1326136366", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:54.288235 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:55.862858 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-46c24349-7c73-495d-b739-b011e046a587 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:55.866991 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=68 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:55.911569 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-46c24349-7c73-495d-b739-b011e046a587 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 200 len: 1467 microversion: 2.1 time: 4.838947 Oct 04 20:36:55.931461 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 422/846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:51 2022] GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 1467 bytes in 4861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:55.986453 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5f991c39-af4f-4d90-93c6-8104520eeb92 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:55.989088 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-5f991c39-af4f-4d90-93c6-8104520eeb92 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:56.004722 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:56.009390 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5f991c39-af4f-4d90-93c6-8104520eeb92 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.010728 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5f991c39-af4f-4d90-93c6-8104520eeb92 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.012025 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5f991c39-af4f-4d90-93c6-8104520eeb92 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.032202 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5f991c39-af4f-4d90-93c6-8104520eeb92 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.032202 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5f991c39-af4f-4d90-93c6-8104520eeb92 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.032202 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5f991c39-af4f-4d90-93c6-8104520eeb92 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.722288 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:56.723313 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:56.723965 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:56.725045 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:56.728297 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:56.763359 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.776455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.777873 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.779871 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.781175 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.782336 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.824276 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Getting quotas for project bbc9b2da40434437a6ce05b82deadbdb. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:56.834976 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Getting quotas for user 0bbad3c441544962b1397f90d80b6153 and project bbc9b2da40434437a6ce05b82deadbdb. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:56.868426 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.utils [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] cores quota exceeded for bbc9b2da40434437a6ce05b82deadbdb, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123540) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 20:36:56.870541 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Request method failure captured: Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 145 Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJleVcrO_p08CSyRgl4NHMW1f_Sbdjng6ES_Uyxevg-WmdsBGAV4-oVsr__g-1pYtcjSVvpoEAMktsZ_t7FC72ted2CM_-hRz_XhiZLUK6UWOK54OzXebVLHVkyOptvgc_5GwLcwdjTpCWvUxx01TrtLfrgocrqlyCdZn2vhMlKQLCc Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: bbc9b2da40434437a6ce05b82deadbdb Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-QuotasAdminNegativeTest-144984851 Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:36:56.879625 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:36:56.882325 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bbc9b2da40434437a6ce05b82deadbdb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bbc9b2da40434437a6ce05b82deadbdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bbc9b2da40434437a6ce05b82deadbdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bbc9b2da40434437a6ce05b82deadbdb"}]}] Oct 04 20:36:56.882325 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-QuotasAdminNegativeTest-144984851 Oct 04 20:36:56.882325 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: bbc9b2da40434437a6ce05b82deadbdb Oct 04 20:36:56.882325 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-144984851 Oct 04 20:36:56.882325 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-QuotasAdminNegativeTest-144984851-project Oct 04 20:36:56.882325 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:36:56.882325 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:36:56.882325 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 0bbad3c441544962b1397f90d80b6153 Oct 04 20:36:56.882325 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-QuotasAdminNegativeTest-144984851-project Oct 04 20:36:56.882325 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:36:56.882325 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1326136366", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} Oct 04 20:36:56.882325 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1326136366', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452'}}} Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 20:36:56.883908 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:56.887010 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.894104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:56.901372 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:56.901372 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:56.901372 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:56.901372 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:56.901372 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:36:56.901372 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.901372 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:56.901372 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5e00992c-d4b3-4d72-a33f-76adae5d814f tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 3.015906 Oct 04 20:36:56.903467 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 425/847] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:53 2022] POST /compute/v2.1/servers => generated 111 bytes in 3025 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:57.640101 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5f991c39-af4f-4d90-93c6-8104520eeb92 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:57.669967 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5f991c39-af4f-4d90-93c6-8104520eeb92 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1316 microversion: 2.1 time: 1.734229 Oct 04 20:36:57.671019 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 423/848] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:55 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1316 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:57.702635 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ee752199-89e5-4b24-8f9a-befd5382c98c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef13a3a0>, body: {"quota_set": {"cores": 20}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:57.718638 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-e1829e6c-1a9c-4e7b-a560-cfb896a663be req-33f2bb84-fafd-4068-b948-c50706cafa7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5072682-0691-4542-a881-7f874a8d8ef3", "name": "network-vif-unplugged", "status": "completed", "tag": "9508b042-5160-4988-9db8-7f6ce03be19a"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:57.766901 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e1829e6c-1a9c-4e7b-a560-cfb896a663be req-33f2bb84-fafd-4068-b948-c50706cafa7a service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.768933 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e1829e6c-1a9c-4e7b-a560-cfb896a663be req-33f2bb84-fafd-4068-b948-c50706cafa7a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.770165 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e1829e6c-1a9c-4e7b-a560-cfb896a663be req-33f2bb84-fafd-4068-b948-c50706cafa7a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.791788 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-e1829e6c-1a9c-4e7b-a560-cfb896a663be req-33f2bb84-fafd-4068-b948-c50706cafa7a service nova] Creating event network-vif-unplugged:9508b042-5160-4988-9db8-7f6ce03be19a for instance f5072682-0691-4542-a881-7f874a8d8ef3 on n-h2-852085-12 Oct 04 20:36:57.805071 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-e1829e6c-1a9c-4e7b-a560-cfb896a663be req-33f2bb84-fafd-4068-b948-c50706cafa7a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.898762 Oct 04 20:36:57.810792 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 426/849] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:57.823194 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-83ff0234-b372-4a3b-8ad0-2e207db30dbf tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:57.827438 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-83ff0234-b372-4a3b-8ad0-2e207db30dbf tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:57.842299 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83ff0234-b372-4a3b-8ad0-2e207db30dbf tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.843601 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83ff0234-b372-4a3b-8ad0-2e207db30dbf tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.844903 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83ff0234-b372-4a3b-8ad0-2e207db30dbf tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.848030 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83ff0234-b372-4a3b-8ad0-2e207db30dbf tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.849181 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83ff0234-b372-4a3b-8ad0-2e207db30dbf tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.850393 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83ff0234-b372-4a3b-8ad0-2e207db30dbf tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.220740 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee752199-89e5-4b24-8f9a-befd5382c98c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.221866 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee752199-89e5-4b24-8f9a-befd5382c98c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.222632 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee752199-89e5-4b24-8f9a-befd5382c98c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.224131 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee752199-89e5-4b24-8f9a-befd5382c98c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.225013 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee752199-89e5-4b24-8f9a-befd5382c98c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.226055 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ee752199-89e5-4b24-8f9a-befd5382c98c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.658017 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ee752199-89e5-4b24-8f9a-befd5382c98c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb" status: 200 len: 329 microversion: 2.1 time: 0.979634 Oct 04 20:36:58.661713 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 424/850] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:36:57 2022] PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb => generated 329 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:58.702915 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5242340c-5642-42a6-bb14-ec851ec86302 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Calling method '.version_select at 0x7f77eefd9820>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:58.962233 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5242340c-5642-42a6-bb14-ec851ec86302 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb" status: 200 len: 371 microversion: 2.1 time: 0.270094 Oct 04 20:36:58.964172 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 425/851] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:36:58 2022] GET /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb => generated 371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:58.980564 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-620a85fc-e726-44d5-ac1a-91b5f73c7961 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:58.983588 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-620a85fc-e726-44d5-ac1a-91b5f73c7961 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:59.023791 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-620a85fc-e726-44d5-ac1a-91b5f73c7961 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:59.028082 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-620a85fc-e726-44d5-ac1a-91b5f73c7961 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:59.029908 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-620a85fc-e726-44d5-ac1a-91b5f73c7961 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:59.032206 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-620a85fc-e726-44d5-ac1a-91b5f73c7961 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:59.036027 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-620a85fc-e726-44d5-ac1a-91b5f73c7961 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:59.039791 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-620a85fc-e726-44d5-ac1a-91b5f73c7961 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:59.973348 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-83ff0234-b372-4a3b-8ad0-2e207db30dbf tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:59.998973 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-83ff0234-b372-4a3b-8ad0-2e207db30dbf tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 200 len: 1467 microversion: 2.1 time: 2.185191 Oct 04 20:37:00.000803 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 427/852] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:57 2022] GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 1467 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:00.022292 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5dbcb18e-3ed1-402f-a029-f66014295775 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef9b9550>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:00.278876 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5dbcb18e-3ed1-402f-a029-f66014295775 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:00.278876 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5dbcb18e-3ed1-402f-a029-f66014295775 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:00.278876 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5dbcb18e-3ed1-402f-a029-f66014295775 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:00.278876 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5dbcb18e-3ed1-402f-a029-f66014295775 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:00.279651 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5dbcb18e-3ed1-402f-a029-f66014295775 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:00.283587 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5dbcb18e-3ed1-402f-a029-f66014295775 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:00.580535 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5dbcb18e-3ed1-402f-a029-f66014295775 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb" status: 200 len: 328 microversion: 2.1 time: 0.576724 Oct 04 20:37:00.595186 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 428/853] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:37:00 2022] PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb => generated 328 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:00.617171 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-9658fb81-1d3e-4e0f-9c50-5c575d291a26 req-3b9f9b7f-c361-4a9d-b1c7-15ad33a4561a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5072682-0691-4542-a881-7f874a8d8ef3", "name": "network-vif-deleted", "tag": "9508b042-5160-4988-9db8-7f6ce03be19a"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:00.662975 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-9658fb81-1d3e-4e0f-9c50-5c575d291a26 req-3b9f9b7f-c361-4a9d-b1c7-15ad33a4561a service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:00.664604 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-9658fb81-1d3e-4e0f-9c50-5c575d291a26 req-3b9f9b7f-c361-4a9d-b1c7-15ad33a4561a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:00.665891 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-9658fb81-1d3e-4e0f-9c50-5c575d291a26 req-3b9f9b7f-c361-4a9d-b1c7-15ad33a4561a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:00.719957 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-9658fb81-1d3e-4e0f-9c50-5c575d291a26 req-3b9f9b7f-c361-4a9d-b1c7-15ad33a4561a service nova] Creating event network-vif-deleted:9508b042-5160-4988-9db8-7f6ce03be19a for instance f5072682-0691-4542-a881-7f874a8d8ef3 on n-h2-852085-12 Oct 04 20:37:00.747279 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-9658fb81-1d3e-4e0f-9c50-5c575d291a26 req-3b9f9b7f-c361-4a9d-b1c7-15ad33a4561a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152790 Oct 04 20:37:00.753661 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 429/854] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:00.933595 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-620a85fc-e726-44d5-ac1a-91b5f73c7961 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:00.959180 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-620a85fc-e726-44d5-ac1a-91b5f73c7961 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1316 microversion: 2.1 time: 1.991807 Oct 04 20:37:00.966972 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 426/855] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:58 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1316 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:01.039048 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-666139885", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:01.053511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:01.063237 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:01.078503 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.083444 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.088721 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.091260 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.093645 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.096925 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.224161 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:01.245472 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.246022 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.248197 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.249645 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lazy-loading 'fault' on Instance uuid f5072682-0691-4542-a881-7f874a8d8ef3 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:01.769783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.848681 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2c2b28a3-0421-465a-ae22-68913a0dad0d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 200 len: 1302 microversion: 2.1 time: 0.802666 Oct 04 20:37:01.853326 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 427/856] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:01 2022] GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 1302 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:01.866119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4ac973cf-a02e-4022-9f7d-877406447b65 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1804635482", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "096f784c-3ac1-48ba-8b74-20f8936c58f6"}], "security_groups": [{"name": "tempest-securitygroup--871331959"}], "key_name": "tempest-keypair-843262235", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:02.507281 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-4ac973cf-a02e-4022-9f7d-877406447b65 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] validate_networks() for [('096f784c-3ac1-48ba-8b74-20f8936c58f6', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:02.513324 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:02.515169 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:02.515935 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:02.516758 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:02.517432 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:02.551706 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.552836 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.553669 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.554877 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.556828 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.557626 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.631101 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Getting quotas for project bbc9b2da40434437a6ce05b82deadbdb. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:02.656274 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:02.660850 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Getting quotas for user 0bbad3c441544962b1397f90d80b6153 and project bbc9b2da40434437a6ce05b82deadbdb. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:02.745765 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.utils [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] instances quota exceeded for bbc9b2da40434437a6ce05b82deadbdb, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123540) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 20:37:02.746530 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Request method failure captured: Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 144 Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJleVcrO_p08CSyRgl4NHMW1f_Sbdjng6ES_Uyxevg-WmdsBGAV4-oVsr__g-1pYtcjSVvpoEAMktsZ_t7FC72ted2CM_-hRz_XhiZLUK6UWOK54OzXebVLHVkyOptvgc_5GwLcwdjTpCWvUxx01TrtLfrgocrqlyCdZn2vhMlKQLCc Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: bbc9b2da40434437a6ce05b82deadbdb Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-QuotasAdminNegativeTest-144984851 Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:02.752261 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:02.754691 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bbc9b2da40434437a6ce05b82deadbdb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bbc9b2da40434437a6ce05b82deadbdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bbc9b2da40434437a6ce05b82deadbdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bbc9b2da40434437a6ce05b82deadbdb"}]}] Oct 04 20:37:02.754691 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-QuotasAdminNegativeTest-144984851 Oct 04 20:37:02.754691 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: bbc9b2da40434437a6ce05b82deadbdb Oct 04 20:37:02.754691 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-144984851 Oct 04 20:37:02.754691 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-QuotasAdminNegativeTest-144984851-project Oct 04 20:37:02.754691 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:02.754691 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:02.754691 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 0bbad3c441544962b1397f90d80b6153 Oct 04 20:37:02.754691 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-QuotasAdminNegativeTest-144984851-project Oct 04 20:37:02.754691 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:02.754691 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-666139885", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} Oct 04 20:37:02.754691 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-666139885', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452'}}} Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 20:37:02.756395 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:02.758666 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:02.761229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:02.764109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:02.764109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:02.764109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:02.764109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:02.764109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:37:02.764109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:02.764109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:02.764109 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-49b6427f-42ef-47b2-9211-690b9f74a4f5 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.730761 Oct 04 20:37:02.764109 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 430/857] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:01 2022] POST /compute/v2.1/servers => generated 119 bytes in 1734 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:02.770881 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1bd6d216-d84b-4b4a-9804-21b78daf9941 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:02.772478 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1bd6d216-d84b-4b4a-9804-21b78daf9941 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:02.822579 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1bd6d216-d84b-4b4a-9804-21b78daf9941 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.823258 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1bd6d216-d84b-4b4a-9804-21b78daf9941 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.824381 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1bd6d216-d84b-4b4a-9804-21b78daf9941 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.827772 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1bd6d216-d84b-4b4a-9804-21b78daf9941 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.828792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1bd6d216-d84b-4b4a-9804-21b78daf9941 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.829270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1bd6d216-d84b-4b4a-9804-21b78daf9941 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.818162 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1bd6d216-d84b-4b4a-9804-21b78daf9941 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:03.848412 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1bd6d216-d84b-4b4a-9804-21b78daf9941 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1316 microversion: 2.1 time: 1.086409 Oct 04 20:37:03.860690 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 431/858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:02 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1316 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:03.889850 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-5d488d0a-9e63-4afa-accf-6c75ae32378a req-c5aa0eb3-b24f-4fd4-85a2-8df637b6dfbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73277283-dff3-403d-a03b-b44ab89b63c8", "name": "network-vif-plugged", "status": "completed", "tag": "4d3acb0b-9db4-4859-841b-32026dc92298"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-4ac973cf-a02e-4022-9f7d-877406447b65 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-957c708f-8a35-426a-9b5b-4f65a244c03a) Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:03.938048 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:03.940955 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:37:03.944573 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:37:03.949993 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:37:03.960703 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-957c708f-8a35-426a-9b5b-4f65a244c03a) Oct 04 20:37:03.960703 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.960703 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-4ac973cf-a02e-4022-9f7d-877406447b65 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:03.960703 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:03.961286 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-5d488d0a-9e63-4afa-accf-6c75ae32378a req-c5aa0eb3-b24f-4fd4-85a2-8df637b6dfbb service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.961286 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-5d488d0a-9e63-4afa-accf-6c75ae32378a req-c5aa0eb3-b24f-4fd4-85a2-8df637b6dfbb service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4ac973cf-a02e-4022-9f7d-877406447b65 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] Request method failure captured: Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 463 Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJk5AbskNXJ6a0qH3XurNTeUItBzeVSXHxg1DACg49hdshJORZY1Qdaz9s1TIrG15K4IkOLEu8jtK4SrJHQN5qf6F7L5gaN5VcxZQN6R7hEUqifvc7_eLAx5CQls38GzZnvZETPPt0Q74W_W-pyojTJVZzgqC_DO06oDZYVv13TcxuE Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 0184f3fdbd854adf9751ab0ef77bdb2a Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-VolumesAdminNegativeTest-976428390 Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:37:03.961557 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:37:03.963917 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0184f3fdbd854adf9751ab0ef77bdb2a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0184f3fdbd854adf9751ab0ef77bdb2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0184f3fdbd854adf9751ab0ef77bdb2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0184f3fdbd854adf9751ab0ef77bdb2a"}]}] Oct 04 20:37:03.963917 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-VolumesAdminNegativeTest-976428390 Oct 04 20:37:03.963917 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 0184f3fdbd854adf9751ab0ef77bdb2a Oct 04 20:37:03.963917 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-976428390 Oct 04 20:37:03.963917 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-VolumesAdminNegativeTest-976428390-project Oct 04 20:37:03.963917 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:37:03.963917 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:37:03.963917 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 803f3ac2d73740ad9ab92cef252f07e6 Oct 04 20:37:03.963917 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-VolumesAdminNegativeTest-976428390-project Oct 04 20:37:03.963917 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1804635482", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "096f784c-3ac1-48ba-8b74-20f8936c58f6"}], "security_groups": [{"name": "tempest-securitygroup--871331959"}], "key_name": "tempest-keypair-843262235", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-VolumesAdminNegativeTest-server-1804635482', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '096f784c-3ac1-48ba-8b74-20f8936c58f6'}], 'security_groups': [{'name': 'tempest-securitygroup--871331959'}], 'key_name': 'tempest-keypair-843262235', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:03.965350 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:37:03.967846 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:37:03.973266 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:37:03.975567 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-957c708f-8a35-426a-9b5b-4f65a244c03a) Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:37:03.977826 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.980352 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.984016 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-5d488d0a-9e63-4afa-accf-6c75ae32378a req-c5aa0eb3-b24f-4fd4-85a2-8df637b6dfbb service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.984246 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4ac973cf-a02e-4022-9f7d-877406447b65 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:03.984246 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:03.984246 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4ac973cf-a02e-4022-9f7d-877406447b65 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.109540 Oct 04 20:37:03.984246 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 428/859] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:01 2022] POST /compute/v2.1/servers => generated 214 bytes in 2113 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:37:04.007663 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6d77765f-2437-4aa1-88c5-c8c6119b5e6c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef07f310>, body: {"quota_set": {"instances": 10}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:04.029675 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-5d488d0a-9e63-4afa-accf-6c75ae32378a req-c5aa0eb3-b24f-4fd4-85a2-8df637b6dfbb service nova] Creating event network-vif-plugged:4d3acb0b-9db4-4859-841b-32026dc92298 for instance 73277283-dff3-403d-a03b-b44ab89b63c8 on n-h1-852085-12 Oct 04 20:37:04.069137 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-5d488d0a-9e63-4afa-accf-6c75ae32378a req-c5aa0eb3-b24f-4fd4-85a2-8df637b6dfbb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206258 Oct 04 20:37:04.077151 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 432/860] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:04.093198 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4488acc5-e074-46bb-b70b-cff6def413d8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:04.103797 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4488acc5-e074-46bb-b70b-cff6def413d8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: f5072682-0691-4542-a881-7f874a8d8ef3] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:04.161511 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4488acc5-e074-46bb-b70b-cff6def413d8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.162742 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4488acc5-e074-46bb-b70b-cff6def413d8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.163708 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4488acc5-e074-46bb-b70b-cff6def413d8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.166313 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4488acc5-e074-46bb-b70b-cff6def413d8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.170063 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4488acc5-e074-46bb-b70b-cff6def413d8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.173996 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4488acc5-e074-46bb-b70b-cff6def413d8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.276656 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-4488acc5-e074-46bb-b70b-cff6def413d8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] HTTP exception thrown: Instance f5072682-0691-4542-a881-7f874a8d8ef3 could not be found. Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4488acc5-e074-46bb-b70b-cff6def413d8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Request method failure captured: Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 HTTP/1.1 Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJiNhV16z4nc9-dvgN1oYsetPABmQ80TjNNMdhys6K47SL84YUPJDpCiDufhH6v6wucCeWAWpWRlL3sBxgSgOzZxFtoEU5iSlSP7PSv8nRhInko8xxLPpv2dozhhyMkCcqR6fHIamFhrC5KfY_KiAl6N23PBq4pT47eDAlx7uY-2aSk Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 74eef3bf938c491d8a2f5192ba598c19 Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-MigrationsAdminTest-1386345839 Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:04.302681 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:04.305262 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74eef3bf938c491d8a2f5192ba598c19", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74eef3bf938c491d8a2f5192ba598c19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74eef3bf938c491d8a2f5192ba598c19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74eef3bf938c491d8a2f5192ba598c19"}]}] Oct 04 20:37:04.305262 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-MigrationsAdminTest-1386345839 Oct 04 20:37:04.305262 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 74eef3bf938c491d8a2f5192ba598c19 Oct 04 20:37:04.305262 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-MigrationsAdminTest-1386345839 Oct 04 20:37:04.305262 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-MigrationsAdminTest-1386345839-project Oct 04 20:37:04.305262 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:04.305262 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:04.305262 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 4360a08eed56405b99333776285fef3a Oct 04 20:37:04.305262 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-MigrationsAdminTest-1386345839-project Oct 04 20:37:04.305262 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:37:04.305262 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance f5072682-0691-4542-a881-7f874a8d8ef3 could not be found. Oct 04 20:37:04.305262 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'f5072682-0691-4542-a881-7f874a8d8ef3'} Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5072682-0691-4542-a881-7f874a8d8ef3 could not be found. Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:04.306636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5072682-0691-4542-a881-7f874a8d8ef3 could not be found. Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5072682-0691-4542-a881-7f874a8d8ef3 could not be found. Oct 04 20:37:04.312411 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:04.316289 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4488acc5-e074-46bb-b70b-cff6def413d8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Returning 404 to user: Instance f5072682-0691-4542-a881-7f874a8d8ef3 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:04.317395 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4488acc5-e074-46bb-b70b-cff6def413d8 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3" status: 404 len: 111 microversion: 2.1 time: 0.232697 Oct 04 20:37:04.323835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6d77765f-2437-4aa1-88c5-c8c6119b5e6c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.323835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6d77765f-2437-4aa1-88c5-c8c6119b5e6c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.324876 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 433/861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:04 2022] GET /compute/v2.1/servers/f5072682-0691-4542-a881-7f874a8d8ef3 => generated 111 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:04.327533 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6d77765f-2437-4aa1-88c5-c8c6119b5e6c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.331700 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6d77765f-2437-4aa1-88c5-c8c6119b5e6c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.334411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6d77765f-2437-4aa1-88c5-c8c6119b5e6c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.335409 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dbfe6b68-dad2-49c3-b4a7-41108d88b5cd tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-214730236", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "096f784c-3ac1-48ba-8b74-20f8936c58f6"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:04.335936 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6d77765f-2437-4aa1-88c5-c8c6119b5e6c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.541229 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-dbfe6b68-dad2-49c3-b4a7-41108d88b5cd tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] validate_networks() for [('096f784c-3ac1-48ba-8b74-20f8936c58f6', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:04.752996 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6d77765f-2437-4aa1-88c5-c8c6119b5e6c tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb" status: 200 len: 329 microversion: 2.1 time: 0.784089 Oct 04 20:37:04.779007 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 429/862] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:37:03 2022] PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb => generated 329 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:04.793109 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-12acc8f6-6ece-4be1-93eb-7dc28514efe7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:04.794518 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-12acc8f6-6ece-4be1-93eb-7dc28514efe7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:04.843325 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-12acc8f6-6ece-4be1-93eb-7dc28514efe7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.844261 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-12acc8f6-6ece-4be1-93eb-7dc28514efe7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.845027 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-12acc8f6-6ece-4be1-93eb-7dc28514efe7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.855653 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-12acc8f6-6ece-4be1-93eb-7dc28514efe7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.857413 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-12acc8f6-6ece-4be1-93eb-7dc28514efe7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.858216 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-12acc8f6-6ece-4be1-93eb-7dc28514efe7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.976321 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-12acc8f6-6ece-4be1-93eb-7dc28514efe7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:37:05.667024 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-12acc8f6-6ece-4be1-93eb-7dc28514efe7 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 204 len: 0 microversion: 2.1 time: 0.885386 Oct 04 20:37:05.669827 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 430/863] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:37:04 2022] DELETE /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:37:05.694336 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8009d6ea-4dd2-4ddf-85fa-1bc9c02d4aaf tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Calling method '.version_select at 0x7f77ef028af0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-dbfe6b68-dad2-49c3-b4a7-41108d88b5cd tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a9b3162c-8f8f-4fe9-bc70-b447b18961b8) Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:06.075898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:06.078742 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:37:06.081090 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:37:06.083450 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a9b3162c-8f8f-4fe9-bc70-b447b18961b8) Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-dbfe6b68-dad2-49c3-b4a7-41108d88b5cd tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dbfe6b68-dad2-49c3-b4a7-41108d88b5cd tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] Request method failure captured: Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 209 Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJk5AbskNXJ6a0qH3XurNTeUItBzeVSXHxg1DACg49hdshJORZY1Qdaz9s1TIrG15K4IkOLEu8jtK4SrJHQN5qf6F7L5gaN5VcxZQN6R7hEUqifvc7_eLAx5CQls38GzZnvZETPPt0Q74W_W-pyojTJVZzgqC_DO06oDZYVv13TcxuE Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 0184f3fdbd854adf9751ab0ef77bdb2a Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-VolumesAdminNegativeTest-976428390 Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:06.085412 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:06.089990 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0184f3fdbd854adf9751ab0ef77bdb2a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0184f3fdbd854adf9751ab0ef77bdb2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0184f3fdbd854adf9751ab0ef77bdb2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0184f3fdbd854adf9751ab0ef77bdb2a"}]}] Oct 04 20:37:06.089990 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-VolumesAdminNegativeTest-976428390 Oct 04 20:37:06.089990 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 0184f3fdbd854adf9751ab0ef77bdb2a Oct 04 20:37:06.089990 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-976428390 Oct 04 20:37:06.089990 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-VolumesAdminNegativeTest-976428390-project Oct 04 20:37:06.089990 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:06.089990 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:06.089990 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 803f3ac2d73740ad9ab92cef252f07e6 Oct 04 20:37:06.089990 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-VolumesAdminNegativeTest-976428390-project Oct 04 20:37:06.089990 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:06.089990 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-214730236", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "096f784c-3ac1-48ba-8b74-20f8936c58f6"}]}} Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-VolumesAdminNegativeTest-server-214730236', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '096f784c-3ac1-48ba-8b74-20f8936c58f6'}]}}} Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:06.093124 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:06.097733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:37:06.104341 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:37:06.106681 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a9b3162c-8f8f-4fe9-bc70-b447b18961b8) Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:06.108758 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:06.111175 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:06.111175 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:06.111175 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:06.111175 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:06.111175 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:06.111175 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dbfe6b68-dad2-49c3-b4a7-41108d88b5cd tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:06.111175 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:06.111175 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-dbfe6b68-dad2-49c3-b4a7-41108d88b5cd tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.773966 Oct 04 20:37:06.125628 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 434/864] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:04 2022] POST /compute/v2.1/servers => generated 214 bytes in 1790 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:37:06.144395 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-becff055-5cd6-4bca-aca3-ff4056100cf2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.150247 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-becff055-5cd6-4bca-aca3-ff4056100cf2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:06.200415 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-becff055-5cd6-4bca-aca3-ff4056100cf2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.201327 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-becff055-5cd6-4bca-aca3-ff4056100cf2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.202166 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-becff055-5cd6-4bca-aca3-ff4056100cf2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.205280 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-becff055-5cd6-4bca-aca3-ff4056100cf2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.210013 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-becff055-5cd6-4bca-aca3-ff4056100cf2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.210860 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-becff055-5cd6-4bca-aca3-ff4056100cf2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.425736 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8009d6ea-4dd2-4ddf-85fa-1bc9c02d4aaf tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb" status: 200 len: 371 microversion: 2.1 time: 0.753245 Oct 04 20:37:06.439631 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 431/865] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:37:05 2022] GET /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb => generated 371 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:06.448511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9ec0eba3-907f-4329-9541-b6e4233e833d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.450847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9ec0eba3-907f-4329-9541-b6e4233e833d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:06.476113 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9ec0eba3-907f-4329-9541-b6e4233e833d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.478465 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9ec0eba3-907f-4329-9541-b6e4233e833d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.479684 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9ec0eba3-907f-4329-9541-b6e4233e833d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.481280 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9ec0eba3-907f-4329-9541-b6e4233e833d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.484677 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9ec0eba3-907f-4329-9541-b6e4233e833d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.492252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9ec0eba3-907f-4329-9541-b6e4233e833d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.386375 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-becff055-5cd6-4bca-aca3-ff4056100cf2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:07.406930 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-becff055-5cd6-4bca-aca3-ff4056100cf2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1316 microversion: 2.1 time: 1.278756 Oct 04 20:37:07.408897 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 435/866] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:06 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1316 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:07.441146 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9a627e39-f965-41a1-a77d-275421dd4c36 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] Calling method '.version_select at 0x7f77ef860c10>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:07.553254 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9ec0eba3-907f-4329-9541-b6e4233e833d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:07.574389 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9ec0eba3-907f-4329-9541-b6e4233e833d tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1468 microversion: 2.1 time: 1.132466 Oct 04 20:37:07.597792 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 432/867] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:06 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1468 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:07.611938 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9a627e39-f965-41a1-a77d-275421dd4c36 tempest-VolumesAdminNegativeTest-976428390 tempest-VolumesAdminNegativeTest-976428390-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-843262235" status: 202 len: 0 microversion: 2.1 time: 0.200083 Oct 04 20:37:07.615213 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a5c63177-ec8d-427c-87ed-449aa2effa65 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef07f670>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:07.615939 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 436/868] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 4 20:37:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-843262235 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:08.120255 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5c63177-ec8d-427c-87ed-449aa2effa65 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:08.122963 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5c63177-ec8d-427c-87ed-449aa2effa65 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:08.126863 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5c63177-ec8d-427c-87ed-449aa2effa65 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:08.131803 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5c63177-ec8d-427c-87ed-449aa2effa65 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:08.132623 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5c63177-ec8d-427c-87ed-449aa2effa65 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:08.133165 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5c63177-ec8d-427c-87ed-449aa2effa65 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:08.406429 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a5c63177-ec8d-427c-87ed-449aa2effa65 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb" status: 200 len: 325 microversion: 2.1 time: 0.806166 Oct 04 20:37:08.411251 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 433/869] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:37:07 2022] PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb => generated 325 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:08.469036 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-32f4868e-0f09-4c42-9790-c589167f2454 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:08.475511 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-32f4868e-0f09-4c42-9790-c589167f2454 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:08.522658 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-32f4868e-0f09-4c42-9790-c589167f2454 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:08.527797 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-32f4868e-0f09-4c42-9790-c589167f2454 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:08.530098 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-32f4868e-0f09-4c42-9790-c589167f2454 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:08.541244 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-32f4868e-0f09-4c42-9790-c589167f2454 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:08.544617 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-32f4868e-0f09-4c42-9790-c589167f2454 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:08.545694 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-32f4868e-0f09-4c42-9790-c589167f2454 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:08.620021 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-741020c9-347e-4572-8660-02c61f9333ab tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:08.622814 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-741020c9-347e-4572-8660-02c61f9333ab tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:08.676731 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:08.677574 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-741020c9-347e-4572-8660-02c61f9333ab tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:08.678706 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-741020c9-347e-4572-8660-02c61f9333ab tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:08.679848 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-741020c9-347e-4572-8660-02c61f9333ab tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:08.683154 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-741020c9-347e-4572-8660-02c61f9333ab tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:08.691593 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-741020c9-347e-4572-8660-02c61f9333ab tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:08.698179 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-741020c9-347e-4572-8660-02c61f9333ab tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:10.928721 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-741020c9-347e-4572-8660-02c61f9333ab tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:10.962093 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-741020c9-347e-4572-8660-02c61f9333ab tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1468 microversion: 2.1 time: 2.348962 Oct 04 20:37:10.982077 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 434/870] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:08 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1468 bytes in 2370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:11.002633 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-32f4868e-0f09-4c42-9790-c589167f2454 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:11.009002 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-876122609", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:11.034266 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-32f4868e-0f09-4c42-9790-c589167f2454 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1465 microversion: 2.1 time: 2.582679 Oct 04 20:37:11.036077 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 437/871] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:08 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1465 bytes in 2590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:11.178839 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:11.550683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-651c7698-ad2c-4646-a4a4-e4c75e89f4e0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Action: 'create', calling method: .version_select at 0x7f77ef82b9d0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC13fnPUGmkcMGlhBs72YiPXZ+bGqico7PCeTVclGtj8nXyuy4455XaBHzcBFReDpO/jiBFSqt4HZinxMP2XtEnl8+esZsFilgsGSJ+CG89HDtlxm2ReslenDXdEWsLsA=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-651c7698-ad2c-4646-a4a4-e4c75e89f4e0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Request method failure captured: Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 257 Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJl2ET_BRbR9vp3YD9N03WXTtROCR_ShrXzvF-TA_pSssT9Er7YgMeSKKnd-PraJORrbuJpQDUKzzpRw84VbktGqZx_q7aVpuTmBZxa-k4swpH8aleZgDA8cGRuBjbi4CDt9ccoImQhBk33twzLUvPVBib_Ge7B9zwD8oRnl7Upk2zI Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:11.583096 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:11.587458 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_36b7984e889d41e1a0c1b377eee8f8c8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/36b7984e889d41e1a0c1b377eee8f8c8"}]}] Oct 04 20:37:11.587458 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:11.587458 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:11.587458 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:11.587458 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:11.587458 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:11.587458 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:11.587458 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:11.587458 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:11.587458 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:11.587458 n-d-852085-12 devstack@n-api.service[123540]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC13fnPUGmkcMGlhBs72YiPXZ+bGqico7PCeTVclGtj8nXyuy4455XaBHzcBFReDpO/jiBFSqt4HZinxMP2XtEnl8+esZsFilgsGSJ+CG89HDtlxm2ReslenDXdEWsLsA=="}} Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC13fnPUGmkcMGlhBs72YiPXZ+bGqico7PCeTVclGtj8nXyuy4455XaBHzcBFReDpO/jiBFSqt4HZinxMP2XtEnl8+esZsFilgsGSJ+CG89HDtlxm2ReslenDXdEWsLsA=='}}} Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.588936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:11.592131 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:37:11.607585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:37:11.613031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 20:37:11.613031 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.613031 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-651c7698-ad2c-4646-a4a4-e4c75e89f4e0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:11.613031 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-651c7698-ad2c-4646-a4a4-e4c75e89f4e0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.550824 Oct 04 20:37:11.613031 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 438/872] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:11 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 556 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:37:11.613031 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-11fbe868-7828-45c7-bb9a-acb1ffb680a6 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:11.614365 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-11fbe868-7828-45c7-bb9a-acb1ffb680a6 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:11.646247 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-11fbe868-7828-45c7-bb9a-acb1ffb680a6 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:11.647209 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-11fbe868-7828-45c7-bb9a-acb1ffb680a6 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:11.650336 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-11fbe868-7828-45c7-bb9a-acb1ffb680a6 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:11.651766 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-11fbe868-7828-45c7-bb9a-acb1ffb680a6 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:11.652176 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-11fbe868-7828-45c7-bb9a-acb1ffb680a6 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:11.653417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-11fbe868-7828-45c7-bb9a-acb1ffb680a6 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:12.584402 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=8 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:12.723624 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=34 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:13.820227 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:13.821309 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:13.823085 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:13.827851 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:13.836200 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:13.860944 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:13.876541 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:13.877970 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:13.880543 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:13.881540 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:13.889287 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:13.975474 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Getting quotas for project bbc9b2da40434437a6ce05b82deadbdb. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:13.994955 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Getting quotas for user 0bbad3c441544962b1397f90d80b6153 and project bbc9b2da40434437a6ce05b82deadbdb. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:14.039548 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.utils [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] ram quota exceeded for bbc9b2da40434437a6ce05b82deadbdb, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123539) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 20:37:14.041268 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Request method failure captured: Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 144 Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJleVcrO_p08CSyRgl4NHMW1f_Sbdjng6ES_Uyxevg-WmdsBGAV4-oVsr__g-1pYtcjSVvpoEAMktsZ_t7FC72ted2CM_-hRz_XhiZLUK6UWOK54OzXebVLHVkyOptvgc_5GwLcwdjTpCWvUxx01TrtLfrgocrqlyCdZn2vhMlKQLCc Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: bbc9b2da40434437a6ce05b82deadbdb Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-QuotasAdminNegativeTest-144984851 Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:37:14.057222 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:37:14.060095 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bbc9b2da40434437a6ce05b82deadbdb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bbc9b2da40434437a6ce05b82deadbdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bbc9b2da40434437a6ce05b82deadbdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bbc9b2da40434437a6ce05b82deadbdb"}]}] Oct 04 20:37:14.060095 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-QuotasAdminNegativeTest-144984851 Oct 04 20:37:14.060095 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: bbc9b2da40434437a6ce05b82deadbdb Oct 04 20:37:14.060095 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-144984851 Oct 04 20:37:14.060095 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-QuotasAdminNegativeTest-144984851-project Oct 04 20:37:14.060095 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:37:14.060095 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:37:14.060095 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 0bbad3c441544962b1397f90d80b6153 Oct 04 20:37:14.060095 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-QuotasAdminNegativeTest-144984851-project Oct 04 20:37:14.060095 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:14.060095 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-876122609", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} Oct 04 20:37:14.060095 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-876122609', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452'}}} Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 20:37:14.061428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:14.063776 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.066200 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:14.081813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:14.081813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:14.081813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:14.081813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:14.081813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:37:14.081813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.081813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:14.081813 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f3fd94df-05be-44d3-9006-55c8af94a149 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 3.070456 Oct 04 20:37:14.081813 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 435/873] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:10 2022] POST /compute/v2.1/servers => generated 110 bytes in 3084 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:14.083011 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-911283fc-8f05-4d04-bf93-f6bbe4ceda3d tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Action: 'create', calling method: .version_select at 0x7f77eeff8820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1268123400", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:14.112103 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-11fbe868-7828-45c7-bb9a-acb1ffb680a6 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1618 microversion: 2.1 time: 2.517754 Oct 04 20:37:14.113450 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 439/874] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:11 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1618 bytes in 2520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:14.120249 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-911283fc-8f05-4d04-bf93-f6bbe4ceda3d tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Getting quotas for project 36b7984e889d41e1a0c1b377eee8f8c8. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:14.137555 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8955fc11-36c1-4881-aa25-a9c4fe398d4b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:14.140295 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-911283fc-8f05-4d04-bf93-f6bbe4ceda3d tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Getting quotas for user ae75884a70da45e582cee8258d1f2a7a and project 36b7984e889d41e1a0c1b377eee8f8c8. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:14.142053 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8955fc11-36c1-4881-aa25-a9c4fe398d4b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:14.168094 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8955fc11-36c1-4881-aa25-a9c4fe398d4b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.177017 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8955fc11-36c1-4881-aa25-a9c4fe398d4b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.177809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8955fc11-36c1-4881-aa25-a9c4fe398d4b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:14.178976 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8955fc11-36c1-4881-aa25-a9c4fe398d4b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.179815 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8955fc11-36c1-4881-aa25-a9c4fe398d4b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.180622 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8955fc11-36c1-4881-aa25-a9c4fe398d4b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:14.228388 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-911283fc-8f05-4d04-bf93-f6bbe4ceda3d tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-911283fc-8f05-4d04-bf93-f6bbe4ceda3d tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Request method failure captured: Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 2167 Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJl2ET_BRbR9vp3YD9N03WXTtROCR_ShrXzvF-TA_pSssT9Er7YgMeSKKnd-PraJORrbuJpQDUKzzpRw84VbktGqZx_q7aVpuTmBZxa-k4swpH8aleZgDA8cGRuBjbi4CDt9ccoImQhBk33twzLUvPVBib_Ge7B9zwD8oRnl7Upk2zI Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_36b7984e889d41e1a0c1b377eee8f8c8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/36b7984e889d41e1a0c1b377eee8f8c8"}]}] Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1268123400", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:37:14.251628 n-d-852085-12 devstack@n-api.service[123539]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1268123400', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:14.260813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:14.267261 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-911283fc-8f05-4d04-bf93-f6bbe4ceda3d tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:14.275185 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-911283fc-8f05-4d04-bf93-f6bbe4ceda3d tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.187063 Oct 04 20:37:14.277124 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 436/875] 10.222.0.78 () {60 vars in 1160 bytes} [Tue Oct 4 20:37:14 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:14.510580 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f34675cf-4c5c-431d-b564-3181a76c8665 tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] Action: 'create', calling method: .version_select at 0x7f77eef41280>, body: {"pool": null} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:14.518483 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8955fc11-36c1-4881-aa25-a9c4fe398d4b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4360a08eed56405b99333776285fef3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eef3bf938c491d8a2f5192ba598c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:14.546527 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8955fc11-36c1-4881-aa25-a9c4fe398d4b tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 200 len: 1297 microversion: 2.1 time: 0.430570 Oct 04 20:37:14.549116 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 440/876] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:14 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 1297 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:14.563421 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-a97b080a-b468-490c-a536-fdb6b2b3b127 req-2dc031b0-6c2d-4994-9b52-2865aa0be7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb3a6b7-921f-41d4-a55e-0686a4dc7189", "name": "network-vif-deleted", "tag": "26cc88b4-8d45-445d-8a36-b340685405f4"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:14.627538 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-a97b080a-b468-490c-a536-fdb6b2b3b127 req-2dc031b0-6c2d-4994-9b52-2865aa0be7e0 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.629339 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-a97b080a-b468-490c-a536-fdb6b2b3b127 req-2dc031b0-6c2d-4994-9b52-2865aa0be7e0 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.630755 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-a97b080a-b468-490c-a536-fdb6b2b3b127 req-2dc031b0-6c2d-4994-9b52-2865aa0be7e0 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:14.664562 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-a97b080a-b468-490c-a536-fdb6b2b3b127 req-2dc031b0-6c2d-4994-9b52-2865aa0be7e0 service nova] Creating event network-vif-deleted:26cc88b4-8d45-445d-8a36-b340685405f4 for instance bdb3a6b7-921f-41d4-a55e-0686a4dc7189 on n-h1-852085-12 Oct 04 20:37:14.683121 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-a97b080a-b468-490c-a536-fdb6b2b3b127 req-2dc031b0-6c2d-4994-9b52-2865aa0be7e0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131061 Oct 04 20:37:14.693381 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 441/877] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:14.709357 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a403e06a-c6c0-406b-bb0f-f63220fe1cbc tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Action: 'update', calling method: .version_select at 0x7f77efa988b0>, body: {"quota_set": {"ram": 51200}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:15.133335 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a403e06a-c6c0-406b-bb0f-f63220fe1cbc tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.134732 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a403e06a-c6c0-406b-bb0f-f63220fe1cbc tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.135675 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a403e06a-c6c0-406b-bb0f-f63220fe1cbc tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.140868 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a403e06a-c6c0-406b-bb0f-f63220fe1cbc tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.141615 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a403e06a-c6c0-406b-bb0f-f63220fe1cbc tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.147460 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a403e06a-c6c0-406b-bb0f-f63220fe1cbc tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.604820 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a403e06a-c6c0-406b-bb0f-f63220fe1cbc tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb" status: 200 len: 329 microversion: 2.1 time: 0.897974 Oct 04 20:37:15.606027 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 442/878] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:37:14 2022] PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb => generated 329 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:15.630474 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5a2adb10-16c9-4660-ab62-578435784288 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Action: 'create', calling method: .version_select at 0x7f77ef609040>, body: {"keypair": {"name": "tempest-keypair-444909326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLhLVFirq7rwuASxpLZj+wdCSJjGsnQhdUSB38g9sEcZuUL/zSAKBNIpx0lmNa+4WN4Zp0c1M6pyhj3RgpqOxH5Fa9aFfL04RPi7BcuEZA8H3kqVTDhcqadCNhYOlctPg=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:15.738675 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-5a2adb10-16c9-4660-ab62-578435784288 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Getting quotas for project 36b7984e889d41e1a0c1b377eee8f8c8. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:15.762793 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-5a2adb10-16c9-4660-ab62-578435784288 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Getting quotas for user ae75884a70da45e582cee8258d1f2a7a and project 36b7984e889d41e1a0c1b377eee8f8c8. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:15.970927 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5a2adb10-16c9-4660-ab62-578435784288 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.363268 Oct 04 20:37:15.981575 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 443/879] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:15.992707 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-730132350", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["50c29121-e094-4132-8ef4-b4c28da9df8a"]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:16.113488 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:18.212452 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:18.214587 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:18.216151 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:18.217270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:18.219901 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:18.275849 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:18.281628 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:18.283867 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:18.289551 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:18.293004 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:18.294065 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:18.399490 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:18.420963 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:18.461530 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Going to run 1 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:37:18.466875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:37:18.731378 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-87629a00-ad8a-4b8c-b6f6-28ddf1304399 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.744814 Oct 04 20:37:18.732551 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 444/880] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:37:18.896028 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0c03886a-6624-442b-864f-e8fd236f5296 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77ef681940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1439164459", "description": "tempest-description-1680170876"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:21.181730 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0c03886a-6624-442b-864f-e8fd236f5296 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 2.446772 Oct 04 20:37:21.196465 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 445/881] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:37:18 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:21.221727 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ce1f93fe-a6dd-46ea-9e5d-22c9cb9ba3e6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:21.223044 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ce1f93fe-a6dd-46ea-9e5d-22c9cb9ba3e6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] [instance: bdb3a6b7-921f-41d4-a55e-0686a4dc7189] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:21.245566 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ce1f93fe-a6dd-46ea-9e5d-22c9cb9ba3e6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.251704 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ce1f93fe-a6dd-46ea-9e5d-22c9cb9ba3e6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.254023 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ce1f93fe-a6dd-46ea-9e5d-22c9cb9ba3e6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.269758 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ce1f93fe-a6dd-46ea-9e5d-22c9cb9ba3e6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.271008 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ce1f93fe-a6dd-46ea-9e5d-22c9cb9ba3e6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.272061 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ce1f93fe-a6dd-46ea-9e5d-22c9cb9ba3e6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.345042 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-ce1f93fe-a6dd-46ea-9e5d-22c9cb9ba3e6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] HTTP exception thrown: Instance bdb3a6b7-921f-41d4-a55e-0686a4dc7189 could not be found. Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ce1f93fe-a6dd-46ea-9e5d-22c9cb9ba3e6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Request method failure captured: Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 HTTP/1.1 Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJiNhV16z4nc9-dvgN1oYsetPABmQ80TjNNMdhys6K47SL84YUPJDpCiDufhH6v6wucCeWAWpWRlL3sBxgSgOzZxFtoEU5iSlSP7PSv8nRhInko8xxLPpv2dozhhyMkCcqR6fHIamFhrC5KfY_KiAl6N23PBq4pT47eDAlx7uY-2aSk Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 74eef3bf938c491d8a2f5192ba598c19 Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-MigrationsAdminTest-1386345839 Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74eef3bf938c491d8a2f5192ba598c19", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74eef3bf938c491d8a2f5192ba598c19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74eef3bf938c491d8a2f5192ba598c19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74eef3bf938c491d8a2f5192ba598c19"}]}] Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-MigrationsAdminTest-1386345839 Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 74eef3bf938c491d8a2f5192ba598c19 Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-MigrationsAdminTest-1386345839 Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-MigrationsAdminTest-1386345839-project Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 4360a08eed56405b99333776285fef3a Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-MigrationsAdminTest-1386345839-project Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance bdb3a6b7-921f-41d4-a55e-0686a4dc7189 could not be found. Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'bdb3a6b7-921f-41d4-a55e-0686a4dc7189'} Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb3a6b7-921f-41d4-a55e-0686a4dc7189 could not be found. Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb3a6b7-921f-41d4-a55e-0686a4dc7189 could not be found. Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:21.359017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:21.368618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:21.368618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:21.368618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:21.368618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:21.368618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:21.368618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb3a6b7-921f-41d4-a55e-0686a4dc7189 could not be found. Oct 04 20:37:21.368618 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:21.368618 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ce1f93fe-a6dd-46ea-9e5d-22c9cb9ba3e6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] Returning 404 to user: Instance bdb3a6b7-921f-41d4-a55e-0686a4dc7189 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:21.372923 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ce1f93fe-a6dd-46ea-9e5d-22c9cb9ba3e6 tempest-MigrationsAdminTest-1386345839 tempest-MigrationsAdminTest-1386345839-project] 10.222.0.78 "GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189" status: 404 len: 111 microversion: 2.1 time: 0.167317 Oct 04 20:37:21.393213 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 446/882] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:21 2022] GET /compute/v2.1/servers/bdb3a6b7-921f-41d4-a55e-0686a4dc7189 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:21.439723 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f9337055-eef8-4608-975c-55574f3f2773 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Action: 'update', calling method: .version_select at 0x7f77ef681280>, body: {"quota_set": {"ram": 0}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:21.485206 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f9337055-eef8-4608-975c-55574f3f2773 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '0bbad3c441544962b1397f90d80b6153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc9b2da40434437a6ce05b82deadbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f9337055-eef8-4608-975c-55574f3f2773 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Request method failure captured: Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: request: PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb HTTP/1.1 Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 25 Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJleVcrO_p08CSyRgl4NHMW1f_Sbdjng6ES_Uyxevg-WmdsBGAV4-oVsr__g-1pYtcjSVvpoEAMktsZ_t7FC72ted2CM_-hRz_XhiZLUK6UWOK54OzXebVLHVkyOptvgc_5GwLcwdjTpCWvUxx01TrtLfrgocrqlyCdZn2vhMlKQLCc Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: bbc9b2da40434437a6ce05b82deadbdb Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-QuotasAdminNegativeTest-144984851 Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bbc9b2da40434437a6ce05b82deadbdb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bbc9b2da40434437a6ce05b82deadbdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bbc9b2da40434437a6ce05b82deadbdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bbc9b2da40434437a6ce05b82deadbdb"}]}] Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-QuotasAdminNegativeTest-144984851 Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: bbc9b2da40434437a6ce05b82deadbdb Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-144984851 Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-QuotasAdminNegativeTest-144984851-project Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 0bbad3c441544962b1397f90d80b6153 Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-QuotasAdminNegativeTest-144984851-project Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: {"quota_set": {"ram": 0}} Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'bbc9b2da40434437a6ce05b82deadbdb', 'body': {'quota_set': {'ram': 0}}} Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:37:21.496526 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 20:37:21.507005 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:21.536673 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f9337055-eef8-4608-975c-55574f3f2773 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:21.540236 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f9337055-eef8-4608-975c-55574f3f2773 tempest-QuotasAdminNegativeTest-144984851 tempest-QuotasAdminNegativeTest-144984851-project] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb" status: 403 len: 116 microversion: 2.1 time: 0.144490 Oct 04 20:37:21.559793 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 447/883] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:37:21 2022] PUT /compute/v2.1/os-quota-sets/bbc9b2da40434437a6ce05b82deadbdb => generated 116 bytes in 161 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:21.642407 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0aeaa975-d520-40f4-877a-59393a3980e0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Action: 'create', calling method: .version_select at 0x7f77ef9de040>, body: {"keypair": {"name": "tempest-keypair-444909326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgP6ePqwV3F8w3HAd+zpEzL/+R9UHfIsmtKLxIVaqs1K700JC+KnYnDmXWcDpDWauZPzib2Qkf3Mjt6Xqg03pGnrpKNYIKH4XURKBNDc5ym5aaBJbCcpuxTMQbxbpbsyQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:21.778679 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-0aeaa975-d520-40f4-877a-59393a3980e0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Getting quotas for project 36b7984e889d41e1a0c1b377eee8f8c8. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:21.812050 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-0aeaa975-d520-40f4-877a-59393a3980e0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Getting quotas for user ae75884a70da45e582cee8258d1f2a7a and project 36b7984e889d41e1a0c1b377eee8f8c8. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:22.026060 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-0aeaa975-d520-40f4-877a-59393a3980e0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] HTTP exception thrown: Key pair 'tempest-keypair-444909326' already exists. Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0aeaa975-d520-40f4-877a-59393a3980e0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Request method failure captured: Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 272 Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJl2ET_BRbR9vp3YD9N03WXTtROCR_ShrXzvF-TA_pSssT9Er7YgMeSKKnd-PraJORrbuJpQDUKzzpRw84VbktGqZx_q7aVpuTmBZxa-k4swpH8aleZgDA8cGRuBjbi4CDt9ccoImQhBk33twzLUvPVBib_Ge7B9zwD8oRnl7Upk2zI Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_36b7984e889d41e1a0c1b377eee8f8c8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/36b7984e889d41e1a0c1b377eee8f8c8"}]}] Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: {"keypair": {"name": "tempest-keypair-444909326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgP6ePqwV3F8w3HAd+zpEzL/+R9UHfIsmtKLxIVaqs1K700JC+KnYnDmXWcDpDWauZPzib2Qkf3Mjt6Xqg03pGnrpKNYIKH4XURKBNDc5ym5aaBJbCcpuxTMQbxbpbsyQ=="}} Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: exception: Key pair 'tempest-keypair-444909326' already exists. Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-444909326', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgP6ePqwV3F8w3HAd+zpEzL/+R9UHfIsmtKLxIVaqs1K700JC+KnYnDmXWcDpDWauZPzib2Qkf3Mjt6Xqg03pGnrpKNYIKH4XURKBNDc5ym5aaBJbCcpuxTMQbxbpbsyQ=='}}} Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'ae75884a70da45e582cee8258d1f2a7a-tempest-keypair-444909326' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 20:37:22.080902 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:37:22.089580 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'ae75884a70da45e582cee8258d1f2a7a-tempest-keypair-444909326' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 20, 37, 21, 887816), 'updated_at': None, 'name': 'tempest-keypair-444909326', 'user_id': 'ae75884a70da45e582cee8258d1f2a7a', 'fingerprint': '99:be:18:71:00:20:14:87:fa:aa:86:35:4c:03:54:19', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgP6ePqwV3F8w3HAd+zpEzL/+R9UHfIsmtKLxIVaqs1K700JC+KnYnDmXWcDpDWauZPzib2Qkf3Mjt6Xqg03pGnrpKNYIKH4XURKBNDc5ym5aaBJbCcpuxTMQbxbpbsyQ==', 'type': 'ssh'}] Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keypair.create() Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._create() Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-444909326' already exists. Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 04 20:37:22.100667 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-444909326' already exists. Oct 04 20:37:22.116051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:22.116051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:22.116051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:22.116051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:22.116051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:22.116051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:22.116051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:22.116051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:22.116051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-444909326' already exists. Oct 04 20:37:22.116051 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:22.116051 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0aeaa975-d520-40f4-877a-59393a3980e0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Returning 409 to user: Key pair 'tempest-keypair-444909326' already exists. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:22.116051 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0aeaa975-d520-40f4-877a-59393a3980e0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.546833 Oct 04 20:37:22.118509 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 448/884] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:21 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 554 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:37:22.162426 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-16dcab6f-0ac6-47b0-9dc6-30fbc710b7dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:22.178586 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-16dcab6f-0ac6-47b0-9dc6-30fbc710b7dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:22.209897 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-16dcab6f-0ac6-47b0-9dc6-30fbc710b7dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:22.213545 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-16dcab6f-0ac6-47b0-9dc6-30fbc710b7dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:22.221883 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-16dcab6f-0ac6-47b0-9dc6-30fbc710b7dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:22.226675 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-16dcab6f-0ac6-47b0-9dc6-30fbc710b7dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:22.232194 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-16dcab6f-0ac6-47b0-9dc6-30fbc710b7dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:22.236575 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-16dcab6f-0ac6-47b0-9dc6-30fbc710b7dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:22.767246 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-16dcab6f-0ac6-47b0-9dc6-30fbc710b7dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:22.841642 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-16dcab6f-0ac6-47b0-9dc6-30fbc710b7dc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1212 microversion: 2.1 time: 0.715632 Oct 04 20:37:22.844082 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 449/885] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:22 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1212 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:22.886448 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7598ffac-d962-498d-8437-033c00d371fe tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77ef6815e0>, body: {"security_group_rule": {"parent_group_id": "5915da87-e704-42fd-afe1-555220d3602e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:23.663856 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f34675cf-4c5c-431d-b564-3181a76c8665 tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 9.383154 Oct 04 20:37:23.666311 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 437/886] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 4 20:37:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 9387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:23.693880 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fd096621-c0c8-4c51-b3e0-4b3e5e381ee0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Calling method '.version_select at 0x7f77eef5e700>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:23.749636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:23.917936 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=8 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:23.931332 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:23.966963 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fd096621-c0c8-4c51-b3e0-4b3e5e381ee0 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-444909326" status: 202 len: 0 microversion: 2.1 time: 0.293548 Oct 04 20:37:23.983500 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 438/887] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 4 20:37:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-444909326 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:23.995107 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7253f55c-bb4c-4589-92c8-36e342257f9b tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] Action: 'create', calling method: .version_select at 0x7f77eef621f0>, body: {"pool": null} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:24.182830 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=38 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:24.658083 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7598ffac-d962-498d-8437-033c00d371fe tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.809324 Oct 04 20:37:24.661433 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 450/888] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:37:22 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:24.695120 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b3268031-8660-4c22-b413-769b9a20b866 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:24.707765 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b3268031-8660-4c22-b413-769b9a20b866 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:24.740847 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3268031-8660-4c22-b413-769b9a20b866 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.742894 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3268031-8660-4c22-b413-769b9a20b866 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.746030 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3268031-8660-4c22-b413-769b9a20b866 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:24.753504 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3268031-8660-4c22-b413-769b9a20b866 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.755182 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3268031-8660-4c22-b413-769b9a20b866 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.762923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3268031-8660-4c22-b413-769b9a20b866 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.296161 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b3268031-8660-4c22-b413-769b9a20b866 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:25.328656 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b3268031-8660-4c22-b413-769b9a20b866 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1286 microversion: 2.1 time: 0.662169 Oct 04 20:37:25.400918 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 451/889] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:24 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1286 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:25.451016 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b4fe6d8b-6de2-46da-8555-291212dda1c9 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Action: 'create', calling method: .version_select at 0x7f77ef9de670>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/6CwoQ2IjRTBUbqvRnoRXYUCJZAGLOxd8ibQVfq1QfxnXDq6UEdku6/UwVxglhz+XcprlMtf9UWWq1/FvTq8s84S/qwc1wmVTtRYoKCCfs8RY5WeKKdy2x5Zts52Dqw=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b4fe6d8b-6de2-46da-8555-291212dda1c9 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Request method failure captured: Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 247 Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJl2ET_BRbR9vp3YD9N03WXTtROCR_ShrXzvF-TA_pSssT9Er7YgMeSKKnd-PraJORrbuJpQDUKzzpRw84VbktGqZx_q7aVpuTmBZxa-k4swpH8aleZgDA8cGRuBjbi4CDt9ccoImQhBk33twzLUvPVBib_Ge7B9zwD8oRnl7Upk2zI Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_36b7984e889d41e1a0c1b377eee8f8c8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/36b7984e889d41e1a0c1b377eee8f8c8"}]}] Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/6CwoQ2IjRTBUbqvRnoRXYUCJZAGLOxd8ibQVfq1QfxnXDq6UEdku6/UwVxglhz+XcprlMtf9UWWq1/FvTq8s84S/qwc1wmVTtRYoKCCfs8RY5WeKKdy2x5Zts52Dqw=="}} Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/6CwoQ2IjRTBUbqvRnoRXYUCJZAGLOxd8ibQVfq1QfxnXDq6UEdku6/UwVxglhz+XcprlMtf9UWWq1/FvTq8s84S/qwc1wmVTtRYoKCCfs8RY5WeKKdy2x5Zts52Dqw=='}}} Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi '' Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:37:25.481796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:37:25.490285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:25.502821 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b4fe6d8b-6de2-46da-8555-291212dda1c9 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:25.506824 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b4fe6d8b-6de2-46da-8555-291212dda1c9 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.103106 Oct 04 20:37:25.514077 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 452/890] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:25 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:37:25.533460 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c50a1cf6-542b-4e74-9b15-e40b7cf6ef82 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77ef2c18b0>, body: {"security_group_rule": {"parent_group_id": "5915da87-e704-42fd-afe1-555220d3602e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:26.080198 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-c50a1cf6-542b-4e74-9b15-e40b7cf6ef82 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] HTTP exception thrown: This rule already exists in group 5915da87-e704-42fd-afe1-555220d3602e Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c50a1cf6-542b-4e74-9b15-e40b7cf6ef82 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Request method failure captured: Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 138 Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJl7_07fRkY3f_ArxwmuIeTiFnCJAMHIeByPElhKeQw9VJ9Q2SIs87lOgLJasq4LHurSLxVbXOh2cYL3DQaa_3s0sf9Y7wU2RBEbUIjQD_QtInit937tee-D19UiMb7-UNVQJwjS4P9d3swUHU4rxHj3MDsUShVsVyPeleWQ6dnDcSc Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_83f4d8accaf7424cb88d1327e40a1e9e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/83f4d8accaf7424cb88d1327e40a1e9e"}]}] Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 434cd2fc0e8144b1ab676a4bf7605339 Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: {"security_group_rule": {"parent_group_id": "5915da87-e704-42fd-afe1-555220d3602e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: exception: This rule already exists in group 5915da87-e704-42fd-afe1-555220d3602e Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5915da87-e704-42fd-afe1-555220d3602e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 5915da87-e704-42fd-afe1-555220d3602e Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 5915da87-e704-42fd-afe1-555220d3602e Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:26.087975 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:26.101202 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:26.101202 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:26.101202 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 5915da87-e704-42fd-afe1-555220d3602e Oct 04 20:37:26.101202 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.105897 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c50a1cf6-542b-4e74-9b15-e40b7cf6ef82 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Returning 400 to user: This rule already exists in group 5915da87-e704-42fd-afe1-555220d3602e {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:26.108188 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c50a1cf6-542b-4e74-9b15-e40b7cf6ef82 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.591358 Oct 04 20:37:26.118192 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 453/891] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:37:25 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 602 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:37:26.131695 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6bedda7f-0c07-4dd7-b8d2-fffe3a643e33 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Action: 'create', calling method: .version_select at 0x7f77ef9d4a60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1289483066", "public_key": " "}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:26.217463 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-6bedda7f-0c07-4dd7-b8d2-fffe3a643e33 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Getting quotas for project 36b7984e889d41e1a0c1b377eee8f8c8. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:26.233901 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-6bedda7f-0c07-4dd7-b8d2-fffe3a643e33 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Getting quotas for user ae75884a70da45e582cee8258d1f2a7a and project 36b7984e889d41e1a0c1b377eee8f8c8. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:26.340824 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-6bedda7f-0c07-4dd7-b8d2-fffe3a643e33 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6bedda7f-0c07-4dd7-b8d2-fffe3a643e33 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Request method failure captured: Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 95 Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJl2ET_BRbR9vp3YD9N03WXTtROCR_ShrXzvF-TA_pSssT9Er7YgMeSKKnd-PraJORrbuJpQDUKzzpRw84VbktGqZx_q7aVpuTmBZxa-k4swpH8aleZgDA8cGRuBjbi4CDt9ccoImQhBk33twzLUvPVBib_Ge7B9zwD8oRnl7Upk2zI Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_36b7984e889d41e1a0c1b377eee8f8c8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/36b7984e889d41e1a0c1b377eee8f8c8"}]}] Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1289483066", "public_key": " "}} Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1289483066', 'public_key': ' '}}} Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:26.358227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6bedda7f-0c07-4dd7-b8d2-fffe3a643e33 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:26.373478 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6bedda7f-0c07-4dd7-b8d2-fffe3a643e33 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.248119 Oct 04 20:37:26.378848 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 454/892] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Oct 4 20:37:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:26.409700 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9137d8cf-9e96-4964-9e01-1dee6cd40c52 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Calling method '.version_select at 0x7f77ef2d65e0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:27.794652 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9137d8cf-9e96-4964-9e01-1dee6cd40c52 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/7d067921-6d77-4fd0-9260-1d0b645a6bd3" status: 202 len: 0 microversion: 2.1 time: 1.411596 Oct 04 20:37:27.802589 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 455/893] 10.222.0.78 () {58 vars in 1287 bytes} [Tue Oct 4 20:37:26 2022] DELETE /compute/v2.1/os-security-group-rules/7d067921-6d77-4fd0-9260-1d0b645a6bd3 => generated 0 bytes in 1419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:27.836823 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a173da4a-db8c-4129-92f7-796ff41f91cd tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Action: 'create', calling method: .version_select at 0x7f77ef2d6ee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5bJ82iBkfidb4RLU1yYV8E4lXpZU8/5hiKzLkQeeFvG2yxojVRCgc0FIp8AW52Le2YPQimgN6HiouyM2gABsimG1dY7SULYD2w1SxMjomGLCQjang8iPc716J5W6003A=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a173da4a-db8c-4129-92f7-796ff41f91cd tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Request method failure captured: Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 507 Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJl2ET_BRbR9vp3YD9N03WXTtROCR_ShrXzvF-TA_pSssT9Er7YgMeSKKnd-PraJORrbuJpQDUKzzpRw84VbktGqZx_q7aVpuTmBZxa-k4swpH8aleZgDA8cGRuBjbi4CDt9ccoImQhBk33twzLUvPVBib_Ge7B9zwD8oRnl7Upk2zI Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_36b7984e889d41e1a0c1b377eee8f8c8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/36b7984e889d41e1a0c1b377eee8f8c8"}]}] Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5bJ82iBkfidb4RLU1yYV8E4lXpZU8/5hiKzLkQeeFvG2yxojVRCgc0FIp8AW52Le2YPQimgN6HiouyM2gABsimG1dY7SULYD2w1SxMjomGLCQjang8iPc716J5W6003A=="}} Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5bJ82iBkfidb4RLU1yYV8E4lXpZU8/5hiKzLkQeeFvG2yxojVRCgc0FIp8AW52Le2YPQimgN6HiouyM2gABsimG1dY7SULYD2w1SxMjomGLCQjang8iPc716J5W6003A=='}}} Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 20:37:27.867507 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a173da4a-db8c-4129-92f7-796ff41f91cd tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:27.874366 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a173da4a-db8c-4129-92f7-796ff41f91cd tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.065701 Oct 04 20:37:27.882426 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 456/894] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:27 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:37:27.903046 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e0455ff1-79cc-405c-8889-df52b77973a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:27.915848 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e0455ff1-79cc-405c-8889-df52b77973a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:27.975528 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:27.984047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e0455ff1-79cc-405c-8889-df52b77973a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:27.985723 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e0455ff1-79cc-405c-8889-df52b77973a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:27.986923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e0455ff1-79cc-405c-8889-df52b77973a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:28.000756 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e0455ff1-79cc-405c-8889-df52b77973a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:28.001826 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e0455ff1-79cc-405c-8889-df52b77973a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:28.002630 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e0455ff1-79cc-405c-8889-df52b77973a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:28.341458 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:28.381738 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e0455ff1-79cc-405c-8889-df52b77973a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.405889 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e0455ff1-79cc-405c-8889-df52b77973a0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1274 microversion: 2.1 time: 0.521601 Oct 04 20:37:28.407312 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 457/895] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:27 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1274 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:28.446833 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7fd24edc-496f-4c61-8989-3ce3621dd4e4 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77efa53f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-322015760", "description": "tempest-description-1409604232"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:30.866533 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7fd24edc-496f-4c61-8989-3ce3621dd4e4 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.436179 Oct 04 20:37:30.869365 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 458/896] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:37:28 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:30.898128 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3c8f97e7-cf8d-4958-a8fd-489dbd7b535b tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Action: 'create', calling method: .version_select at 0x7f77ef681430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-124806459", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:30.961455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-3c8f97e7-cf8d-4958-a8fd-489dbd7b535b tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Getting quotas for project 36b7984e889d41e1a0c1b377eee8f8c8. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:30.978006 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-3c8f97e7-cf8d-4958-a8fd-489dbd7b535b tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Getting quotas for user ae75884a70da45e582cee8258d1f2a7a and project 36b7984e889d41e1a0c1b377eee8f8c8. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:31.057931 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-3c8f97e7-cf8d-4958-a8fd-489dbd7b535b tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3c8f97e7-cf8d-4958-a8fd-489dbd7b535b tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Request method failure captured: Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 117 Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJl2ET_BRbR9vp3YD9N03WXTtROCR_ShrXzvF-TA_pSssT9Er7YgMeSKKnd-PraJORrbuJpQDUKzzpRw84VbktGqZx_q7aVpuTmBZxa-k4swpH8aleZgDA8cGRuBjbi4CDt9ccoImQhBk33twzLUvPVBib_Ge7B9zwD8oRnl7Upk2zI Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_36b7984e889d41e1a0c1b377eee8f8c8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/36b7984e889d41e1a0c1b377eee8f8c8"}]}] Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-124806459", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-124806459', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 20:37:31.093587 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:31.102217 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:31.122891 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3c8f97e7-cf8d-4958-a8fd-489dbd7b535b tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:31.126153 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3c8f97e7-cf8d-4958-a8fd-489dbd7b535b tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.240218 Oct 04 20:37:31.138226 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 459/897] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:30 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:31.163856 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e705040c-792c-4f38-a615-44a3de8c6eef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:31.168794 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e705040c-792c-4f38-a615-44a3de8c6eef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:31.224875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e705040c-792c-4f38-a615-44a3de8c6eef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:31.232206 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e705040c-792c-4f38-a615-44a3de8c6eef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:31.238004 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e705040c-792c-4f38-a615-44a3de8c6eef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:31.248016 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e705040c-792c-4f38-a615-44a3de8c6eef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:31.273751 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e705040c-792c-4f38-a615-44a3de8c6eef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:31.285154 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e705040c-792c-4f38-a615-44a3de8c6eef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.347129 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e705040c-792c-4f38-a615-44a3de8c6eef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:32.387894 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e705040c-792c-4f38-a615-44a3de8c6eef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1316 microversion: 2.1 time: 1.244320 Oct 04 20:37:32.393944 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 460/898] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:31 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1316 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:33.302040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-555944bc-422c-4a5a-b1d9-b57178c83fee tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1427672692", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "f83df98d-561c-48da-846a-6d99e02fce9a"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:33.486265 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-555944bc-422c-4a5a-b1d9-b57178c83fee tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] validate_networks() for [('f83df98d-561c-48da-846a-6d99e02fce9a', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:34.290955 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7253f55c-bb4c-4589-92c8-36e342257f9b tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 10.304934 Oct 04 20:37:34.298042 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 439/899] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 4 20:37:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 10308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:34.306624 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c3041476-1ca6-4f3b-a211-afe9a79de9c9 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77ef0281f0>, body: {"security_group_rule": {"parent_group_id": "19c7289e-7f5b-4877-ac06-3ca00c4ba868", "ip_protocol": "tcp", "from_port": 1917035439, "to_port": 22}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:34.835458 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:35.054727 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-c3041476-1ca6-4f3b-a211-afe9a79de9c9 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] HTTP exception thrown: Invalid port range 1917035439:22. Former value cannot be greater than the later Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c3041476-1ca6-4f3b-a211-afe9a79de9c9 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Request method failure captured: Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 146 Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJl7_07fRkY3f_ArxwmuIeTiFnCJAMHIeByPElhKeQw9VJ9Q2SIs87lOgLJasq4LHurSLxVbXOh2cYL3DQaa_3s0sf9Y7wU2RBEbUIjQD_QtInit937tee-D19UiMb7-UNVQJwjS4P9d3swUHU4rxHj3MDsUShVsVyPeleWQ6dnDcSc Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_83f4d8accaf7424cb88d1327e40a1e9e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/83f4d8accaf7424cb88d1327e40a1e9e"}]}] Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 434cd2fc0e8144b1ab676a4bf7605339 Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: {"security_group_rule": {"parent_group_id": "19c7289e-7f5b-4877-ac06-3ca00c4ba868", "ip_protocol": "tcp", "from_port": 1917035439, "to_port": 22}} Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid port range 1917035439:22. Former value cannot be greater than the later Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'security_group_rule': {'parent_group_id': '19c7289e-7f5b-4877-ac06-3ca00c4ba868', 'ip_protocol': 'tcp', 'from_port': 1917035439, 'to_port': 22}}} Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1917035439:22. Former value cannot be greater than the later Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1917035439:22. Former value cannot be greater than the later Oct 04 20:37:35.060144 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.068807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:35.068807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.068807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:35.068807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:35.068807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:35.068807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:35.068807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:35.068807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1917035439:22. Former value cannot be greater than the later Oct 04 20:37:35.068807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.071926 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c3041476-1ca6-4f3b-a211-afe9a79de9c9 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Returning 400 to user: Invalid port range 1917035439:22. Former value cannot be greater than the later {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:35.074116 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c3041476-1ca6-4f3b-a211-afe9a79de9c9 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.779193 Oct 04 20:37:35.084630 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 440/900] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:37:34 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 791 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:37:35.108162 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-14567707-3c04-44a3-96cf-0eec30f15527 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Calling method '.version_select at 0x7f77ef15c3a0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:35.175627 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-14567707-3c04-44a3-96cf-0eec30f15527 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1748048912 not found for user ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-14567707-3c04-44a3-96cf-0eec30f15527 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Request method failure captured: Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1748048912 HTTP/1.1 Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJl2ET_BRbR9vp3YD9N03WXTtROCR_ShrXzvF-TA_pSssT9Er7YgMeSKKnd-PraJORrbuJpQDUKzzpRw84VbktGqZx_q7aVpuTmBZxa-k4swpH8aleZgDA8cGRuBjbi4CDt9ccoImQhBk33twzLUvPVBib_Ge7B9zwD8oRnl7Upk2zI Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_36b7984e889d41e1a0c1b377eee8f8c8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36b7984e889d41e1a0c1b377eee8f8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/36b7984e889d41e1a0c1b377eee8f8c8"}]}] Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 36b7984e889d41e1a0c1b377eee8f8c8 Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-614898377 Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-KeyPairsNegativeTestJSON-614898377-project Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: exception: Keypair tempest-keypair-non-existent-1748048912 not found for user ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'tempest-keypair-non-existent-1748048912'} Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1748048912 not found for user ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.190979 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1748048912 not found for user ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1748048912 not found for user ae75884a70da45e582cee8258d1f2a7a Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.198840 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-14567707-3c04-44a3-96cf-0eec30f15527 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1748048912 not found for user ae75884a70da45e582cee8258d1f2a7a {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:35.208764 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-14567707-3c04-44a3-96cf-0eec30f15527 tempest-KeyPairsNegativeTestJSON-614898377 tempest-KeyPairsNegativeTestJSON-614898377-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1748048912" status: 404 len: 145 microversion: 2.1 time: 0.113326 Oct 04 20:37:35.208764 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 441/901] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:37:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1748048912 => generated 145 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:35.234682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-50ca6255-943d-4e9f-8df5-23d2b499a9b4 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:35.240970 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-50ca6255-943d-4e9f-8df5-23d2b499a9b4 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:35.256379 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-50ca6255-943d-4e9f-8df5-23d2b499a9b4 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.257187 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-50ca6255-943d-4e9f-8df5-23d2b499a9b4 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.258025 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-50ca6255-943d-4e9f-8df5-23d2b499a9b4 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.260341 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-50ca6255-943d-4e9f-8df5-23d2b499a9b4 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.261314 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-50ca6255-943d-4e9f-8df5-23d2b499a9b4 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.262384 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-50ca6255-943d-4e9f-8df5-23d2b499a9b4 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-555944bc-422c-4a5a-b1d9-b57178c83fee tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3b310527-ce7c-4935-9f50-921993d53d66) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:37:35.491593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3b310527-ce7c-4935-9f50-921993d53d66) Oct 04 20:37:35.501679 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.522843 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-555944bc-422c-4a5a-b1d9-b57178c83fee tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:35.522843 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-555944bc-422c-4a5a-b1d9-b57178c83fee tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Request method failure captured: Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 203 Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJllsosz-1nmVayiu2aBIgM_m1vuxlFJ4nqYT0WayTuP0YQxGh2762wzcuP078Ovbtevf06SA2Hmk61VL_LUIH3VKZW8AzQWoOv9lSs6jBoPNe3GRQDd-42P1aIbfxIem6guRqWg4CGQ751gI7bYpgPlI0b8PQ1olCLWIEoD6ss1ZIo Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 10ad510c188c41c5b44cde6ddd2f40e3 Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-LiveMigrationTest-1791906039 Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_10ad510c188c41c5b44cde6ddd2f40e3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/10ad510c188c41c5b44cde6ddd2f40e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/10ad510c188c41c5b44cde6ddd2f40e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/10ad510c188c41c5b44cde6ddd2f40e3"}]}] Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-LiveMigrationTest-1791906039 Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 10ad510c188c41c5b44cde6ddd2f40e3 Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-LiveMigrationTest-1791906039 Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-LiveMigrationTest-1791906039-project Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: fe9e839b68de4530b70e6a12fb5d00f1 Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-LiveMigrationTest-1791906039-project Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-LiveMigrationTest-server-1427672692", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "f83df98d-561c-48da-846a-6d99e02fce9a"}]}} Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-1427672692', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'f83df98d-561c-48da-846a-6d99e02fce9a'}]}}} Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:37:35.577009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3b310527-ce7c-4935-9f50-921993d53d66) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:37:35.593214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-555944bc-422c-4a5a-b1d9-b57178c83fee tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-555944bc-422c-4a5a-b1d9-b57178c83fee tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.182905 Oct 04 20:37:35.613017 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 461/902] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:32 2022] POST /compute/v2.1/servers => generated 214 bytes in 3192 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:37:35.618583 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ab1e0fad-a018-4efd-b972-67ce8d4bff93 tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] Action: 'create', calling method: .version_select at 0x7f77ef681700>, body: {"pool": null} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:36.574736 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-50ca6255-943d-4e9f-8df5-23d2b499a9b4 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:36.613419 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-50ca6255-943d-4e9f-8df5-23d2b499a9b4 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1316 microversion: 2.1 time: 1.410291 Oct 04 20:37:36.636558 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 442/903] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:35 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1316 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:36.651417 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1aecca0f-d38e-4782-8c75-15c0dcbe9ced tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77ef15c1f0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-224437369", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:36.656808 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-1aecca0f-d38e-4782-8c75-15c0dcbe9ced tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] HTTP exception thrown: Security group id should be uuid Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1aecca0f-d38e-4782-8c75-15c0dcbe9ced tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Request method failure captured: Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 130 Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJl7_07fRkY3f_ArxwmuIeTiFnCJAMHIeByPElhKeQw9VJ9Q2SIs87lOgLJasq4LHurSLxVbXOh2cYL3DQaa_3s0sf9Y7wU2RBEbUIjQD_QtInit937tee-D19UiMb7-UNVQJwjS4P9d3swUHU4rxHj3MDsUShVsVyPeleWQ6dnDcSc Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_83f4d8accaf7424cb88d1327e40a1e9e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/83f4d8accaf7424cb88d1327e40a1e9e"}]}] Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 434cd2fc0e8144b1ab676a4bf7605339 Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-224437369", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: exception: Security group id should be uuid Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-224437369', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:36.661887 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:36.673069 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 04 20:37:36.673069 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:36.685511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1aecca0f-d38e-4782-8c75-15c0dcbe9ced tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Returning 400 to user: Security group id should be uuid {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:36.687264 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1aecca0f-d38e-4782-8c75-15c0dcbe9ced tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.045984 Oct 04 20:37:36.695790 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 443/904] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:37:36 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:36.709771 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1251beb4-ba7b-4a7c-b091-d8e71353700c tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1022840743", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "f83df98d-561c-48da-846a-6d99e02fce9a"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:36.873570 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-1251beb4-ba7b-4a7c-b091-d8e71353700c tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] validate_networks() for [('f83df98d-561c-48da-846a-6d99e02fce9a', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-1251beb4-ba7b-4a7c-b091-d8e71353700c tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0cddd242-a857-4f8f-8f57-29d3ecbfbd7c) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:37:38.105098 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0cddd242-a857-4f8f-8f57-29d3ecbfbd7c) Oct 04 20:37:38.112154 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.120495 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-1251beb4-ba7b-4a7c-b091-d8e71353700c tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:38.120495 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1251beb4-ba7b-4a7c-b091-d8e71353700c tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Request method failure captured: Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 203 Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJllsosz-1nmVayiu2aBIgM_m1vuxlFJ4nqYT0WayTuP0YQxGh2762wzcuP078Ovbtevf06SA2Hmk61VL_LUIH3VKZW8AzQWoOv9lSs6jBoPNe3GRQDd-42P1aIbfxIem6guRqWg4CGQ751gI7bYpgPlI0b8PQ1olCLWIEoD6ss1ZIo Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 10ad510c188c41c5b44cde6ddd2f40e3 Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-LiveMigrationTest-1791906039 Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_10ad510c188c41c5b44cde6ddd2f40e3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/10ad510c188c41c5b44cde6ddd2f40e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/10ad510c188c41c5b44cde6ddd2f40e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/10ad510c188c41c5b44cde6ddd2f40e3"}]}] Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-LiveMigrationTest-1791906039 Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 10ad510c188c41c5b44cde6ddd2f40e3 Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-LiveMigrationTest-1791906039 Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-LiveMigrationTest-1791906039-project Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: fe9e839b68de4530b70e6a12fb5d00f1 Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-LiveMigrationTest-1791906039-project Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-LiveMigrationTest-server-1022840743", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "f83df98d-561c-48da-846a-6d99e02fce9a"}]}} Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-1022840743', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'f83df98d-561c-48da-846a-6d99e02fce9a'}]}}} Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:37:38.124495 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0cddd242-a857-4f8f-8f57-29d3ecbfbd7c) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:37:38.132537 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1251beb4-ba7b-4a7c-b091-d8e71353700c tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:38.144479 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:38.149296 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1251beb4-ba7b-4a7c-b091-d8e71353700c tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.441905 Oct 04 20:37:38.162345 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 444/905] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 1464 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:37:38.174894 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2c7eb323-054e-451b-9433-7e61a5540e4e tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77ef13ae50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-478522447", "description": "tempest-description-1193182339"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:39.525754 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2c7eb323-054e-451b-9433-7e61a5540e4e tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.363724 Oct 04 20:37:39.527099 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 445/906] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:37:38 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:40.175065 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-df9b8255-2c88-4d72-8553-f3bb769a21ca tempest-QuotaClassesAdmin257Test-836772276 tempest-QuotaClassesAdmin257Test-836772276-project-admin] Calling method '.version_select at 0x7f77eef5e8b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:40.268013 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-df9b8255-2c88-4d72-8553-f3bb769a21ca tempest-QuotaClassesAdmin257Test-836772276 tempest-QuotaClassesAdmin257Test-836772276-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.738696 Oct 04 20:37:40.279255 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 446/907] 10.222.0.78 () {60 vars in 1226 bytes} [Tue Oct 4 20:37:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:37:40.556005 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1e8ed13a-9f09-422b-9d1f-4f0c4f1ac6c4 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:40.579847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1e8ed13a-9f09-422b-9d1f-4f0c4f1ac6c4 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.591384 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1e8ed13a-9f09-422b-9d1f-4f0c4f1ac6c4 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.598136 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1e8ed13a-9f09-422b-9d1f-4f0c4f1ac6c4 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:40.600254 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1e8ed13a-9f09-422b-9d1f-4f0c4f1ac6c4 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.601554 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1e8ed13a-9f09-422b-9d1f-4f0c4f1ac6c4 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.607658 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1e8ed13a-9f09-422b-9d1f-4f0c4f1ac6c4 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:40.736631 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1e8ed13a-9f09-422b-9d1f-4f0c4f1ac6c4 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.465010 Oct 04 20:37:40.738574 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 447/908] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:37:40 2022] GET /compute/v2.1/os-services => generated 949 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:40.768974 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4d1213e6-ac6d-40d8-8ce6-cd9909e2a301 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:40.768974 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4d1213e6-ac6d-40d8-8ce6-cd9909e2a301 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:40.786069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4d1213e6-ac6d-40d8-8ce6-cd9909e2a301 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.788332 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4d1213e6-ac6d-40d8-8ce6-cd9909e2a301 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.789210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4d1213e6-ac6d-40d8-8ce6-cd9909e2a301 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:40.791902 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4d1213e6-ac6d-40d8-8ce6-cd9909e2a301 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.793299 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4d1213e6-ac6d-40d8-8ce6-cd9909e2a301 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.794038 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4d1213e6-ac6d-40d8-8ce6-cd9909e2a301 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.019835 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=30 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:41.269001 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4d1213e6-ac6d-40d8-8ce6-cd9909e2a301 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.280737 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4d1213e6-ac6d-40d8-8ce6-cd9909e2a301 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1316 microversion: 2.1 time: 0.535568 Oct 04 20:37:41.281651 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 448/909] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:40 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:41.295104 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-c0164a85-4243-4970-84f1-a941fb2627a3 req-b2d82533-b1bf-40d1-a042-dfdbff4c1635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70bac598-5b49-450a-9297-98c948ede895", "tag": "3ba03155-a256-4d12-935c-4c94ada17413"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:41.315441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-c0164a85-4243-4970-84f1-a941fb2627a3 req-b2d82533-b1bf-40d1-a042-dfdbff4c1635 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.316291 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-c0164a85-4243-4970-84f1-a941fb2627a3 req-b2d82533-b1bf-40d1-a042-dfdbff4c1635 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.317078 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-c0164a85-4243-4970-84f1-a941fb2627a3 req-b2d82533-b1bf-40d1-a042-dfdbff4c1635 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.335668 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-c0164a85-4243-4970-84f1-a941fb2627a3 req-b2d82533-b1bf-40d1-a042-dfdbff4c1635 service nova] Creating event network-changed:3ba03155-a256-4d12-935c-4c94ada17413 for instance 70bac598-5b49-450a-9297-98c948ede895 on n-h1-852085-12 Oct 04 20:37:41.342217 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-c0164a85-4243-4970-84f1-a941fb2627a3 req-b2d82533-b1bf-40d1-a042-dfdbff4c1635 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058537 Oct 04 20:37:41.343198 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 449/910] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:41.353384 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-60cb4552-66fc-49d6-b784-b3e8b9a98f8b tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Action: 'create', calling method: .version_select at 0x7f77ef03e0d0>, body: {"keypair": {"name": "tempest-keypair-383612971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLW6JepBz9NBxHA3vN1clqgfLy3ixuWY0B1Zo1oIVpi4cu6DOvlqm0iYT3mkwnUw2mHFLcd0ITVqgtHOnwUrCHU4GW6IkFm3ysaH+oTU/fYi5GLEwWdtm48zWbd1lP49A=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:41.391412 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-60cb4552-66fc-49d6-b784-b3e8b9a98f8b tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Getting quotas for project 10ad510c188c41c5b44cde6ddd2f40e3. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:41.400431 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-60cb4552-66fc-49d6-b784-b3e8b9a98f8b tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Getting quotas for user fe9e839b68de4530b70e6a12fb5d00f1 and project 10ad510c188c41c5b44cde6ddd2f40e3. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:41.650980 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-60cb4552-66fc-49d6-b784-b3e8b9a98f8b tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.302919 Oct 04 20:37:41.650980 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 450/911] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:41.661593 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bea05825-599f-40dc-a0a2-5349c364713a tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77eef5e820>, body: {"security_group_rule": {"parent_group_id": "04f8da55-f451-43e3-9ea3-e9ea44afecd8", "ip_protocol": "tempest-999-1804848027", "from_port": 22, "to_port": 22}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:41.996937 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-bea05825-599f-40dc-a0a2-5349c364713a tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] HTTP exception thrown: Invalid IP protocol tempest-999-1804848027. Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bea05825-599f-40dc-a0a2-5349c364713a tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Request method failure captured: Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 157 Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJl7_07fRkY3f_ArxwmuIeTiFnCJAMHIeByPElhKeQw9VJ9Q2SIs87lOgLJasq4LHurSLxVbXOh2cYL3DQaa_3s0sf9Y7wU2RBEbUIjQD_QtInit937tee-D19UiMb7-UNVQJwjS4P9d3swUHU4rxHj3MDsUShVsVyPeleWQ6dnDcSc Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_83f4d8accaf7424cb88d1327e40a1e9e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/83f4d8accaf7424cb88d1327e40a1e9e"}]}] Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 434cd2fc0e8144b1ab676a4bf7605339 Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: {"security_group_rule": {"parent_group_id": "04f8da55-f451-43e3-9ea3-e9ea44afecd8", "ip_protocol": "tempest-999-1804848027", "from_port": 22, "to_port": 22}} Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid IP protocol tempest-999-1804848027. Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'security_group_rule': {'parent_group_id': '04f8da55-f451-43e3-9ea3-e9ea44afecd8', 'ip_protocol': 'tempest-999-1804848027', 'from_port': 22, 'to_port': 22}}} Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1804848027. Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1804848027. Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:42.004894 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:42.018693 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:42.018693 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:42.018693 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:42.018693 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:42.018693 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:42.018693 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:42.018693 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1804848027. Oct 04 20:37:42.018693 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:42.018693 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bea05825-599f-40dc-a0a2-5349c364713a tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Returning 400 to user: Invalid IP protocol tempest-999-1804848027. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:42.018693 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bea05825-599f-40dc-a0a2-5349c364713a tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.355015 Oct 04 20:37:42.018693 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 451/912] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:37:41 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 359 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:42.025673 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-74393cb1-d3c9-43f7-8852-b6a0355865e3 tempest-QuotaClassesAdmin257Test-836772276 tempest-QuotaClassesAdmin257Test-836772276-project-admin] Action: 'update', calling method: .version_select at 0x7f77eef01040>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:42.194774 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ab1e0fad-a018-4efd-b972-67ce8d4bff93 tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.606080 Oct 04 20:37:42.208825 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 462/913] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 4 20:37:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:42.221509 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d67a83bb-6723-414f-90af-2eace0aeb8c2 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:42.228522 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d67a83bb-6723-414f-90af-2eace0aeb8c2 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.229625 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d67a83bb-6723-414f-90af-2eace0aeb8c2 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.230430 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d67a83bb-6723-414f-90af-2eace0aeb8c2 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.232065 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d67a83bb-6723-414f-90af-2eace0aeb8c2 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.232775 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d67a83bb-6723-414f-90af-2eace0aeb8c2 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.233777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d67a83bb-6723-414f-90af-2eace0aeb8c2 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.279487 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=50 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:42.329217 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d67a83bb-6723-414f-90af-2eace0aeb8c2 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.116226 Oct 04 20:37:42.330857 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 463/914] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Oct 4 20:37:42 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:42.697677 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9b4924c4-be7b-4151-954a-5e96538596d3 tempest-AbsoluteLimitsTestJSON-2083265338 tempest-AbsoluteLimitsTestJSON-2083265338-project] Calling method '.version_select at 0x7f77ef681430>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:42.733065 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9b4924c4-be7b-4151-954a-5e96538596d3 tempest-AbsoluteLimitsTestJSON-2083265338 tempest-AbsoluteLimitsTestJSON-2083265338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.736725 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9b4924c4-be7b-4151-954a-5e96538596d3 tempest-AbsoluteLimitsTestJSON-2083265338 tempest-AbsoluteLimitsTestJSON-2083265338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.741563 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9b4924c4-be7b-4151-954a-5e96538596d3 tempest-AbsoluteLimitsTestJSON-2083265338 tempest-AbsoluteLimitsTestJSON-2083265338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.746326 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9b4924c4-be7b-4151-954a-5e96538596d3 tempest-AbsoluteLimitsTestJSON-2083265338 tempest-AbsoluteLimitsTestJSON-2083265338-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.749575 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9b4924c4-be7b-4151-954a-5e96538596d3 tempest-AbsoluteLimitsTestJSON-2083265338 tempest-AbsoluteLimitsTestJSON-2083265338-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.750734 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9b4924c4-be7b-4151-954a-5e96538596d3 tempest-AbsoluteLimitsTestJSON-2083265338 tempest-AbsoluteLimitsTestJSON-2083265338-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.800481 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9b4924c4-be7b-4151-954a-5e96538596d3 tempest-AbsoluteLimitsTestJSON-2083265338 tempest-AbsoluteLimitsTestJSON-2083265338-project] 10.222.0.78 "GET /compute/v2.1/limits" status: 200 len: 513 microversion: 2.1 time: 0.467416 Oct 04 20:37:42.801251 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 464/915] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:42 2022] GET /compute/v2.1/limits => generated 513 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:42.810112 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5e150e6b-f70d-4623-97de-b98971b5bac5 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77ef9d4e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-194680308", "description": "tempest-description-763829564"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:43.385901 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-74393cb1-d3c9-43f7-8852-b6a0355865e3 tempest-QuotaClassesAdmin257Test-836772276 tempest-QuotaClassesAdmin257Test-836772276-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 1.372878 Oct 04 20:37:43.389020 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 452/916] 10.222.0.78 () {62 vars in 1247 bytes} [Tue Oct 4 20:37:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:37:43.404567 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-530e8b64-a228-4d71-8a6b-ff431ef36139 tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] Action: 'create', calling method: .version_select at 0x7f77eef635e0>, body: {"pool": null} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:45.119669 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5e150e6b-f70d-4623-97de-b98971b5bac5 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 2.305762 Oct 04 20:37:45.119669 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 465/917] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:37:42 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 2309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:45.130433 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-154ca90b-cc0f-4d7f-9a12-138858fdfe3a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:45.132470 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-154ca90b-cc0f-4d7f-9a12-138858fdfe3a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:45.148788 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-154ca90b-cc0f-4d7f-9a12-138858fdfe3a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.149821 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-154ca90b-cc0f-4d7f-9a12-138858fdfe3a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.152971 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-154ca90b-cc0f-4d7f-9a12-138858fdfe3a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.153183 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-154ca90b-cc0f-4d7f-9a12-138858fdfe3a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.153578 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-154ca90b-cc0f-4d7f-9a12-138858fdfe3a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.154141 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-154ca90b-cc0f-4d7f-9a12-138858fdfe3a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.275129 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-154ca90b-cc0f-4d7f-9a12-138858fdfe3a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:46.309482 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-154ca90b-cc0f-4d7f-9a12-138858fdfe3a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1316 microversion: 2.1 time: 1.195953 Oct 04 20:37:46.324233 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 466/918] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:45 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1316 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:46.349085 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5c72fcf8-c460-408f-bb3b-1c320b9c29da tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:46.363476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5c72fcf8-c460-408f-bb3b-1c320b9c29da tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.363476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5c72fcf8-c460-408f-bb3b-1c320b9c29da tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.363476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5c72fcf8-c460-408f-bb3b-1c320b9c29da tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.363476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5c72fcf8-c460-408f-bb3b-1c320b9c29da tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.366033 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5c72fcf8-c460-408f-bb3b-1c320b9c29da tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.367699 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5c72fcf8-c460-408f-bb3b-1c320b9c29da tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.435268 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5c72fcf8-c460-408f-bb3b-1c320b9c29da tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.097594 Oct 04 20:37:46.438854 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 467/919] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:37:46 2022] GET /compute/v2.1/os-services => generated 949 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:46.451793 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a631932f-ed1f-499c-98e9-0486a095c096 tempest-QuotaClassesAdmin257Test-836772276 tempest-QuotaClassesAdmin257Test-836772276-project-admin] Calling method '.version_select at 0x7f77ef681790>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:46.499303 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a631932f-ed1f-499c-98e9-0486a095c096 tempest-QuotaClassesAdmin257Test-836772276 tempest-QuotaClassesAdmin257Test-836772276-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.057915 Oct 04 20:37:46.502872 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 468/920] 10.222.0.78 () {60 vars in 1226 bytes} [Tue Oct 4 20:37:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:37:46.546569 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-52167cec-0f49-4df6-9a6f-5b4bcd86bd06 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77ef2f6af0>, body: {"security_group_rule": {"parent_group_id": "4f5f3da5-25ec-4c41-a0bb-6a4fc55405c5", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:47.097659 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-52167cec-0f49-4df6-9a6f-5b4bcd86bd06 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-52167cec-0f49-4df6-9a6f-5b4bcd86bd06 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Request method failure captured: Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 138 Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJl7_07fRkY3f_ArxwmuIeTiFnCJAMHIeByPElhKeQw9VJ9Q2SIs87lOgLJasq4LHurSLxVbXOh2cYL3DQaa_3s0sf9Y7wU2RBEbUIjQD_QtInit937tee-D19UiMb7-UNVQJwjS4P9d3swUHU4rxHj3MDsUShVsVyPeleWQ6dnDcSc Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_83f4d8accaf7424cb88d1327e40a1e9e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/83f4d8accaf7424cb88d1327e40a1e9e"}]}] Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 434cd2fc0e8144b1ab676a4bf7605339 Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: {"security_group_rule": {"parent_group_id": "4f5f3da5-25ec-4c41-a0bb-6a4fc55405c5", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4f5f3da5-25ec-4c41-a0bb-6a4fc55405c5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:37:47.100933 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:47.110101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:47.110101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:47.110101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:47.110101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:47.110101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:47.110101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:47.110101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:47.110101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:37:47.110101 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:47.110101 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-52167cec-0f49-4df6-9a6f-5b4bcd86bd06 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:47.110101 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-52167cec-0f49-4df6-9a6f-5b4bcd86bd06 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.597475 Oct 04 20:37:47.110101 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 469/921] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:37:46 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 600 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:37:47.116568 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f201b461-4837-4aa6-b6b2-8dcfb468251a tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:47.127331 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f201b461-4837-4aa6-b6b2-8dcfb468251a tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.128004 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f201b461-4837-4aa6-b6b2-8dcfb468251a tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.133474 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f201b461-4837-4aa6-b6b2-8dcfb468251a tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.133474 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f201b461-4837-4aa6-b6b2-8dcfb468251a tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.134386 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f201b461-4837-4aa6-b6b2-8dcfb468251a tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.135721 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f201b461-4837-4aa6-b6b2-8dcfb468251a tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.211556 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f201b461-4837-4aa6-b6b2-8dcfb468251a tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=n-d-852085-12&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.104540 Oct 04 20:37:47.213688 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 470/922] 10.222.0.78 () {58 vars in 1196 bytes} [Tue Oct 4 20:37:47 2022] GET /compute/v2.1/os-services?host=n-d-852085-12&binary=xxx => generated 16 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:37:47.224680 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d370d60c-874e-423b-98af-b4a93e3a4efa tempest-QuotaClassesAdmin257Test-836772276 tempest-QuotaClassesAdmin257Test-836772276-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef75d700>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:48.220166 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d370d60c-874e-423b-98af-b4a93e3a4efa tempest-QuotaClassesAdmin257Test-836772276 tempest-QuotaClassesAdmin257Test-836772276-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 1.003742 Oct 04 20:37:48.227479 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 471/923] 10.222.0.78 () {62 vars in 1247 bytes} [Tue Oct 4 20:37:47 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:37:48.254846 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e0c40d1b-5b29-4831-afec-7010ef765acd tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77ef2d6f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-169100326", "description": "tempest-description-1029678555"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:49.370926 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e0c40d1b-5b29-4831-afec-7010ef765acd tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.140071 Oct 04 20:37:49.372115 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 472/924] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:37:48 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:49.397785 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-45cd6316-2aa7-437a-acac-60f4d06692c7 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.407800 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-45cd6316-2aa7-437a-acac-60f4d06692c7 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.409192 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-45cd6316-2aa7-437a-acac-60f4d06692c7 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.413316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-45cd6316-2aa7-437a-acac-60f4d06692c7 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.413316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-45cd6316-2aa7-437a-acac-60f4d06692c7 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.413316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-45cd6316-2aa7-437a-acac-60f4d06692c7 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.414047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-45cd6316-2aa7-437a-acac-60f4d06692c7 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.470466 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-45cd6316-2aa7-437a-acac-60f4d06692c7 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.085116 Oct 04 20:37:49.507507 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 473/925] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:37:49 2022] GET /compute/v2.1/os-services => generated 949 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:49.507507 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-55129b99-2b3b-4244-a5f6-60467e17fb4e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.507507 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-55129b99-2b3b-4244-a5f6-60467e17fb4e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:49.517779 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-55129b99-2b3b-4244-a5f6-60467e17fb4e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.518617 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-55129b99-2b3b-4244-a5f6-60467e17fb4e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.519494 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-55129b99-2b3b-4244-a5f6-60467e17fb4e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.521123 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-55129b99-2b3b-4244-a5f6-60467e17fb4e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.522296 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-55129b99-2b3b-4244-a5f6-60467e17fb4e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.523362 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-55129b99-2b3b-4244-a5f6-60467e17fb4e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.947401 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-530e8b64-a228-4d71-8a6b-ff431ef36139 tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.554086 Oct 04 20:37:49.948915 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 453/926] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Oct 4 20:37:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:49.960152 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-24023683-3c02-4955-ae02-c4090c415b07 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1391722891", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "f83df98d-561c-48da-846a-6d99e02fce9a"}], "security_groups": [{"name": "tempest-securitygroup--1440289309"}], "key_name": "tempest-keypair-383612971", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:50.008093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-55129b99-2b3b-4244-a5f6-60467e17fb4e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:50.026703 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-55129b99-2b3b-4244-a5f6-60467e17fb4e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1316 microversion: 2.1 time: 0.542494 Oct 04 20:37:50.040437 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 474/927] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:49 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:50.068710 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-b09b7458-7474-44ad-aa82-70662af673a5 req-4810cfa3-c2fd-4ff3-a22f-54f45d245717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bac598-5b49-450a-9297-98c948ede895", "name": "network-vif-plugged", "status": "completed", "tag": "3ba03155-a256-4d12-935c-4c94ada17413"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:50.086197 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-b09b7458-7474-44ad-aa82-70662af673a5 req-4810cfa3-c2fd-4ff3-a22f-54f45d245717 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.087036 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-b09b7458-7474-44ad-aa82-70662af673a5 req-4810cfa3-c2fd-4ff3-a22f-54f45d245717 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.088343 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-b09b7458-7474-44ad-aa82-70662af673a5 req-4810cfa3-c2fd-4ff3-a22f-54f45d245717 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.114131 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-b09b7458-7474-44ad-aa82-70662af673a5 req-4810cfa3-c2fd-4ff3-a22f-54f45d245717 service nova] Creating event network-vif-plugged:3ba03155-a256-4d12-935c-4c94ada17413 for instance 70bac598-5b49-450a-9297-98c948ede895 on n-h1-852085-12 Oct 04 20:37:50.135599 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-b09b7458-7474-44ad-aa82-70662af673a5 req-4810cfa3-c2fd-4ff3-a22f-54f45d245717 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086298 Oct 04 20:37:50.137298 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 475/928] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:50.154344 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e1e7cb67-18dd-4090-a97d-8ce1a5b06020 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77ef681a60>, body: {"security_group_rule": {"parent_group_id": "18f457bf-4de2-4896-947f-35c627822465", "ip_protocol": "tcp", "from_port": 22, "to_port": 1912965713}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:50.249459 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-24023683-3c02-4955-ae02-c4090c415b07 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] validate_networks() for [('f83df98d-561c-48da-846a-6d99e02fce9a', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:50.524790 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-e1e7cb67-18dd-4090-a97d-8ce1a5b06020 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] HTTP exception thrown: Invalid port range 22:1912965713. Valid TCP ports should be between 1-65535 Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e1e7cb67-18dd-4090-a97d-8ce1a5b06020 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Request method failure captured: Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 146 Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJl7_07fRkY3f_ArxwmuIeTiFnCJAMHIeByPElhKeQw9VJ9Q2SIs87lOgLJasq4LHurSLxVbXOh2cYL3DQaa_3s0sf9Y7wU2RBEbUIjQD_QtInit937tee-D19UiMb7-UNVQJwjS4P9d3swUHU4rxHj3MDsUShVsVyPeleWQ6dnDcSc Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_83f4d8accaf7424cb88d1327e40a1e9e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/83f4d8accaf7424cb88d1327e40a1e9e"}]}] Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 434cd2fc0e8144b1ab676a4bf7605339 Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: {"security_group_rule": {"parent_group_id": "18f457bf-4de2-4896-947f-35c627822465", "ip_protocol": "tcp", "from_port": 22, "to_port": 1912965713}} Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: exception: Invalid port range 22:1912965713. Valid TCP ports should be between 1-65535 Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'security_group_rule': {'parent_group_id': '18f457bf-4de2-4896-947f-35c627822465', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1912965713}}} Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1912965713. Valid TCP ports should be between 1-65535 Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1912965713. Valid TCP ports should be between 1-65535 Oct 04 20:37:50.528810 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:50.549349 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:50.549349 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:50.549349 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:50.549349 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:50.549349 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:50.549349 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:50.549349 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:50.549349 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1912965713. Valid TCP ports should be between 1-65535 Oct 04 20:37:50.549349 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:50.549349 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e1e7cb67-18dd-4090-a97d-8ce1a5b06020 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Returning 400 to user: Invalid port range 22:1912965713. Valid TCP ports should be between 1-65535 {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:50.549349 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e1e7cb67-18dd-4090-a97d-8ce1a5b06020 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.386161 Oct 04 20:37:50.559692 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 476/929] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:37:50 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 413 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:37:50.576370 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0751d88e-4fe4-4f1a-a568-9016692f8527 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:50.605004 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0751d88e-4fe4-4f1a-a568-9016692f8527 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.606012 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0751d88e-4fe4-4f1a-a568-9016692f8527 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.607323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0751d88e-4fe4-4f1a-a568-9016692f8527 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.608292 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0751d88e-4fe4-4f1a-a568-9016692f8527 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.609173 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0751d88e-4fe4-4f1a-a568-9016692f8527 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.609986 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0751d88e-4fe4-4f1a-a568-9016692f8527 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.642319 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:50.675799 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0751d88e-4fe4-4f1a-a568-9016692f8527 tempest-ServicesAdminNegativeTestJSON-965155300 tempest-ServicesAdminNegativeTestJSON-965155300-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.122174 Oct 04 20:37:50.678011 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 477/930] 10.222.0.78 () {58 vars in 1198 bytes} [Tue Oct 4 20:37:50 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:37:50.704752 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e75bc5fd-5444-4447-87fc-ead35bdd0d22 tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] Calling method '.version_select at 0x7f77ef2f65e0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-24023683-3c02-4955-ae02-c4090c415b07 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7680fc70-b23e-4436-ae27-c9e6972d7a93) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:37:51.085404 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7680fc70-b23e-4436-ae27-c9e6972d7a93) Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-24023683-3c02-4955-ae02-c4090c415b07 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:51.100786 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-24023683-3c02-4955-ae02-c4090c415b07 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Request method failure captured: Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 457 Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJllsosz-1nmVayiu2aBIgM_m1vuxlFJ4nqYT0WayTuP0YQxGh2762wzcuP078Ovbtevf06SA2Hmk61VL_LUIH3VKZW8AzQWoOv9lSs6jBoPNe3GRQDd-42P1aIbfxIem6guRqWg4CGQ751gI7bYpgPlI0b8PQ1olCLWIEoD6ss1ZIo Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 10ad510c188c41c5b44cde6ddd2f40e3 Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-LiveMigrationTest-1791906039 Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_10ad510c188c41c5b44cde6ddd2f40e3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/10ad510c188c41c5b44cde6ddd2f40e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/10ad510c188c41c5b44cde6ddd2f40e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/10ad510c188c41c5b44cde6ddd2f40e3"}]}] Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-LiveMigrationTest-1791906039 Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 10ad510c188c41c5b44cde6ddd2f40e3 Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-LiveMigrationTest-1791906039 Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-LiveMigrationTest-1791906039-project Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: fe9e839b68de4530b70e6a12fb5d00f1 Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-LiveMigrationTest-1791906039-project Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-LiveMigrationTest-server-1391722891", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "f83df98d-561c-48da-846a-6d99e02fce9a"}], "security_groups": [{"name": "tempest-securitygroup--1440289309"}], "key_name": "tempest-keypair-383612971", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-1391722891', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'f83df98d-561c-48da-846a-6d99e02fce9a'}], 'security_groups': [{'name': 'tempest-securitygroup--1440289309'}], 'key_name': 'tempest-keypair-383612971', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:37:51.110949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7680fc70-b23e-4436-ae27-c9e6972d7a93) Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:51.124639 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-24023683-3c02-4955-ae02-c4090c415b07 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:51.135385 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-24023683-3c02-4955-ae02-c4090c415b07 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.177510 Oct 04 20:37:51.146892 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 454/931] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:49 2022] POST /compute/v2.1/servers => generated 214 bytes in 1196 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:37:51.180210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-21345f95-2a0c-4bda-9a99-ad47c90af895 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Action: 'create', calling method: .version_select at 0x7f77eefca790>, body: {"security_group_rule": {"parent_group_id": "13210f25-a2a3-4428-8970-df9dfc1d86a2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:51.259105 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-21345f95-2a0c-4bda-9a99-ad47c90af895 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 13210f25-a2a3-4428-8970-df9dfc1d86a2 does not exist", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.security_group_api [None req-21345f95-2a0c-4bda-9a99-ad47c90af895 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Neutron security group 13210f25-a2a3-4428-8970-df9dfc1d86a2 not found {{(pid=123539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-21345f95-2a0c-4bda-9a99-ad47c90af895 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] HTTP exception thrown: Security group 13210f25-a2a3-4428-8970-df9dfc1d86a2 does not exist Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-9ab7f2d3-74f3-4a04-92e8-525c30cdcf7c'] Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-21345f95-2a0c-4bda-9a99-ad47c90af895 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Request method failure captured: Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 138 Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJl7_07fRkY3f_ArxwmuIeTiFnCJAMHIeByPElhKeQw9VJ9Q2SIs87lOgLJasq4LHurSLxVbXOh2cYL3DQaa_3s0sf9Y7wU2RBEbUIjQD_QtInit937tee-D19UiMb7-UNVQJwjS4P9d3swUHU4rxHj3MDsUShVsVyPeleWQ6dnDcSc Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_83f4d8accaf7424cb88d1327e40a1e9e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/83f4d8accaf7424cb88d1327e40a1e9e"}]}] Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 434cd2fc0e8144b1ab676a4bf7605339 Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: {"security_group_rule": {"parent_group_id": "13210f25-a2a3-4428-8970-df9dfc1d86a2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: exception: Security group 13210f25-a2a3-4428-8970-df9dfc1d86a2 does not exist Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-9ab7f2d3-74f3-4a04-92e8-525c30cdcf7c'] Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'security_group_rule': {'parent_group_id': '13210f25-a2a3-4428-8970-df9dfc1d86a2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.266241 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 13210f25-a2a3-4428-8970-df9dfc1d86a2 does not exist Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ab7f2d3-74f3-4a04-92e8-525c30cdcf7c'] Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 13210f25-a2a3-4428-8970-df9dfc1d86a2 does not exist Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ab7f2d3-74f3-4a04-92e8-525c30cdcf7c'] Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 13210f25-a2a3-4428-8970-df9dfc1d86a2 does not exist Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ab7f2d3-74f3-4a04-92e8-525c30cdcf7c'] Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 13210f25-a2a3-4428-8970-df9dfc1d86a2 does not exist Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ab7f2d3-74f3-4a04-92e8-525c30cdcf7c'] Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-21345f95-2a0c-4bda-9a99-ad47c90af895 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Returning 404 to user: Security group 13210f25-a2a3-4428-8970-df9dfc1d86a2 does not exist Oct 04 20:37:51.302418 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-9ab7f2d3-74f3-4a04-92e8-525c30cdcf7c'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:51.328175 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e75bc5fd-5444-4447-87fc-ead35bdd0d22 tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/078742fb-ac36-44e5-b863-1fdd56a65449" status: 200 len: 142 microversion: 2.1 time: 0.596155 Oct 04 20:37:51.328902 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-21345f95-2a0c-4bda-9a99-ad47c90af895 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.113959 Oct 04 20:37:51.332097 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 478/932] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:37:50 2022] GET /compute/v2.1/os-floating-ips/078742fb-ac36-44e5-b863-1fdd56a65449 => generated 142 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:51.332476 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 455/933] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:37:51 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:51.332476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b3b9b95b-fd34-4ea2-9587-27b243ba8e9e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:51.332476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b3b9b95b-fd34-4ea2-9587-27b243ba8e9e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:51.332476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3b9b95b-fd34-4ea2-9587-27b243ba8e9e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:51.332476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3b9b95b-fd34-4ea2-9587-27b243ba8e9e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:51.332476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3b9b95b-fd34-4ea2-9587-27b243ba8e9e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:51.332476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3b9b95b-fd34-4ea2-9587-27b243ba8e9e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:51.332476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3b9b95b-fd34-4ea2-9587-27b243ba8e9e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:51.332476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3b9b95b-fd34-4ea2-9587-27b243ba8e9e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:51.332476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=16 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:51.715889 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b3b9b95b-fd34-4ea2-9587-27b243ba8e9e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:51.737461 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b3b9b95b-fd34-4ea2-9587-27b243ba8e9e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1316 microversion: 2.1 time: 0.455937 Oct 04 20:37:51.739845 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 456/934] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:51 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1316 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:51.773352 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-314ff48c-5565-4b54-b550-86515890528f tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Calling method '.version_select at 0x7f77eef5e820>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:51.862052 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-314ff48c-5565-4b54-b550-86515890528f tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule a84cd67d-e9cf-48ad-aab4-111f3c61cdc7 does not exist", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:37:51.864116 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.security_group_api [None req-314ff48c-5565-4b54-b550-86515890528f tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Neutron security group rule a84cd67d-e9cf-48ad-aab4-111f3c61cdc7 not found {{(pid=123539) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 04 20:37:51.865136 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-314ff48c-5565-4b54-b550-86515890528f tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] HTTP exception thrown: Security group rule a84cd67d-e9cf-48ad-aab4-111f3c61cdc7 does not exist Oct 04 20:37:51.865136 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-be27ea31-e4a5-424d-8cf2-f93a4871dda8'] Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-314ff48c-5565-4b54-b550-86515890528f tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Request method failure captured: Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/os-security-group-rules/a84cd67d-e9cf-48ad-aab4-111f3c61cdc7 HTTP/1.1 Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJl7_07fRkY3f_ArxwmuIeTiFnCJAMHIeByPElhKeQw9VJ9Q2SIs87lOgLJasq4LHurSLxVbXOh2cYL3DQaa_3s0sf9Y7wU2RBEbUIjQD_QtInit937tee-D19UiMb7-UNVQJwjS4P9d3swUHU4rxHj3MDsUShVsVyPeleWQ6dnDcSc Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_83f4d8accaf7424cb88d1327e40a1e9e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83f4d8accaf7424cb88d1327e40a1e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/83f4d8accaf7424cb88d1327e40a1e9e"}]}] Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 83f4d8accaf7424cb88d1327e40a1e9e Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209 Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 434cd2fc0e8144b1ab676a4bf7605339 Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-486850209-project Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: exception: Security group rule a84cd67d-e9cf-48ad-aab4-111f3c61cdc7 does not exist Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-be27ea31-e4a5-424d-8cf2-f93a4871dda8'] Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'a84cd67d-e9cf-48ad-aab4-111f3c61cdc7'} Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:37:51.871426 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule a84cd67d-e9cf-48ad-aab4-111f3c61cdc7 does not exist Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be27ea31-e4a5-424d-8cf2-f93a4871dda8'] Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule a84cd67d-e9cf-48ad-aab4-111f3c61cdc7 does not exist Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be27ea31-e4a5-424d-8cf2-f93a4871dda8'] Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule a84cd67d-e9cf-48ad-aab4-111f3c61cdc7 does not exist Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be27ea31-e4a5-424d-8cf2-f93a4871dda8'] Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule a84cd67d-e9cf-48ad-aab4-111f3c61cdc7 does not exist Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be27ea31-e4a5-424d-8cf2-f93a4871dda8'] Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-314ff48c-5565-4b54-b550-86515890528f tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Returning 404 to user: Security group rule a84cd67d-e9cf-48ad-aab4-111f3c61cdc7 does not exist Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-be27ea31-e4a5-424d-8cf2-f93a4871dda8'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:51.880120 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-314ff48c-5565-4b54-b550-86515890528f tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/a84cd67d-e9cf-48ad-aab4-111f3c61cdc7" status: 404 len: 199 microversion: 2.1 time: 0.129757 Oct 04 20:37:51.893721 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 457/935] 10.222.0.78 () {58 vars in 1287 bytes} [Tue Oct 4 20:37:51 2022] DELETE /compute/v2.1/os-security-group-rules/a84cd67d-e9cf-48ad-aab4-111f3c61cdc7 => generated 199 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:51.917832 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-30aebdaa-8db3-41b2-a540-12a4ca07733e tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] Calling method '.version_select at 0x7f77ef168af0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:52.260711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0f05c847-2a20-4525-b366-1ba04a224728 tempest-ServicesAdminNegativeTestJSON-1572973507 tempest-ServicesAdminNegativeTestJSON-1572973507-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:52.284540 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0f05c847-2a20-4525-b366-1ba04a224728 tempest-ServicesAdminNegativeTestJSON-1572973507 tempest-ServicesAdminNegativeTestJSON-1572973507-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'af8669a819704f2b9762bce6752b8e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fb412093454da0af42e1473196145f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0f05c847-2a20-4525-b366-1ba04a224728 tempest-ServicesAdminNegativeTestJSON-1572973507 tempest-ServicesAdminNegativeTestJSON-1572973507-project] Request method failure captured: Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJmNLg-UTPGraE6c7JgiP1Dqi6ITbc9lRxJChLMunwJ0icel9JGzqwrD8aGBsMMOhALAMYE_6h0MjWzMecEoOAKY1d-U-HgQJGwK2JNf3pPry8yCEvNxnWjza91ENEAD4uuZ0bU5w5AjnKkBrRC0m-k81pggQrx2bSmGeJEivqqvSFk Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 86fb412093454da0af42e1473196145f Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1572973507 Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_86fb412093454da0af42e1473196145f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86fb412093454da0af42e1473196145f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86fb412093454da0af42e1473196145f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/86fb412093454da0af42e1473196145f"}]}] Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1572973507 Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 86fb412093454da0af42e1473196145f Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1572973507 Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServicesAdminNegativeTestJSON-1572973507-project Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: af8669a819704f2b9762bce6752b8e7d Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1572973507-project Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: action_args: {} Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:37:52.290716 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:52.304079 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:52.304079 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:52.304079 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:52.304079 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:52.304079 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:52.304079 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:37:52.304079 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:37:52.304079 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:37:52.304079 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:52.304079 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0f05c847-2a20-4525-b366-1ba04a224728 tempest-ServicesAdminNegativeTestJSON-1572973507 tempest-ServicesAdminNegativeTestJSON-1572973507-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:52.308672 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0f05c847-2a20-4525-b366-1ba04a224728 tempest-ServicesAdminNegativeTestJSON-1572973507 tempest-ServicesAdminNegativeTestJSON-1572973507-project] 10.222.0.78 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 1.026072 Oct 04 20:37:52.315724 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 479/936] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:37:51 2022] GET /compute/v2.1/os-services => generated 112 bytes in 1036 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:52.343089 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d0f2228e-daab-4aca-951f-1668d00ef6c3 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Calling method '.version_select at 0x7f77ef2d6430>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:53.379344 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=29,nova_cell0:UPDATE=7 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:53.815166 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d0f2228e-daab-4aca-951f-1668d00ef6c3 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/18f457bf-4de2-4896-947f-35c627822465" status: 202 len: 0 microversion: 2.1 time: 1.495097 Oct 04 20:37:53.816231 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 480/937] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:37:52 2022] DELETE /compute/v2.1/os-security-groups/18f457bf-4de2-4896-947f-35c627822465 => generated 0 bytes in 1500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:53.869478 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-06b908ae-5993-43ab-9637-51270b3b1218 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:53.870851 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-06b908ae-5993-43ab-9637-51270b3b1218 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:53.914205 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-06b908ae-5993-43ab-9637-51270b3b1218 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.915249 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-06b908ae-5993-43ab-9637-51270b3b1218 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.916118 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-06b908ae-5993-43ab-9637-51270b3b1218 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.917940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-06b908ae-5993-43ab-9637-51270b3b1218 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.919212 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-06b908ae-5993-43ab-9637-51270b3b1218 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.920465 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-06b908ae-5993-43ab-9637-51270b3b1218 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.468132 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-06b908ae-5993-43ab-9637-51270b3b1218 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.490461 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-06b908ae-5993-43ab-9637-51270b3b1218 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1465 microversion: 2.1 time: 0.666238 Oct 04 20:37:54.491464 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 481/938] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:53 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1465 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:55.128904 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-30aebdaa-8db3-41b2-a540-12a4ca07733e tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/078742fb-ac36-44e5-b863-1fdd56a65449" status: 202 len: 0 microversion: 2.1 time: 3.240983 Oct 04 20:37:55.137431 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 458/939] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:37:51 2022] DELETE /compute/v2.1/os-floating-ips/078742fb-ac36-44e5-b863-1fdd56a65449 => generated 0 bytes in 3251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:55.161830 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1464db92-8918-4463-afb2-3cd7c29128e1 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Calling method '.version_select at 0x7f77eef5e8b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:55.298854 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6785d883-f19f-4f9c-972a-bffbf17093ac tempest-ListServerFiltersTestJSON-298500262 tempest-ListServerFiltersTestJSON-298500262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1706303741", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "73860823-05c1-4d23-b7c0-6204dbac5f05"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:55.529395 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-6785d883-f19f-4f9c-972a-bffbf17093ac tempest-ListServerFiltersTestJSON-298500262 tempest-ListServerFiltersTestJSON-298500262-project] validate_networks() for [('73860823-05c1-4d23-b7c0-6204dbac5f05', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-6785d883-f19f-4f9c-972a-bffbf17093ac tempest-ListServerFiltersTestJSON-298500262 tempest-ListServerFiltersTestJSON-298500262-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-34aaa28f-9adc-4146-9fde-f3949b685ccc) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:37:56.273692 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-34aaa28f-9adc-4146-9fde-f3949b685ccc) Oct 04 20:37:56.281165 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-6785d883-f19f-4f9c-972a-bffbf17093ac tempest-ListServerFiltersTestJSON-298500262 tempest-ListServerFiltersTestJSON-298500262-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6785d883-f19f-4f9c-972a-bffbf17093ac tempest-ListServerFiltersTestJSON-298500262 tempest-ListServerFiltersTestJSON-298500262-project] Request method failure captured: Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 213 Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJmfOKYx1edx8HU2iAqg5bZnNHKKdUa59SMnfFEInej485k1wcUrUPDcIObFwV00azIbCAcCqUrXDrjSRW-EWCXAcFQlWPzWDJ3nkYRl5Y8fQtpC_tWmCIwIT91EJRWUBc2vzoBBcdQdw4PVTTWdMYrkJN8rOaIzSKRa9tF-VoJb59E Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: c3c72a0ce1094ac2a3af43b076abac75 Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ListServerFiltersTestJSON-298500262 Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c3c72a0ce1094ac2a3af43b076abac75", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c3c72a0ce1094ac2a3af43b076abac75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c3c72a0ce1094ac2a3af43b076abac75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c3c72a0ce1094ac2a3af43b076abac75"}]}] Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ListServerFiltersTestJSON-298500262 Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: c3c72a0ce1094ac2a3af43b076abac75 Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-298500262 Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ListServerFiltersTestJSON-298500262-project Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 251a6ad03ee24285aa5f7f0efd74c7ac Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ListServerFiltersTestJSON-298500262-project Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1706303741", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "73860823-05c1-4d23-b7c0-6204dbac5f05"}]}} Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ListServerFiltersTestJSON-instance-1706303741', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '73860823-05c1-4d23-b7c0-6204dbac5f05'}]}}} Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:37:56.290160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-34aaa28f-9adc-4146-9fde-f3949b685ccc) Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:56.301572 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6785d883-f19f-4f9c-972a-bffbf17093ac tempest-ListServerFiltersTestJSON-298500262 tempest-ListServerFiltersTestJSON-298500262-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:56.314097 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6785d883-f19f-4f9c-972a-bffbf17093ac tempest-ListServerFiltersTestJSON-298500262 tempest-ListServerFiltersTestJSON-298500262-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.805508 Oct 04 20:37:56.319549 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 482/940] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:54 2022] POST /compute/v2.1/servers => generated 214 bytes in 1826 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:37:56.331829 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-299b65ed-699c-4ecd-86e5-43cac6d016ea tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:56.334199 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-299b65ed-699c-4ecd-86e5-43cac6d016ea tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:56.353830 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-299b65ed-699c-4ecd-86e5-43cac6d016ea tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.363600 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-299b65ed-699c-4ecd-86e5-43cac6d016ea tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.364711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-299b65ed-699c-4ecd-86e5-43cac6d016ea tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.366102 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-299b65ed-699c-4ecd-86e5-43cac6d016ea tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.368490 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-299b65ed-699c-4ecd-86e5-43cac6d016ea tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.369345 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-299b65ed-699c-4ecd-86e5-43cac6d016ea tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.381360 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1464db92-8918-4463-afb2-3cd7c29128e1 tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/4f5f3da5-25ec-4c41-a0bb-6a4fc55405c5" status: 202 len: 0 microversion: 2.1 time: 1.241139 Oct 04 20:37:56.383340 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 459/941] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:37:55 2022] DELETE /compute/v2.1/os-security-groups/4f5f3da5-25ec-4c41-a0bb-6a4fc55405c5 => generated 0 bytes in 1245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:56.409892 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-69b57536-e85c-4b0a-992e-f26ff92b8576 tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] Calling method '.version_select at 0x7f77eef638b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:57.849176 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-299b65ed-699c-4ecd-86e5-43cac6d016ea tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1618 microversion: 2.1 time: 1.527883 Oct 04 20:37:57.854855 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 483/942] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:56 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1618 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:57.889296 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-69b57536-e85c-4b0a-992e-f26ff92b8576 tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.493737 Oct 04 20:37:57.890433 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 460/943] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Oct 4 20:37:56 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:37:57.914438 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-10587b2c-fadf-49ec-a2ef-1cd1dda6a92c tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Calling method '.version_select at 0x7f77ef9dec10>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:57.915988 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9ceb44bd-7cc7-461f-bc72-16e23cfc72ed tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] Calling method '.version_select at 0x7f77eef62280>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:58.219059 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:59.238103 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9ceb44bd-7cc7-461f-bc72-16e23cfc72ed tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 1.332631 Oct 04 20:37:59.247192 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 461/944] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 4 20:37:57 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:37:59.262514 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-961276796", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "50c29121-e094-4132-8ef4-b4c28da9df8a"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:59.389545 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:59.897325 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-10587b2c-fadf-49ec-a2ef-1cd1dda6a92c tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/04f8da55-f451-43e3-9ea3-e9ea44afecd8" status: 202 len: 0 microversion: 2.1 time: 2.031777 Oct 04 20:37:59.898719 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 484/945] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:37:57 2022] DELETE /compute/v2.1/os-security-groups/04f8da55-f451-43e3-9ea3-e9ea44afecd8 => generated 0 bytes in 2044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:59.925500 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-afd09d52-1e8f-4843-a0f4-1442dbf3ce7d tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] Calling method '.version_select at 0x7f77ef2c1670>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:00.628022 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=12 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:01.382757 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:38:01.385459 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:38:01.386929 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:38:01.389040 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:38:01.390161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:38:01.429522 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:01.434712 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:01.436845 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:01.439360 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:01.448893 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:01.450142 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:01.577233 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for project 70436b8b504e43dc882f5ee434ecf443. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:01.609031 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Getting quotas for user 5bda0ce3a36747c69b4a78e558a03b1b and project 70436b8b504e43dc882f5ee434ecf443. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:01.649558 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:38:01.701767 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:01.993830 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-130d93d1-87bb-4a08-b877-ee76b61390ab tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.751068 Oct 04 20:38:01.996031 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 462/946] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:38:02.021541 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5bf5e66d-ed32-4a71-bfbb-4b05729bc06d tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Calling method '.version_select at 0x7f77eef5e430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:03.751619 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5bf5e66d-ed32-4a71-bfbb-4b05729bc06d tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/19c7289e-7f5b-4877-ac06-3ca00c4ba868" status: 202 len: 0 microversion: 2.1 time: 1.752950 Oct 04 20:38:03.753379 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 463/947] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:38:01 2022] DELETE /compute/v2.1/os-security-groups/19c7289e-7f5b-4877-ac06-3ca00c4ba868 => generated 0 bytes in 1757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:38:04.382847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a7b0ce15-bfbe-47dc-b3f9-5c9591f1bc05 tempest-QuotaClassesAdminTestJSON-1287482125 tempest-QuotaClassesAdminTestJSON-1287482125-project-admin] Calling method '.version_select at 0x7f77eef63c10>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:04.492975 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a7b0ce15-bfbe-47dc-b3f9-5c9591f1bc05 tempest-QuotaClassesAdminTestJSON-1287482125 tempest-QuotaClassesAdminTestJSON-1287482125-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.737156 Oct 04 20:38:04.497212 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 464/948] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 4 20:38:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:04.522010 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-829f8510-616b-4b27-bc33-cb2ec6068c56 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:04.527561 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-829f8510-616b-4b27-bc33-cb2ec6068c56 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:04.550232 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-829f8510-616b-4b27-bc33-cb2ec6068c56 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.563277 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-829f8510-616b-4b27-bc33-cb2ec6068c56 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.565935 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-829f8510-616b-4b27-bc33-cb2ec6068c56 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.571185 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-829f8510-616b-4b27-bc33-cb2ec6068c56 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.576187 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-829f8510-616b-4b27-bc33-cb2ec6068c56 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.578482 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-829f8510-616b-4b27-bc33-cb2ec6068c56 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.220697 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-829f8510-616b-4b27-bc33-cb2ec6068c56 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:05.269899 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-829f8510-616b-4b27-bc33-cb2ec6068c56 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1220 microversion: 2.1 time: 0.764247 Oct 04 20:38:05.290124 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 465/949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:04 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1220 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:05.318985 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-afd09d52-1e8f-4843-a0f4-1442dbf3ce7d tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/ba8d8ae4-4bee-47d6-a374-4c6481d09ca9" status: 202 len: 0 microversion: 2.1 time: 5.418381 Oct 04 20:38:05.321424 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 485/950] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:37:59 2022] DELETE /compute/v2.1/os-floating-ips/ba8d8ae4-4bee-47d6-a374-4c6481d09ca9 => generated 0 bytes in 5422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:38:05.336321 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-11336963-6e0c-435f-aad5-be38f2ddb0ad tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] Calling method '.version_select at 0x7f77eef5eca0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:05.354465 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bafd9c69-2062-4682-9527-81c3c6920735 tempest-QuotaClassesAdminTestJSON-1287482125 tempest-QuotaClassesAdminTestJSON-1287482125-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef9973a0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:05.458752 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=7 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:06.336631 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-11336963-6e0c-435f-aad5-be38f2ddb0ad tempest-SecurityGroupRulesNegativeTestJSON-486850209 tempest-SecurityGroupRulesNegativeTestJSON-486850209-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/5915da87-e704-42fd-afe1-555220d3602e" status: 202 len: 0 microversion: 2.1 time: 1.043904 Oct 04 20:38:06.343430 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 466/951] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:38:05 2022] DELETE /compute/v2.1/os-security-groups/5915da87-e704-42fd-afe1-555220d3602e => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:38:06.359887 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8f2a5453-0996-49db-9412-a1e3b4511f3d tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] Calling method '.version_select at 0x7f77eef7f280>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:07.676223 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bafd9c69-2062-4682-9527-81c3c6920735 tempest-QuotaClassesAdminTestJSON-1287482125 tempest-QuotaClassesAdminTestJSON-1287482125-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 2.349605 Oct 04 20:38:07.676223 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 486/952] 10.222.0.78 () {60 vars in 1206 bytes} [Tue Oct 4 20:38:05 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 2353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:07.737923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0e4b0d42-8b34-4afb-a63f-b157be5ad445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:07.747425 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0e4b0d42-8b34-4afb-a63f-b157be5ad445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:07.801336 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e4b0d42-8b34-4afb-a63f-b157be5ad445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.810448 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e4b0d42-8b34-4afb-a63f-b157be5ad445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.813232 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e4b0d42-8b34-4afb-a63f-b157be5ad445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.815535 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e4b0d42-8b34-4afb-a63f-b157be5ad445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.825864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e4b0d42-8b34-4afb-a63f-b157be5ad445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.828318 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e4b0d42-8b34-4afb-a63f-b157be5ad445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.829742 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=37 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:08.375904 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0e4b0d42-8b34-4afb-a63f-b157be5ad445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:08.443330 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0e4b0d42-8b34-4afb-a63f-b157be5ad445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1276 microversion: 2.1 time: 0.726336 Oct 04 20:38:08.444809 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 487/953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:07 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1276 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:08.473974 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4d4f398c-bd9a-4098-8e3f-49503fdf29f3 tempest-QuotaClassesAdminTestJSON-1287482125 tempest-QuotaClassesAdminTestJSON-1287482125-project-admin] Calling method '.version_select at 0x7f77ef681280>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:08.560361 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4d4f398c-bd9a-4098-8e3f-49503fdf29f3 tempest-QuotaClassesAdminTestJSON-1287482125 tempest-QuotaClassesAdminTestJSON-1287482125-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.067752 Oct 04 20:38:08.560361 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 488/954] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 4 20:38:08 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:08.579369 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bdbf07d6-929e-478b-9cca-94a1d14a7382 tempest-QuotaClassesAdminTestJSON-1287482125 tempest-QuotaClassesAdminTestJSON-1287482125-project-admin] Action: 'update', calling method: .version_select at 0x7f77ef2f6160>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:10.411922 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bdbf07d6-929e-478b-9cca-94a1d14a7382 tempest-QuotaClassesAdminTestJSON-1287482125 tempest-QuotaClassesAdminTestJSON-1287482125-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.843017 Oct 04 20:38:10.432866 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 489/955] 10.222.0.78 () {60 vars in 1206 bytes} [Tue Oct 4 20:38:08 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:10.443937 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dadf0a7f-3dcd-4bb3-a1e0-b95b7f9f996f tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2c1a60>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:10.650047 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-dadf0a7f-3dcd-4bb3-a1e0-b95b7f9f996f tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/27cf760d-69b4-4924-8f8a-08fc005840b9" status: 200 len: 661 microversion: 2.1 time: 0.213370 Oct 04 20:38:10.663176 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 490/956] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:10 2022] GET /compute/v2.1/images/27cf760d-69b4-4924-8f8a-08fc005840b9 => generated 661 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:10.672067 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-70dbaf5c-f8ed-48fb-abc4-c53d82540bb7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:10.674226 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-70dbaf5c-f8ed-48fb-abc4-c53d82540bb7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:10.694838 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70dbaf5c-f8ed-48fb-abc4-c53d82540bb7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.697761 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70dbaf5c-f8ed-48fb-abc4-c53d82540bb7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.699561 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70dbaf5c-f8ed-48fb-abc4-c53d82540bb7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.707845 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70dbaf5c-f8ed-48fb-abc4-c53d82540bb7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.707845 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70dbaf5c-f8ed-48fb-abc4-c53d82540bb7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.707845 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70dbaf5c-f8ed-48fb-abc4-c53d82540bb7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:11.047959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-70dbaf5c-f8ed-48fb-abc4-c53d82540bb7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:11.072866 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-70dbaf5c-f8ed-48fb-abc4-c53d82540bb7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1274 microversion: 2.1 time: 0.417875 Oct 04 20:38:11.088137 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 491/957] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:10 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1274 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:11.503213 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:12.222390 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-89a05e65-1e2f-4ae6-9764-ee546512e126 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-284784508", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "17942c9d-fde3-45c6-9039-236894629c55"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:12.359767 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-89a05e65-1e2f-4ae6-9764-ee546512e126 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] validate_networks() for [('17942c9d-fde3-45c6-9039-236894629c55', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-89a05e65-1e2f-4ae6-9764-ee546512e126 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cb1bf86d-cd8d-4ccf-a6b8-56b2ad77ce7b) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:38:13.625608 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cb1bf86d-cd8d-4ccf-a6b8-56b2ad77ce7b) Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-89a05e65-1e2f-4ae6-9764-ee546512e126 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:13.637249 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-89a05e65-1e2f-4ae6-9764-ee546512e126 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Request method failure captured: Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 199 Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJmx0Ci1pR8bugFf9T77ekbLZyQsk3LtNAOowILpgr90BgswK2Dhe8ElIwB9O_tswrZDFgmscJxjKxYxFQ6zGjNdhe7nuzpHjuxljRrcRK2FMgncadVkbNTP7ZHMm7oNTyKMcT1Crfv2MhPAW_BsL0wV3p9oJv7us2wOUJzF950wiwY Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 1d50f961abf54801bd03d5551f45b8be Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ImagesTestJSON-1337949915 Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1d50f961abf54801bd03d5551f45b8be", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1d50f961abf54801bd03d5551f45b8be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1d50f961abf54801bd03d5551f45b8be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1d50f961abf54801bd03d5551f45b8be"}]}] Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ImagesTestJSON-1337949915 Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 1d50f961abf54801bd03d5551f45b8be Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ImagesTestJSON-1337949915 Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ImagesTestJSON-1337949915-project Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 682727ddf79c4a27a28ce32301564d34 Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ImagesTestJSON-1337949915-project Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ImagesTestJSON-server-284784508", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "17942c9d-fde3-45c6-9039-236894629c55"}]}} Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-284784508', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '17942c9d-fde3-45c6-9039-236894629c55'}]}}} Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:38:13.647102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cb1bf86d-cd8d-4ccf-a6b8-56b2ad77ce7b) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:38:13.662519 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-89a05e65-1e2f-4ae6-9764-ee546512e126 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-89a05e65-1e2f-4ae6-9764-ee546512e126 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.575600 Oct 04 20:38:13.674244 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 492/958] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:11 2022] POST /compute/v2.1/servers => generated 214 bytes in 2578 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:38:13.704621 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-15bab020-e512-435c-8494-5a2ae877eab9 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef681a60>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:13.812203 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-15bab020-e512-435c-8494-5a2ae877eab9 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/27cf760d-69b4-4924-8f8a-08fc005840b9" status: 200 len: 661 microversion: 2.1 time: 0.133737 Oct 04 20:38:13.814365 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 493/959] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:13 2022] GET /compute/v2.1/images/27cf760d-69b4-4924-8f8a-08fc005840b9 => generated 661 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:13.827732 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a1f67859-4b34-45f3-aeb4-f18e21d9e7b9 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:13.832908 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a1f67859-4b34-45f3-aeb4-f18e21d9e7b9 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:13.849004 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1f67859-4b34-45f3-aeb4-f18e21d9e7b9 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:13.850397 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1f67859-4b34-45f3-aeb4-f18e21d9e7b9 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:13.851653 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1f67859-4b34-45f3-aeb4-f18e21d9e7b9 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:13.855197 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1f67859-4b34-45f3-aeb4-f18e21d9e7b9 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:13.856619 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1f67859-4b34-45f3-aeb4-f18e21d9e7b9 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:13.857842 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1f67859-4b34-45f3-aeb4-f18e21d9e7b9 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:14.476478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=8 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:14.548246 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=11,nova_api:UPDATE=7 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:14.964386 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8f2a5453-0996-49db-9412-a1e3b4511f3d tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/f4593edf-8c5c-4ec8-9072-1b829ac91a5c" status: 202 len: 0 microversion: 2.1 time: 8.621811 Oct 04 20:38:14.972143 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 467/960] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:38:06 2022] DELETE /compute/v2.1/os-floating-ips/f4593edf-8c5c-4ec8-9072-1b829ac91a5c => generated 0 bytes in 8633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:38:14.994263 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3b939f90-6841-404f-b185-9fe161cc4649 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1272955016", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "17942c9d-fde3-45c6-9039-236894629c55"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:15.092984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a1f67859-4b34-45f3-aeb4-f18e21d9e7b9 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:15.144104 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a1f67859-4b34-45f3-aeb4-f18e21d9e7b9 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1316 microversion: 2.1 time: 1.316014 Oct 04 20:38:15.163966 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 494/961] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:13 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1316 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:15.222041 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-3b939f90-6841-404f-b185-9fe161cc4649 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] validate_networks() for [('17942c9d-fde3-45c6-9039-236894629c55', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:15.226411 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-18024c1c-64c4-4475-a855-6dfad183c383 tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] Calling method '.version_select at 0x7f77ef28c0d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:15.246429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=14 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-3b939f90-6841-404f-b185-9fe161cc4649 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-be3f7886-9d26-450f-a710-85c8e214edd5) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:38:18.672989 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-be3f7886-9d26-450f-a710-85c8e214edd5) Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-3b939f90-6841-404f-b185-9fe161cc4649 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:18.684393 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3b939f90-6841-404f-b185-9fe161cc4649 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Request method failure captured: Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 200 Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJmx0Ci1pR8bugFf9T77ekbLZyQsk3LtNAOowILpgr90BgswK2Dhe8ElIwB9O_tswrZDFgmscJxjKxYxFQ6zGjNdhe7nuzpHjuxljRrcRK2FMgncadVkbNTP7ZHMm7oNTyKMcT1Crfv2MhPAW_BsL0wV3p9oJv7us2wOUJzF950wiwY Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 1d50f961abf54801bd03d5551f45b8be Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesTestJSON-1337949915 Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1d50f961abf54801bd03d5551f45b8be", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1d50f961abf54801bd03d5551f45b8be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1d50f961abf54801bd03d5551f45b8be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1d50f961abf54801bd03d5551f45b8be"}]}] Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesTestJSON-1337949915 Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 1d50f961abf54801bd03d5551f45b8be Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesTestJSON-1337949915 Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesTestJSON-1337949915-project Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 682727ddf79c4a27a28ce32301564d34 Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesTestJSON-1337949915-project Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ImagesTestJSON-server-1272955016", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "17942c9d-fde3-45c6-9039-236894629c55"}]}} Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-1272955016', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '17942c9d-fde3-45c6-9039-236894629c55'}]}}} Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:38:18.689138 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-be3f7886-9d26-450f-a710-85c8e214edd5) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:38:18.701354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3b939f90-6841-404f-b185-9fe161cc4649 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3b939f90-6841-404f-b185-9fe161cc4649 tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.716752 Oct 04 20:38:18.714270 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 468/962] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 3721 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:38:18.723396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e50096fc-e48e-489a-a1e1-4b450d1362c6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:18.723396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e50096fc-e48e-489a-a1e1-4b450d1362c6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:18.750288 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e50096fc-e48e-489a-a1e1-4b450d1362c6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:18.751318 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e50096fc-e48e-489a-a1e1-4b450d1362c6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:18.752123 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e50096fc-e48e-489a-a1e1-4b450d1362c6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:18.753607 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e50096fc-e48e-489a-a1e1-4b450d1362c6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:18.754492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e50096fc-e48e-489a-a1e1-4b450d1362c6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:18.755331 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e50096fc-e48e-489a-a1e1-4b450d1362c6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:20.402612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:20.733491 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e50096fc-e48e-489a-a1e1-4b450d1362c6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:20.772471 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e50096fc-e48e-489a-a1e1-4b450d1362c6 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1316 microversion: 2.1 time: 2.077097 Oct 04 20:38:20.774087 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 469/963] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:18 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1316 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:20.831392 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6c888fd7-e752-449c-a543-2be663c3ca80 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eef1e1f0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:20.992114 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6c888fd7-e752-449c-a543-2be663c3ca80 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/fa153043-0b63-469f-b782-43b9fe9d0813" status: 200 len: 662 microversion: 2.1 time: 0.190611 Oct 04 20:38:20.993467 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 470/964] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:20 2022] GET /compute/v2.1/images/fa153043-0b63-469f-b782-43b9fe9d0813 => generated 662 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:21.013777 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-38e2cd31-36af-44fd-a833-5d39a1a9c15b tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-246367655", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "17942c9d-fde3-45c6-9039-236894629c55"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:21.244552 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-38e2cd31-36af-44fd-a833-5d39a1a9c15b tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] validate_networks() for [('17942c9d-fde3-45c6-9039-236894629c55', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-38e2cd31-36af-44fd-a833-5d39a1a9c15b tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8afcf4a9-1547-468e-9a71-4081fad8f704) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:38:23.169734 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8afcf4a9-1547-468e-9a71-4081fad8f704) Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-38e2cd31-36af-44fd-a833-5d39a1a9c15b tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:23.176713 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-38e2cd31-36af-44fd-a833-5d39a1a9c15b tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Request method failure captured: Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 199 Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJmx0Ci1pR8bugFf9T77ekbLZyQsk3LtNAOowILpgr90BgswK2Dhe8ElIwB9O_tswrZDFgmscJxjKxYxFQ6zGjNdhe7nuzpHjuxljRrcRK2FMgncadVkbNTP7ZHMm7oNTyKMcT1Crfv2MhPAW_BsL0wV3p9oJv7us2wOUJzF950wiwY Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 1d50f961abf54801bd03d5551f45b8be Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesTestJSON-1337949915 Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1d50f961abf54801bd03d5551f45b8be", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1d50f961abf54801bd03d5551f45b8be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1d50f961abf54801bd03d5551f45b8be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1d50f961abf54801bd03d5551f45b8be"}]}] Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesTestJSON-1337949915 Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 1d50f961abf54801bd03d5551f45b8be Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesTestJSON-1337949915 Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesTestJSON-1337949915-project Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 682727ddf79c4a27a28ce32301564d34 Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesTestJSON-1337949915-project Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ImagesTestJSON-server-246367655", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "17942c9d-fde3-45c6-9039-236894629c55"}]}} Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-246367655', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '17942c9d-fde3-45c6-9039-236894629c55'}]}}} Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:38:23.195630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8afcf4a9-1547-468e-9a71-4081fad8f704) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:38:23.204502 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-38e2cd31-36af-44fd-a833-5d39a1a9c15b tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-38e2cd31-36af-44fd-a833-5d39a1a9c15b tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.202165 Oct 04 20:38:23.221705 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 471/965] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 2220 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:38:23.246445 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2890dcf0-a0ba-4643-abcb-a173fe62b0df tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef168310>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:23.473536 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2890dcf0-a0ba-4643-abcb-a173fe62b0df tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/fa153043-0b63-469f-b782-43b9fe9d0813" status: 200 len: 662 microversion: 2.1 time: 0.256375 Oct 04 20:38:23.474611 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 472/966] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:23 2022] GET /compute/v2.1/images/fa153043-0b63-469f-b782-43b9fe9d0813 => generated 662 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:23.513694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2605a37a-08ca-48c9-89fc-d7720f7f6233 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:23.514664 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2605a37a-08ca-48c9-89fc-d7720f7f6233 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:23.547720 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2605a37a-08ca-48c9-89fc-d7720f7f6233 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.557064 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2605a37a-08ca-48c9-89fc-d7720f7f6233 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.558013 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2605a37a-08ca-48c9-89fc-d7720f7f6233 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.559438 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2605a37a-08ca-48c9-89fc-d7720f7f6233 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.560289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2605a37a-08ca-48c9-89fc-d7720f7f6233 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.569539 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2605a37a-08ca-48c9-89fc-d7720f7f6233 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.576654 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-18024c1c-64c4-4475-a855-6dfad183c383 tempest-FloatingIPDetailsTestJSON-923652462 tempest-FloatingIPDetailsTestJSON-923652462-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/39d36b41-0315-4928-b287-9f1f9c94fd0e" status: 202 len: 0 microversion: 2.1 time: 8.386337 Oct 04 20:38:23.585942 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 495/967] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:38:15 2022] DELETE /compute/v2.1/os-floating-ips/39d36b41-0315-4928-b287-9f1f9c94fd0e => generated 0 bytes in 8417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:38:23.596984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-de1ee9ce-f4f2-4340-ab3f-b92a5528d8f5 req-0d6f2082-83eb-4fff-b9f0-5d3daf2ef9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451e57ea-f708-47a1-9ee7-a826357c8b68", "tag": "d8a76343-fb5c-4c62-9138-2da5de84b62c"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:23.694610 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-de1ee9ce-f4f2-4340-ab3f-b92a5528d8f5 req-0d6f2082-83eb-4fff-b9f0-5d3daf2ef9b5 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.700027 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-de1ee9ce-f4f2-4340-ab3f-b92a5528d8f5 req-0d6f2082-83eb-4fff-b9f0-5d3daf2ef9b5 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.705464 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-de1ee9ce-f4f2-4340-ab3f-b92a5528d8f5 req-0d6f2082-83eb-4fff-b9f0-5d3daf2ef9b5 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.839098 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-de1ee9ce-f4f2-4340-ab3f-b92a5528d8f5 req-0d6f2082-83eb-4fff-b9f0-5d3daf2ef9b5 service nova] Creating event network-changed:d8a76343-fb5c-4c62-9138-2da5de84b62c for instance 451e57ea-f708-47a1-9ee7-a826357c8b68 on n-h2-852085-12 Oct 04 20:38:23.880812 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-de1ee9ce-f4f2-4340-ab3f-b92a5528d8f5 req-0d6f2082-83eb-4fff-b9f0-5d3daf2ef9b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281804 Oct 04 20:38:23.880812 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 496/968] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:23.904324 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-aa91a166-481b-46c6-9d58-af6d605d76ef tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-403423420", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "17942c9d-fde3-45c6-9039-236894629c55"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:24.113156 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-aa91a166-481b-46c6-9d58-af6d605d76ef tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] validate_networks() for [('17942c9d-fde3-45c6-9039-236894629c55', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:25.868642 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2605a37a-08ca-48c9-89fc-d7720f7f6233 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:25.891278 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2605a37a-08ca-48c9-89fc-d7720f7f6233 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1316 microversion: 2.1 time: 2.400460 Oct 04 20:38:25.913196 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 473/969] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:23 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1316 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-aa91a166-481b-46c6-9d58-af6d605d76ef tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ff12bd93-5a6b-400a-ad73-1ef718dcfaa1) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:38:26.209367 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ff12bd93-5a6b-400a-ad73-1ef718dcfaa1) Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-aa91a166-481b-46c6-9d58-af6d605d76ef tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-aa91a166-481b-46c6-9d58-af6d605d76ef tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Request method failure captured: Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 199 Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJmx0Ci1pR8bugFf9T77ekbLZyQsk3LtNAOowILpgr90BgswK2Dhe8ElIwB9O_tswrZDFgmscJxjKxYxFQ6zGjNdhe7nuzpHjuxljRrcRK2FMgncadVkbNTP7ZHMm7oNTyKMcT1Crfv2MhPAW_BsL0wV3p9oJv7us2wOUJzF950wiwY Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 1d50f961abf54801bd03d5551f45b8be Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ImagesTestJSON-1337949915 Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1d50f961abf54801bd03d5551f45b8be", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1d50f961abf54801bd03d5551f45b8be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1d50f961abf54801bd03d5551f45b8be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1d50f961abf54801bd03d5551f45b8be"}]}] Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ImagesTestJSON-1337949915 Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 1d50f961abf54801bd03d5551f45b8be Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ImagesTestJSON-1337949915 Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ImagesTestJSON-1337949915-project Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 682727ddf79c4a27a28ce32301564d34 Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ImagesTestJSON-1337949915-project Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ImagesTestJSON-server-403423420", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "17942c9d-fde3-45c6-9039-236894629c55"}]}} Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-403423420', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '17942c9d-fde3-45c6-9039-236894629c55'}]}}} Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:26.222675 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:38:26.233267 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ff12bd93-5a6b-400a-ad73-1ef718dcfaa1) Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-aa91a166-481b-46c6-9d58-af6d605d76ef tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-aa91a166-481b-46c6-9d58-af6d605d76ef tempest-ImagesTestJSON-1337949915 tempest-ImagesTestJSON-1337949915-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.340828 Oct 04 20:38:26.250375 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 497/970] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:23 2022] POST /compute/v2.1/servers => generated 214 bytes in 2358 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:38:26.879262 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1159814077", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:26.963546 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cb4d8e92-d350-4ac1-b13d-31086c4ce505 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:26.966157 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-cb4d8e92-d350-4ac1-b13d-31086c4ce505 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:26.985453 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb4d8e92-d350-4ac1-b13d-31086c4ce505 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:26.986412 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb4d8e92-d350-4ac1-b13d-31086c4ce505 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:26.995093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb4d8e92-d350-4ac1-b13d-31086c4ce505 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:27.000289 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb4d8e92-d350-4ac1-b13d-31086c4ce505 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:27.000289 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb4d8e92-d350-4ac1-b13d-31086c4ce505 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:27.000289 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb4d8e92-d350-4ac1-b13d-31086c4ce505 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:27.665221 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-cb4d8e92-d350-4ac1-b13d-31086c4ce505 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:27.689662 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cb4d8e92-d350-4ac1-b13d-31086c4ce505 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1316 microversion: 2.1 time: 0.738374 Oct 04 20:38:27.703266 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 498/971] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:26 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1316 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:28.147966 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4e4460b3-22c3-4814-b66a-a9318ff1df4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77efab1820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:28.290547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:28.329659 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4e4460b3-22c3-4814-b66a-a9318ff1df4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/829d0df1-ae76-4afe-9c6c-de0f2a16fea8" status: 200 len: 661 microversion: 2.1 time: 0.195643 Oct 04 20:38:28.335630 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 499/972] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:28 2022] GET /compute/v2.1/images/829d0df1-ae76-4afe-9c6c-de0f2a16fea8 => generated 661 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:38:28.360863 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1dbe13d2-2b67-46e2-b85c-405fca7d0218 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28cee0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:28.491365 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1dbe13d2-2b67-46e2-b85c-405fca7d0218 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/829d0df1-ae76-4afe-9c6c-de0f2a16fea8" status: 200 len: 661 microversion: 2.1 time: 0.134494 Oct 04 20:38:28.497472 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 500/973] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:28 2022] GET /compute/v2.1/images/829d0df1-ae76-4afe-9c6c-de0f2a16fea8 => generated 661 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:38:28.740337 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9c6545a1-69b9-4236-b241-d7386e98d4da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:28.758425 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9c6545a1-69b9-4236-b241-d7386e98d4da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:28.794420 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c6545a1-69b9-4236-b241-d7386e98d4da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.797859 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c6545a1-69b9-4236-b241-d7386e98d4da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.799982 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c6545a1-69b9-4236-b241-d7386e98d4da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.816228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c6545a1-69b9-4236-b241-d7386e98d4da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.816228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c6545a1-69b9-4236-b241-d7386e98d4da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.816228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9c6545a1-69b9-4236-b241-d7386e98d4da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.129128 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:38:29.130911 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:38:29.132469 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:38:29.134041 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:38:29.142331 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:38:29.182544 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:29.185315 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:29.192122 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.198908 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:29.200990 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:29.204279 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.329340 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Getting quotas for project 7129909d365645369fbe27a2fd00fc88. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:29.374535 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Getting quotas for user 96f056a5a16e449385f1b503e1d2231a and project 7129909d365645369fbe27a2fd00fc88. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:29.433108 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:38:29.444377 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:29.942891 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d3e2f65c-83cd-4573-b68d-47d513baa255 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.534414 Oct 04 20:38:29.944509 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 474/974] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:38:29.968314 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-273189643", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:30.203053 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:30.207829 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9c6545a1-69b9-4236-b241-d7386e98d4da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:30.262017 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9c6545a1-69b9-4236-b241-d7386e98d4da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1316 microversion: 2.1 time: 1.529274 Oct 04 20:38:30.267177 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 501/975] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:28 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1316 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:30.284792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9e628bb1-adc0-4c03-b401-ba6cf177a3ad tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:30.285949 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9e628bb1-adc0-4c03-b401-ba6cf177a3ad tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:30.908082 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9e628bb1-adc0-4c03-b401-ba6cf177a3ad tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:30.940284 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9e628bb1-adc0-4c03-b401-ba6cf177a3ad tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1223 microversion: 2.1 time: 0.656804 Oct 04 20:38:30.942824 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 502/976] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:30 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1223 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:31.320253 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7502b174-d87d-4ea5-8e2c-d6ed71b147c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:31.353589 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7502b174-d87d-4ea5-8e2c-d6ed71b147c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:31.394916 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7502b174-d87d-4ea5-8e2c-d6ed71b147c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.400642 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7502b174-d87d-4ea5-8e2c-d6ed71b147c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.401967 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7502b174-d87d-4ea5-8e2c-d6ed71b147c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.404428 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7502b174-d87d-4ea5-8e2c-d6ed71b147c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.441294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7502b174-d87d-4ea5-8e2c-d6ed71b147c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.442897 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7502b174-d87d-4ea5-8e2c-d6ed71b147c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:32.778468 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7502b174-d87d-4ea5-8e2c-d6ed71b147c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:32.823592 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7502b174-d87d-4ea5-8e2c-d6ed71b147c0 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1316 microversion: 2.1 time: 1.502220 Oct 04 20:38:32.823592 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 503/977] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:31 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1316 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:32.857447 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0e62ab8c-6458-4526-b0a1-3b8ea724f8ec tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:32.858710 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0e62ab8c-6458-4526-b0a1-3b8ea724f8ec tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:32.887349 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e62ab8c-6458-4526-b0a1-3b8ea724f8ec tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:32.897988 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e62ab8c-6458-4526-b0a1-3b8ea724f8ec tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:32.903497 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e62ab8c-6458-4526-b0a1-3b8ea724f8ec tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:32.912724 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e62ab8c-6458-4526-b0a1-3b8ea724f8ec tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:32.913984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e62ab8c-6458-4526-b0a1-3b8ea724f8ec tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:32.915111 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e62ab8c-6458-4526-b0a1-3b8ea724f8ec tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:33.017105 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:38:33.018680 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:38:33.019916 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:38:33.020861 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:38:33.023536 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:38:33.067103 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:33.068474 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:33.069709 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:33.075467 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:33.076819 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:33.077995 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:33.165379 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0e62ab8c-6458-4526-b0a1-3b8ea724f8ec tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:33.174182 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Getting quotas for project b46055f08aae47a99a59e1192db71b8e. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:33.195633 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0e62ab8c-6458-4526-b0a1-3b8ea724f8ec tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1227 microversion: 2.1 time: 0.366211 Oct 04 20:38:33.213247 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 504/978] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:32 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1227 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:33.220560 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Getting quotas for user 5e0144899b8946309d4524a4cf515d98 and project b46055f08aae47a99a59e1192db71b8e. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:33.300823 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:38:33.318257 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:33.525685 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fe2f3809-4761-418f-b34c-5de19ebfff08 tempest-ServerRescueTestJSON-1044155650 tempest-ServerRescueTestJSON-1044155650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2063623361", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:33.550597 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c169e58a-7e90-48f1-bbad-95937e134e95 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.601227 Oct 04 20:38:33.553228 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 475/979] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:38:33.604249 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:UPDATE=24,nova_api:SELECT=69,nova_api:INSERT=7 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:33.854026 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2058885325", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:33.910793 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-fe2f3809-4761-418f-b34c-5de19ebfff08 tempest-ServerRescueTestJSON-1044155650 tempest-ServerRescueTestJSON-1044155650-project] validate_networks() for [('803d74c8-22bd-4a6c-82d8-765a83711179', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:34.182390 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:38.118215 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:38:38.119270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:38:38.119592 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:38:38.120192 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:38:38.120803 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:38:38.203106 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.204085 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.204851 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.206319 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.228754 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.229757 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-fe2f3809-4761-418f-b34c-5de19ebfff08 tempest-ServerRescueTestJSON-1044155650 tempest-ServerRescueTestJSON-1044155650-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f9465c8d-8ff1-4c96-8517-3b7055c34c2d) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:38:38.318616 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f9465c8d-8ff1-4c96-8517-3b7055c34c2d) Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-fe2f3809-4761-418f-b34c-5de19ebfff08 tempest-ServerRescueTestJSON-1044155650 tempest-ServerRescueTestJSON-1044155650-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fe2f3809-4761-418f-b34c-5de19ebfff08 tempest-ServerRescueTestJSON-1044155650 tempest-ServerRescueTestJSON-1044155650-project] Request method failure captured: Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 238 Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJnI68PEu-v_YbY38vZa5klfxD3Deo9M-3MVAu0WK_Ue6MCEsXc3rfNArxynh3RhLM_epMaM2ivudnjOQ1WiE1fuGw-DENDIYuqw4MrTZv58FY_37mE4jqCui3Phlc8azL23BJZz4TaBGYI25y1xP7O2DFC0ScVSAtcZlj8U944Xp4E Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: f37d0edcedec45449d139180e2fec383 Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerRescueTestJSON-1044155650 Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f37d0edcedec45449d139180e2fec383", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f37d0edcedec45449d139180e2fec383"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f37d0edcedec45449d139180e2fec383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f37d0edcedec45449d139180e2fec383"}]}] Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerRescueTestJSON-1044155650 Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: f37d0edcedec45449d139180e2fec383 Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerRescueTestJSON-1044155650 Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerRescueTestJSON-1044155650-project Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: c35904ae44544c128474584457e43cca Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerRescueTestJSON-1044155650-project Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServerRescueTestJSON-server-2063623361", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "L0^__ZfQGv+fq2v", "networks": [{"uuid": "803d74c8-22bd-4a6c-82d8-765a83711179"}]}} Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueTestJSON-server-2063623361', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'L0^__ZfQGv+fq2v', 'networks': [{'uuid': '803d74c8-22bd-4a6c-82d8-765a83711179'}]}}} Oct 04 20:38:38.332102 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:38:38.339754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f9465c8d-8ff1-4c96-8517-3b7055c34c2d) Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fe2f3809-4761-418f-b34c-5de19ebfff08 tempest-ServerRescueTestJSON-1044155650 tempest-ServerRescueTestJSON-1044155650-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:38.351480 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fe2f3809-4761-418f-b34c-5de19ebfff08 tempest-ServerRescueTestJSON-1044155650 tempest-ServerRescueTestJSON-1044155650-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 5.131066 Oct 04 20:38:38.357405 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 505/980] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 5142 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:38:38.407377 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Getting quotas for project b46055f08aae47a99a59e1192db71b8e. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:38.423468 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Getting quotas for user 5e0144899b8946309d4524a4cf515d98 and project b46055f08aae47a99a59e1192db71b8e. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:38.452824 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:38:38.458367 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:38.836149 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2cabbc71-8d09-4c03-8e37-ea171a99526d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:38.852731 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2cabbc71-8d09-4c03-8e37-ea171a99526d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:38.914918 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2cabbc71-8d09-4c03-8e37-ea171a99526d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.916902 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2e3ee8bd-da5a-4689-a639-de4360ce8e55 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.095221 Oct 04 20:38:38.919661 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2cabbc71-8d09-4c03-8e37-ea171a99526d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.921138 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2cabbc71-8d09-4c03-8e37-ea171a99526d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.931836 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 476/981] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 5101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:38:38.936903 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2cabbc71-8d09-4c03-8e37-ea171a99526d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.942755 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2cabbc71-8d09-4c03-8e37-ea171a99526d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.948348 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2cabbc71-8d09-4c03-8e37-ea171a99526d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.974821 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7a802a17-6bca-452a-8806-018198efbeae tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:38.975217 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7a802a17-6bca-452a-8806-018198efbeae tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:38.977300 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=45 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:39.031563 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7a802a17-6bca-452a-8806-018198efbeae tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.049579 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7a802a17-6bca-452a-8806-018198efbeae tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.049579 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7a802a17-6bca-452a-8806-018198efbeae tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.049579 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7a802a17-6bca-452a-8806-018198efbeae tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.049579 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7a802a17-6bca-452a-8806-018198efbeae tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.050754 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7a802a17-6bca-452a-8806-018198efbeae tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.981144 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7a802a17-6bca-452a-8806-018198efbeae tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:40.021686 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7a802a17-6bca-452a-8806-018198efbeae tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1281 microversion: 2.1 time: 1.097323 Oct 04 20:38:40.036560 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 477/982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:38 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1281 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:40.072535 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2100fce0-6e67-444a-b543-da7a2149d140 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:40.084210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2100fce0-6e67-444a-b543-da7a2149d140 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:40.663664 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2100fce0-6e67-444a-b543-da7a2149d140 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:40.694304 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2100fce0-6e67-444a-b543-da7a2149d140 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1218 microversion: 2.1 time: 0.651089 Oct 04 20:38:40.700574 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 478/983] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:40 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1218 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:40.916884 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:41.098203 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-de148711-14e0-4189-9be9-88ebd7a19ff9 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:41.106615 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-de148711-14e0-4189-9be9-88ebd7a19ff9 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:41.159471 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-de148711-14e0-4189-9be9-88ebd7a19ff9 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:41.184456 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-de148711-14e0-4189-9be9-88ebd7a19ff9 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:41.189882 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-de148711-14e0-4189-9be9-88ebd7a19ff9 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:41.210791 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-de148711-14e0-4189-9be9-88ebd7a19ff9 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:41.213965 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-de148711-14e0-4189-9be9-88ebd7a19ff9 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:41.226063 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-de148711-14e0-4189-9be9-88ebd7a19ff9 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.346626 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-2cabbc71-8d09-4c03-8e37-ea171a99526d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:42.369992 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2cabbc71-8d09-4c03-8e37-ea171a99526d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1316 microversion: 2.1 time: 4.009377 Oct 04 20:38:42.375245 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 506/984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:38 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1316 bytes in 4017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:42.406053 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-50ca02cd-6a8a-43d9-8249-c365aca17814 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:42.415518 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-50ca02cd-6a8a-43d9-8249-c365aca17814 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:42.442553 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-50ca02cd-6a8a-43d9-8249-c365aca17814 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.445172 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-50ca02cd-6a8a-43d9-8249-c365aca17814 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.446043 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-50ca02cd-6a8a-43d9-8249-c365aca17814 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.447820 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-50ca02cd-6a8a-43d9-8249-c365aca17814 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.449101 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-50ca02cd-6a8a-43d9-8249-c365aca17814 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.452419 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-50ca02cd-6a8a-43d9-8249-c365aca17814 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.496538 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-de148711-14e0-4189-9be9-88ebd7a19ff9 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:42.530380 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-de148711-14e0-4189-9be9-88ebd7a19ff9 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1281 microversion: 2.1 time: 1.451964 Oct 04 20:38:42.531716 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 479/985] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:41 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1281 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:43.287668 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-0e159417-becc-4167-81e4-6370b8d5e30a req-41fe5378-98d3-43e0-af34-3a0f7049e492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451e57ea-f708-47a1-9ee7-a826357c8b68", "name": "network-vif-plugged", "status": "completed", "tag": "d8a76343-fb5c-4c62-9138-2da5de84b62c"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:43.354805 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-0e159417-becc-4167-81e4-6370b8d5e30a req-41fe5378-98d3-43e0-af34-3a0f7049e492 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.357107 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-0e159417-becc-4167-81e4-6370b8d5e30a req-41fe5378-98d3-43e0-af34-3a0f7049e492 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.358973 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-0e159417-becc-4167-81e4-6370b8d5e30a req-41fe5378-98d3-43e0-af34-3a0f7049e492 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.417111 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-0e159417-becc-4167-81e4-6370b8d5e30a req-41fe5378-98d3-43e0-af34-3a0f7049e492 service nova] Creating event network-vif-plugged:d8a76343-fb5c-4c62-9138-2da5de84b62c for instance 451e57ea-f708-47a1-9ee7-a826357c8b68 on n-h2-852085-12 Oct 04 20:38:43.443705 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-0e159417-becc-4167-81e4-6370b8d5e30a req-41fe5378-98d3-43e0-af34-3a0f7049e492 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171856 Oct 04 20:38:43.461747 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 480/986] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:43.476189 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b4cd03a2-4de7-4297-9fa8-e9d4d58dc3a7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:43.477823 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b4cd03a2-4de7-4297-9fa8-e9d4d58dc3a7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:43.491306 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b4cd03a2-4de7-4297-9fa8-e9d4d58dc3a7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.493173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b4cd03a2-4de7-4297-9fa8-e9d4d58dc3a7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.494563 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b4cd03a2-4de7-4297-9fa8-e9d4d58dc3a7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.497068 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b4cd03a2-4de7-4297-9fa8-e9d4d58dc3a7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.499499 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b4cd03a2-4de7-4297-9fa8-e9d4d58dc3a7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.510678 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b4cd03a2-4de7-4297-9fa8-e9d4d58dc3a7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.532736 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-50ca02cd-6a8a-43d9-8249-c365aca17814 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:43.601537 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-50ca02cd-6a8a-43d9-8249-c365aca17814 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1222 microversion: 2.1 time: 1.222471 Oct 04 20:38:43.606302 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 507/987] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:42 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1222 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:43.636684 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b3c4acb0-d443-48ed-87e6-5a3d0c2fe23b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:43.638446 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b3c4acb0-d443-48ed-87e6-5a3d0c2fe23b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:43.711122 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3c4acb0-d443-48ed-87e6-5a3d0c2fe23b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.711122 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3c4acb0-d443-48ed-87e6-5a3d0c2fe23b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.711122 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3c4acb0-d443-48ed-87e6-5a3d0c2fe23b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.711122 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3c4acb0-d443-48ed-87e6-5a3d0c2fe23b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.711122 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3c4acb0-d443-48ed-87e6-5a3d0c2fe23b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.711122 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3c4acb0-d443-48ed-87e6-5a3d0c2fe23b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.479976 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b3c4acb0-d443-48ed-87e6-5a3d0c2fe23b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.507215 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b3c4acb0-d443-48ed-87e6-5a3d0c2fe23b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1281 microversion: 2.1 time: 0.894769 Oct 04 20:38:44.517143 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 508/988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:43 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1281 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:44.656786 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3c167545-2c6a-4480-aba5-83a03bbb5022 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:44.659335 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3c167545-2c6a-4480-aba5-83a03bbb5022 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:44.671670 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c167545-2c6a-4480-aba5-83a03bbb5022 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.687312 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c167545-2c6a-4480-aba5-83a03bbb5022 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.688559 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c167545-2c6a-4480-aba5-83a03bbb5022 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.690239 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c167545-2c6a-4480-aba5-83a03bbb5022 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.691567 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c167545-2c6a-4480-aba5-83a03bbb5022 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.692868 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c167545-2c6a-4480-aba5-83a03bbb5022 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.890349 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3c167545-2c6a-4480-aba5-83a03bbb5022 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.922244 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3c167545-2c6a-4480-aba5-83a03bbb5022 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1270 microversion: 2.1 time: 0.272644 Oct 04 20:38:44.925627 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 509/989] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:44 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1270 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:45.460488 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b4cd03a2-4de7-4297-9fa8-e9d4d58dc3a7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:45.498338 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b4cd03a2-4de7-4297-9fa8-e9d4d58dc3a7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1316 microversion: 2.1 time: 2.029298 Oct 04 20:38:45.503050 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 481/990] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:43 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1316 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:45.573915 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-70886110-21e9-4b1b-81b1-4b65fa55e449 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:45.576052 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-70886110-21e9-4b1b-81b1-4b65fa55e449 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:45.594316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70886110-21e9-4b1b-81b1-4b65fa55e449 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.595819 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70886110-21e9-4b1b-81b1-4b65fa55e449 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.596949 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70886110-21e9-4b1b-81b1-4b65fa55e449 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.598855 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70886110-21e9-4b1b-81b1-4b65fa55e449 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.600190 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70886110-21e9-4b1b-81b1-4b65fa55e449 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.603942 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-70886110-21e9-4b1b-81b1-4b65fa55e449 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.973363 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a6c2ea7d-bd69-4158-b871-c293474b4c76 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:45.978546 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a6c2ea7d-bd69-4158-b871-c293474b4c76 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:46.003267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a6c2ea7d-bd69-4158-b871-c293474b4c76 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.004391 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a6c2ea7d-bd69-4158-b871-c293474b4c76 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.005933 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a6c2ea7d-bd69-4158-b871-c293474b4c76 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.009254 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a6c2ea7d-bd69-4158-b871-c293474b4c76 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.010598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a6c2ea7d-bd69-4158-b871-c293474b4c76 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.012012 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a6c2ea7d-bd69-4158-b871-c293474b4c76 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.193889 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-70886110-21e9-4b1b-81b1-4b65fa55e449 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:46.227283 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-70886110-21e9-4b1b-81b1-4b65fa55e449 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1281 microversion: 2.1 time: 0.664740 Oct 04 20:38:46.231341 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 510/991] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:45 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1281 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:46.575534 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-07205999-e9ae-4c2a-825c-5f8b652b0833 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:46.577813 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-07205999-e9ae-4c2a-825c-5f8b652b0833 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:46.602011 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-07205999-e9ae-4c2a-825c-5f8b652b0833 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.605415 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-07205999-e9ae-4c2a-825c-5f8b652b0833 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.607849 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-07205999-e9ae-4c2a-825c-5f8b652b0833 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.610535 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-07205999-e9ae-4c2a-825c-5f8b652b0833 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.616403 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-07205999-e9ae-4c2a-825c-5f8b652b0833 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.622279 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-07205999-e9ae-4c2a-825c-5f8b652b0833 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.988366 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a6c2ea7d-bd69-4158-b871-c293474b4c76 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:47.021682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=43 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:47.036722 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a6c2ea7d-bd69-4158-b871-c293474b4c76 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1288 microversion: 2.1 time: 1.073684 Oct 04 20:38:47.040211 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 482/992] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:45 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1288 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:47.286402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-187f575c-2946-4cf9-9b8d-9e7d4793fc59 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:47.293130 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-187f575c-2946-4cf9-9b8d-9e7d4793fc59 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:47.307792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=9 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:47.332897 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-187f575c-2946-4cf9-9b8d-9e7d4793fc59 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.341155 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-187f575c-2946-4cf9-9b8d-9e7d4793fc59 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.342766 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-187f575c-2946-4cf9-9b8d-9e7d4793fc59 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.350200 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-187f575c-2946-4cf9-9b8d-9e7d4793fc59 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.370953 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-187f575c-2946-4cf9-9b8d-9e7d4793fc59 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.377491 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-187f575c-2946-4cf9-9b8d-9e7d4793fc59 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.867174 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-187f575c-2946-4cf9-9b8d-9e7d4793fc59 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:47.930821 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-187f575c-2946-4cf9-9b8d-9e7d4793fc59 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1281 microversion: 2.1 time: 0.661270 Oct 04 20:38:47.936120 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 483/993] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:47 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1281 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:48.101624 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-393955ef-b853-410c-9375-dc69f9a952d2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:48.104569 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-393955ef-b853-410c-9375-dc69f9a952d2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:48.152528 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-393955ef-b853-410c-9375-dc69f9a952d2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.152528 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-393955ef-b853-410c-9375-dc69f9a952d2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.152528 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-393955ef-b853-410c-9375-dc69f9a952d2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.156614 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-393955ef-b853-410c-9375-dc69f9a952d2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.157631 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-393955ef-b853-410c-9375-dc69f9a952d2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.157980 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-393955ef-b853-410c-9375-dc69f9a952d2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.305450 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=6 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:49.155654 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-393955ef-b853-410c-9375-dc69f9a952d2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:49.190053 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-07205999-e9ae-4c2a-825c-5f8b652b0833 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:49.197596 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-393955ef-b853-410c-9375-dc69f9a952d2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1276 microversion: 2.1 time: 1.121462 Oct 04 20:38:49.198440 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 484/994] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:48 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1276 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:49.227460 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-86eea3f8-2008-40cb-903f-63f9a822a2df tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:49.229004 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-86eea3f8-2008-40cb-903f-63f9a822a2df tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:49.246697 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-86eea3f8-2008-40cb-903f-63f9a822a2df tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:49.247896 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-07205999-e9ae-4c2a-825c-5f8b652b0833 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1316 microversion: 2.1 time: 2.687155 Oct 04 20:38:49.248779 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-86eea3f8-2008-40cb-903f-63f9a822a2df tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:49.250759 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 511/995] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:46 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1316 bytes in 2692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:49.262016 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-86eea3f8-2008-40cb-903f-63f9a822a2df tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:49.267678 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-86eea3f8-2008-40cb-903f-63f9a822a2df tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:49.272958 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-86eea3f8-2008-40cb-903f-63f9a822a2df tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:49.277279 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-86eea3f8-2008-40cb-903f-63f9a822a2df tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:50.254478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-86eea3f8-2008-40cb-903f-63f9a822a2df tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:50.280252 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d5e7b375-ec48-42a9-bbc9-39cc86bbd395 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:50.284265 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d5e7b375-ec48-42a9-bbc9-39cc86bbd395 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:50.306315 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-86eea3f8-2008-40cb-903f-63f9a822a2df tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 1.097129 Oct 04 20:38:50.307376 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 485/996] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:49 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:50.320800 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5e7b375-ec48-42a9-bbc9-39cc86bbd395 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:50.322286 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5e7b375-ec48-42a9-bbc9-39cc86bbd395 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:50.324214 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5e7b375-ec48-42a9-bbc9-39cc86bbd395 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:50.326960 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5e7b375-ec48-42a9-bbc9-39cc86bbd395 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:50.328452 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5e7b375-ec48-42a9-bbc9-39cc86bbd395 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:50.330184 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5ef2c894-94e2-4f72-be17-e8475bf98117 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:50.331742 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5e7b375-ec48-42a9-bbc9-39cc86bbd395 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:50.333465 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-5ef2c894-94e2-4f72-be17-e8475bf98117 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:50.363785 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5ef2c894-94e2-4f72-be17-e8475bf98117 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:50.365186 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5ef2c894-94e2-4f72-be17-e8475bf98117 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:50.366607 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5ef2c894-94e2-4f72-be17-e8475bf98117 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:50.372693 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5ef2c894-94e2-4f72-be17-e8475bf98117 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:50.382485 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5ef2c894-94e2-4f72-be17-e8475bf98117 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:50.383783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5ef2c894-94e2-4f72-be17-e8475bf98117 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:50.673613 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=20 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:51.333455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-d5e7b375-ec48-42a9-bbc9-39cc86bbd395 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:51.368627 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d5e7b375-ec48-42a9-bbc9-39cc86bbd395 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 1.110533 Oct 04 20:38:51.388784 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 512/997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:50 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:51.439104 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b60349f1-7842-43af-9613-b89ed97859b7 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:51.441567 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b60349f1-7842-43af-9613-b89ed97859b7 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:51.473730 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5ef2c894-94e2-4f72-be17-e8475bf98117 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:51.483771 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b60349f1-7842-43af-9613-b89ed97859b7 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:51.491594 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b60349f1-7842-43af-9613-b89ed97859b7 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:51.492614 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b60349f1-7842-43af-9613-b89ed97859b7 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:51.500502 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b60349f1-7842-43af-9613-b89ed97859b7 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:51.502886 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5ef2c894-94e2-4f72-be17-e8475bf98117 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1466 microversion: 2.1 time: 1.193331 Oct 04 20:38:51.504156 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b60349f1-7842-43af-9613-b89ed97859b7 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:51.510342 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b60349f1-7842-43af-9613-b89ed97859b7 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:51.531391 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 486/998] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:50 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1466 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:51.561439 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2d25e527-1824-4ece-9773-b9d6cc035ea2 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:51.562867 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2d25e527-1824-4ece-9773-b9d6cc035ea2 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:51.584998 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2d25e527-1824-4ece-9773-b9d6cc035ea2 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:51.586352 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2d25e527-1824-4ece-9773-b9d6cc035ea2 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:51.586988 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2d25e527-1824-4ece-9773-b9d6cc035ea2 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:51.588271 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2d25e527-1824-4ece-9773-b9d6cc035ea2 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:51.588931 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2d25e527-1824-4ece-9773-b9d6cc035ea2 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:51.589383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2d25e527-1824-4ece-9773-b9d6cc035ea2 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.625702 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b60349f1-7842-43af-9613-b89ed97859b7 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:52.633930 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2d25e527-1824-4ece-9773-b9d6cc035ea2 tempest-ServersOnMultiNodesTest-242779177 tempest-ServersOnMultiNodesTest-242779177-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1619 microversion: 2.1 time: 1.079843 Oct 04 20:38:52.641172 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 487/999] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:51 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1619 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:52.659029 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d8f09a5d-6f01-4874-82cd-606c62cb7346 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:52.669862 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d8f09a5d-6f01-4874-82cd-606c62cb7346 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:52.673107 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b60349f1-7842-43af-9613-b89ed97859b7 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 1.275710 Oct 04 20:38:52.684544 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d8f09a5d-6f01-4874-82cd-606c62cb7346 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.685930 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d8f09a5d-6f01-4874-82cd-606c62cb7346 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.687287 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d8f09a5d-6f01-4874-82cd-606c62cb7346 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.691202 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d8f09a5d-6f01-4874-82cd-606c62cb7346 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.692531 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d8f09a5d-6f01-4874-82cd-606c62cb7346 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.695028 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d8f09a5d-6f01-4874-82cd-606c62cb7346 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.696125 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 513/1000] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:51 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:52.733513 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-84fa7645-8a15-4b1a-bc32-53f60068e6da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:52.734735 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-84fa7645-8a15-4b1a-bc32-53f60068e6da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:52.816922 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84fa7645-8a15-4b1a-bc32-53f60068e6da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.822043 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84fa7645-8a15-4b1a-bc32-53f60068e6da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.823372 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84fa7645-8a15-4b1a-bc32-53f60068e6da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.827545 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84fa7645-8a15-4b1a-bc32-53f60068e6da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.831001 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84fa7645-8a15-4b1a-bc32-53f60068e6da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.833831 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84fa7645-8a15-4b1a-bc32-53f60068e6da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.972047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-84fa7645-8a15-4b1a-bc32-53f60068e6da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:38:53.720985 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-84fa7645-8a15-4b1a-bc32-53f60068e6da tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "DELETE /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 204 len: 0 microversion: 2.1 time: 1.010478 Oct 04 20:38:53.723676 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 514/1001] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:38:52 2022] DELETE /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 0 bytes in 1027 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:38:53.736130 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a52b2f88-2080-47b9-99de-11cfa12da1f6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:53.738323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a52b2f88-2080-47b9-99de-11cfa12da1f6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:53.752662 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a52b2f88-2080-47b9-99de-11cfa12da1f6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:53.753958 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a52b2f88-2080-47b9-99de-11cfa12da1f6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:53.755036 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a52b2f88-2080-47b9-99de-11cfa12da1f6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:53.756718 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a52b2f88-2080-47b9-99de-11cfa12da1f6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:53.758434 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a52b2f88-2080-47b9-99de-11cfa12da1f6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:53.759560 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a52b2f88-2080-47b9-99de-11cfa12da1f6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:54.146378 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d8f09a5d-6f01-4874-82cd-606c62cb7346 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:54.163819 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d8f09a5d-6f01-4874-82cd-606c62cb7346 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 1.520411 Oct 04 20:38:54.173494 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 488/1002] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:52 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:54.174646 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f6d24ab5-bcd5-4510-acea-a360afe8dc2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:54.176232 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f6d24ab5-bcd5-4510-acea-a360afe8dc2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:54.190433 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6d24ab5-bcd5-4510-acea-a360afe8dc2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:54.191998 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6d24ab5-bcd5-4510-acea-a360afe8dc2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:54.193284 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6d24ab5-bcd5-4510-acea-a360afe8dc2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:54.195870 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6d24ab5-bcd5-4510-acea-a360afe8dc2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:54.197254 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6d24ab5-bcd5-4510-acea-a360afe8dc2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:54.198450 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6d24ab5-bcd5-4510-acea-a360afe8dc2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:55.092636 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a52b2f88-2080-47b9-99de-11cfa12da1f6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:55.145943 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a52b2f88-2080-47b9-99de-11cfa12da1f6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 1.419410 Oct 04 20:38:55.171189 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 515/1003] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:53 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:55.171189 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-394fb930-89ab-4b78-9a2a-f317128807d2 req-874ae30d-6efb-4664-a510-e3a349078287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd64c084-10af-4b12-bdd9-ef53866be364", "tag": "a55c4fe7-8c63-4a39-819e-95561de2446e"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:55.207020 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-394fb930-89ab-4b78-9a2a-f317128807d2 req-874ae30d-6efb-4664-a510-e3a349078287 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:55.212914 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-394fb930-89ab-4b78-9a2a-f317128807d2 req-874ae30d-6efb-4664-a510-e3a349078287 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:55.214571 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-394fb930-89ab-4b78-9a2a-f317128807d2 req-874ae30d-6efb-4664-a510-e3a349078287 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:55.268024 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-394fb930-89ab-4b78-9a2a-f317128807d2 req-874ae30d-6efb-4664-a510-e3a349078287 service nova] Creating event network-changed:a55c4fe7-8c63-4a39-819e-95561de2446e for instance bd64c084-10af-4b12-bdd9-ef53866be364 on n-h1-852085-12 Oct 04 20:38:55.290376 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-394fb930-89ab-4b78-9a2a-f317128807d2 req-874ae30d-6efb-4664-a510-e3a349078287 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138093 Oct 04 20:38:55.291829 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 516/1004] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:55.306292 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5f3a6a1a-2287-4ec4-ad48-497d6a4a8b00 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:55.307908 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-5f3a6a1a-2287-4ec4-ad48-497d6a4a8b00 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:55.325875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5f3a6a1a-2287-4ec4-ad48-497d6a4a8b00 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:55.326813 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5f3a6a1a-2287-4ec4-ad48-497d6a4a8b00 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:55.327878 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5f3a6a1a-2287-4ec4-ad48-497d6a4a8b00 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:55.329338 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5f3a6a1a-2287-4ec4-ad48-497d6a4a8b00 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:55.330750 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5f3a6a1a-2287-4ec4-ad48-497d6a4a8b00 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:55.331512 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5f3a6a1a-2287-4ec4-ad48-497d6a4a8b00 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:55.623654 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f6d24ab5-bcd5-4510-acea-a360afe8dc2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:55.646199 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f6d24ab5-bcd5-4510-acea-a360afe8dc2d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1472 microversion: 2.1 time: 1.479005 Oct 04 20:38:55.666909 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 489/1005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:54 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1472 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:56.200051 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-91befbc0-94ec-4541-962f-233a9b496a4a tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:56.202300 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-91befbc0-94ec-4541-962f-233a9b496a4a tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:56.216139 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-91befbc0-94ec-4541-962f-233a9b496a4a tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:56.216935 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-91befbc0-94ec-4541-962f-233a9b496a4a tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:56.217815 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-91befbc0-94ec-4541-962f-233a9b496a4a tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:56.219565 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-91befbc0-94ec-4541-962f-233a9b496a4a tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:56.220489 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-91befbc0-94ec-4541-962f-233a9b496a4a tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:56.221991 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-91befbc0-94ec-4541-962f-233a9b496a4a tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:56.776764 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-5f3a6a1a-2287-4ec4-ad48-497d6a4a8b00 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:56.811885 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5f3a6a1a-2287-4ec4-ad48-497d6a4a8b00 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 1.514858 Oct 04 20:38:56.813025 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 517/1006] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:55 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:56.839382 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a51e289c-0c23-4c0e-907b-604fc6293f44 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:56.840730 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a51e289c-0c23-4c0e-907b-604fc6293f44 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:56.857636 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a51e289c-0c23-4c0e-907b-604fc6293f44 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:56.874932 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a51e289c-0c23-4c0e-907b-604fc6293f44 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:56.874932 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a51e289c-0c23-4c0e-907b-604fc6293f44 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:56.874932 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a51e289c-0c23-4c0e-907b-604fc6293f44 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:56.874932 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a51e289c-0c23-4c0e-907b-604fc6293f44 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:56.874932 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a51e289c-0c23-4c0e-907b-604fc6293f44 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:57.678047 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-91befbc0-94ec-4541-962f-233a9b496a4a tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:57.709138 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-91befbc0-94ec-4541-962f-233a9b496a4a tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 1.517565 Oct 04 20:38:57.710900 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 490/1007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:56 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:57.720866 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-994afdf4-d3e4-4f15-966d-5deaccfc824e req-628315ec-c088-44c3-bafc-52212c1767d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb70165-8fd0-439d-aa99-cff22896f645", "tag": "3816d2e0-249b-44b8-be16-c80be3f1c4e8"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:57.744366 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-994afdf4-d3e4-4f15-966d-5deaccfc824e req-628315ec-c088-44c3-bafc-52212c1767d2 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:57.751598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-994afdf4-d3e4-4f15-966d-5deaccfc824e req-628315ec-c088-44c3-bafc-52212c1767d2 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:57.751598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-994afdf4-d3e4-4f15-966d-5deaccfc824e req-628315ec-c088-44c3-bafc-52212c1767d2 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:57.762134 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-994afdf4-d3e4-4f15-966d-5deaccfc824e req-628315ec-c088-44c3-bafc-52212c1767d2 service nova] Creating event network-changed:3816d2e0-249b-44b8-be16-c80be3f1c4e8 for instance 7bb70165-8fd0-439d-aa99-cff22896f645 on n-h1-852085-12 Oct 04 20:38:57.774961 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-994afdf4-d3e4-4f15-966d-5deaccfc824e req-628315ec-c088-44c3-bafc-52212c1767d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060381 Oct 04 20:38:57.776925 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 491/1008] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:57.867547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-80f1cce8-729d-4611-8e33-c1113fcae62e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:57.869763 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-80f1cce8-729d-4611-8e33-c1113fcae62e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:57.883701 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80f1cce8-729d-4611-8e33-c1113fcae62e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:57.885086 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80f1cce8-729d-4611-8e33-c1113fcae62e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:57.886161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80f1cce8-729d-4611-8e33-c1113fcae62e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:57.887887 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80f1cce8-729d-4611-8e33-c1113fcae62e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:57.888950 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80f1cce8-729d-4611-8e33-c1113fcae62e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:57.889907 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-80f1cce8-729d-4611-8e33-c1113fcae62e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:57.952275 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a51e289c-0c23-4c0e-907b-604fc6293f44 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:57.972266 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a51e289c-0c23-4c0e-907b-604fc6293f44 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1472 microversion: 2.1 time: 1.152324 Oct 04 20:38:57.985608 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 518/1009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:56 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1472 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:58.388463 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-80f1cce8-729d-4611-8e33-c1113fcae62e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:58.416558 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-80f1cce8-729d-4611-8e33-c1113fcae62e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 0.559465 Oct 04 20:38:58.419318 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 492/1010] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:57 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:58.475350 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-083210ef-2b8a-457d-9c71-e2b389c83f7e req-828ec0d9-2618-4ce1-8f03-8b48128adbdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d42994f-e35e-413c-a0a3-14bb3878e209", "tag": "2a1a7e79-2aa6-49de-b62c-90d4d8aa18d1"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:58.517551 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-083210ef-2b8a-457d-9c71-e2b389c83f7e req-828ec0d9-2618-4ce1-8f03-8b48128adbdf service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:58.519031 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-083210ef-2b8a-457d-9c71-e2b389c83f7e req-828ec0d9-2618-4ce1-8f03-8b48128adbdf service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:58.523941 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-083210ef-2b8a-457d-9c71-e2b389c83f7e req-828ec0d9-2618-4ce1-8f03-8b48128adbdf service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:58.576901 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-083210ef-2b8a-457d-9c71-e2b389c83f7e req-828ec0d9-2618-4ce1-8f03-8b48128adbdf service nova] Creating event network-changed:2a1a7e79-2aa6-49de-b62c-90d4d8aa18d1 for instance 9d42994f-e35e-413c-a0a3-14bb3878e209 on n-h2-852085-12 Oct 04 20:38:58.593506 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-083210ef-2b8a-457d-9c71-e2b389c83f7e req-828ec0d9-2618-4ce1-8f03-8b48128adbdf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127096 Oct 04 20:38:58.595428 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 519/1011] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:58.753029 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-618106f9-3b9c-4dcd-b127-8f1de641cfcc tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:58.754225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-618106f9-3b9c-4dcd-b127-8f1de641cfcc tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:58.780276 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-618106f9-3b9c-4dcd-b127-8f1de641cfcc tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:58.781178 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-618106f9-3b9c-4dcd-b127-8f1de641cfcc tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:58.785510 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-618106f9-3b9c-4dcd-b127-8f1de641cfcc tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:58.787118 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-618106f9-3b9c-4dcd-b127-8f1de641cfcc tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:58.790590 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-618106f9-3b9c-4dcd-b127-8f1de641cfcc tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:58.801404 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-618106f9-3b9c-4dcd-b127-8f1de641cfcc tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:59.036100 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ca0ce247-fbb6-4f26-978a-a567ff767ad1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:59.042971 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ca0ce247-fbb6-4f26-978a-a567ff767ad1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:59.085263 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca0ce247-fbb6-4f26-978a-a567ff767ad1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:59.087979 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca0ce247-fbb6-4f26-978a-a567ff767ad1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:59.089668 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca0ce247-fbb6-4f26-978a-a567ff767ad1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:59.098222 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca0ce247-fbb6-4f26-978a-a567ff767ad1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:59.107623 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca0ce247-fbb6-4f26-978a-a567ff767ad1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:59.108218 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca0ce247-fbb6-4f26-978a-a567ff767ad1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:59.267859 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-618106f9-3b9c-4dcd-b127-8f1de641cfcc tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:59.288120 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-618106f9-3b9c-4dcd-b127-8f1de641cfcc tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 0.540241 Oct 04 20:38:59.290786 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 493/1012] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:58 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:59.337800 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ca0ce247-fbb6-4f26-978a-a567ff767ad1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:59.370790 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ca0ce247-fbb6-4f26-978a-a567ff767ad1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1430 microversion: 2.1 time: 0.340575 Oct 04 20:38:59.407306 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 520/1013] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:59 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1430 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:59.468369 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e739fc16-89a5-4a91-a00f-99b6608ba2cd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:59.469604 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e739fc16-89a5-4a91-a00f-99b6608ba2cd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:59.511111 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e739fc16-89a5-4a91-a00f-99b6608ba2cd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:59.511933 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e739fc16-89a5-4a91-a00f-99b6608ba2cd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:59.512701 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e739fc16-89a5-4a91-a00f-99b6608ba2cd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:59.514020 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e739fc16-89a5-4a91-a00f-99b6608ba2cd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:59.514884 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e739fc16-89a5-4a91-a00f-99b6608ba2cd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:59.515693 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e739fc16-89a5-4a91-a00f-99b6608ba2cd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:59.914577 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-edac24ec-c3de-45f9-a4fc-61965544e803 req-cc797df5-9872-432d-b938-b105fbbf6454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451e57ea-f708-47a1-9ee7-a826357c8b68", "name": "network-vif-deleted", "tag": "d8a76343-fb5c-4c62-9138-2da5de84b62c"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:59.954401 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-edac24ec-c3de-45f9-a4fc-61965544e803 req-cc797df5-9872-432d-b938-b105fbbf6454 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:59.955328 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-edac24ec-c3de-45f9-a4fc-61965544e803 req-cc797df5-9872-432d-b938-b105fbbf6454 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:59.960487 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-edac24ec-c3de-45f9-a4fc-61965544e803 req-cc797df5-9872-432d-b938-b105fbbf6454 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.007642 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-edac24ec-c3de-45f9-a4fc-61965544e803 req-cc797df5-9872-432d-b938-b105fbbf6454 service nova] Creating event network-vif-deleted:d8a76343-fb5c-4c62-9138-2da5de84b62c for instance 451e57ea-f708-47a1-9ee7-a826357c8b68 on n-h2-852085-12 Oct 04 20:39:00.024333 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-edac24ec-c3de-45f9-a4fc-61965544e803 req-cc797df5-9872-432d-b938-b105fbbf6454 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116909 Oct 04 20:39:00.025631 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 521/1014] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:39:00.059315 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e739fc16-89a5-4a91-a00f-99b6608ba2cd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:00.083487 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e739fc16-89a5-4a91-a00f-99b6608ba2cd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 0.621324 Oct 04 20:39:00.083487 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 494/1015] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:59 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:00.380976 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-abe06275-437b-4085-bd43-974194141c4b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:00.385234 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-abe06275-437b-4085-bd43-974194141c4b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:00.420437 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:00.424249 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:00.426480 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-abe06275-437b-4085-bd43-974194141c4b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.428214 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-abe06275-437b-4085-bd43-974194141c4b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.430048 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-abe06275-437b-4085-bd43-974194141c4b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.432175 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-abe06275-437b-4085-bd43-974194141c4b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.434881 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-abe06275-437b-4085-bd43-974194141c4b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.437348 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-abe06275-437b-4085-bd43-974194141c4b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.469256 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.470300 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.471079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.472388 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.473252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.474051 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.749928 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.766221 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.768385 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.773571 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lazy-loading 'fault' on Instance uuid 451e57ea-f708-47a1-9ee7-a826357c8b68 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:01.188637 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:01.218812 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4ba61f73-3015-430a-b178-05364371fddb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 200 len: 1306 microversion: 2.1 time: 0.805932 Oct 04 20:39:01.232962 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 495/1016] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:00 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 1306 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:01.252630 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5e393f76-f55c-4fd7-8c5e-95891f0b7bc5 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:01.254004 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-5e393f76-f55c-4fd7-8c5e-95891f0b7bc5 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:01.271902 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5e393f76-f55c-4fd7-8c5e-95891f0b7bc5 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:01.276923 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5e393f76-f55c-4fd7-8c5e-95891f0b7bc5 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:01.278773 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5e393f76-f55c-4fd7-8c5e-95891f0b7bc5 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:01.280703 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5e393f76-f55c-4fd7-8c5e-95891f0b7bc5 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:01.282086 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5e393f76-f55c-4fd7-8c5e-95891f0b7bc5 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:01.283354 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5e393f76-f55c-4fd7-8c5e-95891f0b7bc5 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:03.009220 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5e393f76-f55c-4fd7-8c5e-95891f0b7bc5 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:03.070775 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5e393f76-f55c-4fd7-8c5e-95891f0b7bc5 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 1.822249 Oct 04 20:39:03.072422 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 496/1017] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:01 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:03.104358 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6bec6f2e-e3f9-4437-a697-70fe11cf79ec tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:03.105742 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6bec6f2e-e3f9-4437-a697-70fe11cf79ec tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 451e57ea-f708-47a1-9ee7-a826357c8b68] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:03.162884 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6bec6f2e-e3f9-4437-a697-70fe11cf79ec tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:03.163764 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6bec6f2e-e3f9-4437-a697-70fe11cf79ec tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:03.164485 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6bec6f2e-e3f9-4437-a697-70fe11cf79ec tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:03.165723 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6bec6f2e-e3f9-4437-a697-70fe11cf79ec tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:03.166530 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6bec6f2e-e3f9-4437-a697-70fe11cf79ec tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:03.172919 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6bec6f2e-e3f9-4437-a697-70fe11cf79ec tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:03.266527 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-abe06275-437b-4085-bd43-974194141c4b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:03.276262 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-6bec6f2e-e3f9-4437-a697-70fe11cf79ec tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] HTTP exception thrown: Instance 451e57ea-f708-47a1-9ee7-a826357c8b68 could not be found. Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6bec6f2e-e3f9-4437-a697-70fe11cf79ec tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Request method failure captured: Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 HTTP/1.1 Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJiX9qFSmM0WIGlyM7HbZzTPpvEuvlvHp38bunRoEM7tEfzOcvUctzJWNch8qf5bzEnXMRNwi_qG22iTzv7XkZD5YSIxebdCaTEMgsrPaAqnGsuLG0461kB-xJ2z1h2lOhJmaxlujAP14GS51da_EIRjI1YwBai6e6BtaI0EwMb_Mrg Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70436b8b504e43dc882f5ee434ecf443", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70436b8b504e43dc882f5ee434ecf443"}]}] Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 5bda0ce3a36747c69b4a78e558a03b1b Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 451e57ea-f708-47a1-9ee7-a826357c8b68 could not be found. Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '451e57ea-f708-47a1-9ee7-a826357c8b68'} Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 451e57ea-f708-47a1-9ee7-a826357c8b68 could not be found. Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 451e57ea-f708-47a1-9ee7-a826357c8b68 could not be found. Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:03.302119 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:03.319161 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:03.319161 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:03.319161 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:03.319161 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:03.319161 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:03.319161 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 451e57ea-f708-47a1-9ee7-a826357c8b68 could not be found. Oct 04 20:39:03.319161 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:03.319161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6bec6f2e-e3f9-4437-a697-70fe11cf79ec tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Returning 404 to user: Instance 451e57ea-f708-47a1-9ee7-a826357c8b68 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:03.319161 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6bec6f2e-e3f9-4437-a697-70fe11cf79ec tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68" status: 404 len: 111 microversion: 2.1 time: 0.230844 Oct 04 20:39:03.325098 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-abe06275-437b-4085-bd43-974194141c4b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 2.969252 Oct 04 20:39:03.340203 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 497/1018] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:03 2022] GET /compute/v2.1/servers/451e57ea-f708-47a1-9ee7-a826357c8b68 => generated 111 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:03.356718 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 522/1019] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:00 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 3011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:03.395463 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d24da93d-7c08-4ccb-8b97-51777897a6ef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:03.396359 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d24da93d-7c08-4ccb-8b97-51777897a6ef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:03.438335 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d24da93d-7c08-4ccb-8b97-51777897a6ef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:03.439257 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d24da93d-7c08-4ccb-8b97-51777897a6ef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:03.440074 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d24da93d-7c08-4ccb-8b97-51777897a6ef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:03.441443 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d24da93d-7c08-4ccb-8b97-51777897a6ef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:03.442316 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d24da93d-7c08-4ccb-8b97-51777897a6ef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:03.443105 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d24da93d-7c08-4ccb-8b97-51777897a6ef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:03.597319 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d24da93d-7c08-4ccb-8b97-51777897a6ef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:04.052322 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:04.121102 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-278492a4-a83e-4a8f-b2e7-b6f9c3c46d2e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:04.122734 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-278492a4-a83e-4a8f-b2e7-b6f9c3c46d2e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:04.139052 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:04.155726 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-278492a4-a83e-4a8f-b2e7-b6f9c3c46d2e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:04.156549 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-278492a4-a83e-4a8f-b2e7-b6f9c3c46d2e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:04.157359 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-278492a4-a83e-4a8f-b2e7-b6f9c3c46d2e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:04.158756 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-278492a4-a83e-4a8f-b2e7-b6f9c3c46d2e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:04.159683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-278492a4-a83e-4a8f-b2e7-b6f9c3c46d2e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:04.166290 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-278492a4-a83e-4a8f-b2e7-b6f9c3c46d2e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:04.348161 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:04.521804 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d24da93d-7c08-4ccb-8b97-51777897a6ef tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "DELETE /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 204 len: 0 microversion: 2.1 time: 1.179152 Oct 04 20:39:04.525554 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 498/1020] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:03 2022] DELETE /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 0 bytes in 1182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:04.546307 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a89f6727-9944-4d92-a59f-b653e08724b1 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:04.548371 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a89f6727-9944-4d92-a59f-b653e08724b1 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:04.573205 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a89f6727-9944-4d92-a59f-b653e08724b1 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:04.581542 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a89f6727-9944-4d92-a59f-b653e08724b1 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:04.583579 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a89f6727-9944-4d92-a59f-b653e08724b1 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:04.596177 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a89f6727-9944-4d92-a59f-b653e08724b1 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:04.597608 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a89f6727-9944-4d92-a59f-b653e08724b1 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:04.612216 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a89f6727-9944-4d92-a59f-b653e08724b1 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:05.212629 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-278492a4-a83e-4a8f-b2e7-b6f9c3c46d2e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:05.257869 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-278492a4-a83e-4a8f-b2e7-b6f9c3c46d2e tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 1.141623 Oct 04 20:39:05.259948 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 523/1021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:04 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:05.283523 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1ba166c5-303a-40c9-9b7f-9eabd64d2027 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:05.289498 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1ba166c5-303a-40c9-9b7f-9eabd64d2027 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:05.328094 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1ba166c5-303a-40c9-9b7f-9eabd64d2027 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:05.331969 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1ba166c5-303a-40c9-9b7f-9eabd64d2027 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:05.331969 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1ba166c5-303a-40c9-9b7f-9eabd64d2027 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:05.335708 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1ba166c5-303a-40c9-9b7f-9eabd64d2027 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:05.336683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1ba166c5-303a-40c9-9b7f-9eabd64d2027 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:05.337503 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1ba166c5-303a-40c9-9b7f-9eabd64d2027 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:05.441682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a89f6727-9944-4d92-a59f-b653e08724b1 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:05.473397 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a89f6727-9944-4d92-a59f-b653e08724b1 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 0.945966 Oct 04 20:39:05.504120 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 499/1022] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:04 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:06.599651 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f951c3b4-2b91-4676-a965-b2b3b68a0fed tempest-ListImagesTestJSON-989785619 tempest-ListImagesTestJSON-989785619-project] Calling method '.version_select at 0x7f77eeff80d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:06.745139 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f951c3b4-2b91-4676-a965-b2b3b68a0fed tempest-ListImagesTestJSON-989785619 tempest-ListImagesTestJSON-989785619-project] 10.222.0.78 "GET /compute/v2.1/images/72e89793-9b3c-463e-96d2-f69d6ab1a9d9" status: 200 len: 784 microversion: 2.1 time: 0.563584 Oct 04 20:39:06.746217 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 500/1023] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:06 2022] GET /compute/v2.1/images/72e89793-9b3c-463e-96d2-f69d6ab1a9d9 => generated 784 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:39:06.783336 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-772a9821-627e-4e19-9ff4-cd56d8cc2924 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:06.785781 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-772a9821-627e-4e19-9ff4-cd56d8cc2924 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:06.803467 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-772a9821-627e-4e19-9ff4-cd56d8cc2924 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:06.805604 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-772a9821-627e-4e19-9ff4-cd56d8cc2924 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:06.806839 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-772a9821-627e-4e19-9ff4-cd56d8cc2924 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:06.808546 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-772a9821-627e-4e19-9ff4-cd56d8cc2924 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:06.811821 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-772a9821-627e-4e19-9ff4-cd56d8cc2924 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:06.814199 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-772a9821-627e-4e19-9ff4-cd56d8cc2924 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:06.891185 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1ba166c5-303a-40c9-9b7f-9eabd64d2027 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:06.936170 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1ba166c5-303a-40c9-9b7f-9eabd64d2027 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1471 microversion: 2.1 time: 1.668502 Oct 04 20:39:06.937759 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 524/1024] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:05 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1471 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:06.951466 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-56db2573-4fc6-4a8f-8b8c-eaedc3a22f37 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:06.956091 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-56db2573-4fc6-4a8f-8b8c-eaedc3a22f37 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:06.968125 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56db2573-4fc6-4a8f-8b8c-eaedc3a22f37 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:06.969597 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56db2573-4fc6-4a8f-8b8c-eaedc3a22f37 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:06.971193 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56db2573-4fc6-4a8f-8b8c-eaedc3a22f37 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:06.973009 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56db2573-4fc6-4a8f-8b8c-eaedc3a22f37 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:06.974892 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56db2573-4fc6-4a8f-8b8c-eaedc3a22f37 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:06.978220 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56db2573-4fc6-4a8f-8b8c-eaedc3a22f37 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:07.958909 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-772a9821-627e-4e19-9ff4-cd56d8cc2924 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:07.976725 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-772a9821-627e-4e19-9ff4-cd56d8cc2924 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 1.218252 Oct 04 20:39:07.977819 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 501/1025] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:06 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:07.993730 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-280ec813-b9ff-42e5-b5d2-dacbe1bd131e tempest-ListImagesTestJSON-989785619 tempest-ListImagesTestJSON-989785619-project] Calling method '.version_select at 0x7f77eef7fc10>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:08.271739 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-280ec813-b9ff-42e5-b5d2-dacbe1bd131e tempest-ListImagesTestJSON-989785619 tempest-ListImagesTestJSON-989785619-project] 10.222.0.78 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.291900 Oct 04 20:39:08.280979 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-56db2573-4fc6-4a8f-8b8c-eaedc3a22f37 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:08.289751 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 502/1026] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:39:07 2022] GET /compute/v2.1/images => generated 445 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:08.317558 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6e3bc53a-976f-4106-a702-bc7279a15145 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2087924089", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f83df98d-561c-48da-846a-6d99e02fce9a"}], "block_device_mapping_v2": [{"uuid": "cf9c15f0-69ba-42e7-aeca-eec6547dd350", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:08.329128 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-56db2573-4fc6-4a8f-8b8c-eaedc3a22f37 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 1.385891 Oct 04 20:39:08.331028 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 525/1027] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:06 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:08.371052 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a568c488-05bf-4221-abac-55fc7fa8b79d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:08.372908 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a568c488-05bf-4221-abac-55fc7fa8b79d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:08.387520 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a568c488-05bf-4221-abac-55fc7fa8b79d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:08.398505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a568c488-05bf-4221-abac-55fc7fa8b79d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:08.402585 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a568c488-05bf-4221-abac-55fc7fa8b79d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.405688 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a568c488-05bf-4221-abac-55fc7fa8b79d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:08.407102 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a568c488-05bf-4221-abac-55fc7fa8b79d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:08.408783 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a568c488-05bf-4221-abac-55fc7fa8b79d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.683350 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-6e3bc53a-976f-4106-a702-bc7279a15145 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] validate_networks() for [('f83df98d-561c-48da-846a-6d99e02fce9a', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-6e3bc53a-976f-4106-a702-bc7279a15145 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7cbab80e-6597-4752-a4b5-084def7052a1) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:39:09.872757 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7cbab80e-6597-4752-a4b5-084def7052a1) Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-6e3bc53a-976f-4106-a702-bc7279a15145 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6e3bc53a-976f-4106-a702-bc7279a15145 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Request method failure captured: Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 349 Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJllsosz-1nmVayiu2aBIgM_m1vuxlFJ4nqYT0WayTuP0YQxGh2762wzcuP078Ovbtevf06SA2Hmk61VL_LUIH3VKZW8AzQWoOv9lSs6jBoPNe3GRQDd-42P1aIbfxIem6guRqWg4CGQ751gI7bYpgPlI0b8PQ1olCLWIEoD6ss1ZIo Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 10ad510c188c41c5b44cde6ddd2f40e3 Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-LiveMigrationTest-1791906039 Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_10ad510c188c41c5b44cde6ddd2f40e3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/10ad510c188c41c5b44cde6ddd2f40e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/10ad510c188c41c5b44cde6ddd2f40e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/10ad510c188c41c5b44cde6ddd2f40e3"}]}] Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-LiveMigrationTest-1791906039 Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 10ad510c188c41c5b44cde6ddd2f40e3 Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-LiveMigrationTest-1791906039 Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-LiveMigrationTest-1791906039-project Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: fe9e839b68de4530b70e6a12fb5d00f1 Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-LiveMigrationTest-1791906039-project Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-LiveMigrationTest-server-2087924089", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f83df98d-561c-48da-846a-6d99e02fce9a"}], "block_device_mapping_v2": [{"uuid": "cf9c15f0-69ba-42e7-aeca-eec6547dd350", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:39:09.887830 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-2087924089', 'imageRef': '', 'flavorRef': '452', 'networks': [{'uuid': 'f83df98d-561c-48da-846a-6d99e02fce9a'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': 'cf9c15f0-69ba-42e7-aeca-eec6547dd350'}]}}} Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:39:09.896263 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7cbab80e-6597-4752-a4b5-084def7052a1) Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6e3bc53a-976f-4106-a702-bc7279a15145 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6e3bc53a-976f-4106-a702-bc7279a15145 tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.599427 Oct 04 20:39:09.910058 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 503/1028] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:39:08 2022] POST /compute/v2.1/servers => generated 214 bytes in 1616 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:39:09.921639 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2eb377b5-27c6-4454-a031-ad58ff580533 tempest-ListImagesTestJSON-989785619 tempest-ListImagesTestJSON-989785619-project] Calling method '.version_select at 0x7f77eef7f940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:10.104616 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2eb377b5-27c6-4454-a031-ad58ff580533 tempest-ListImagesTestJSON-989785619 tempest-ListImagesTestJSON-989785619-project] 10.222.0.78 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.195168 Oct 04 20:39:10.114750 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a568c488-05bf-4221-abac-55fc7fa8b79d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:10.126083 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 504/1029] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 4 20:39:09 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:10.162545 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c12c5ba9-c87b-41cc-9953-2f3c3bbe23ca tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:10.167302 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a568c488-05bf-4221-abac-55fc7fa8b79d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1471 microversion: 2.1 time: 1.829102 Oct 04 20:39:10.171837 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c12c5ba9-c87b-41cc-9953-2f3c3bbe23ca tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:10.178292 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 526/1030] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:08 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1471 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:10.204076 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c12c5ba9-c87b-41cc-9953-2f3c3bbe23ca tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.205260 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d3695022-4a00-4b1a-bc39-455c9fb0f48d tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:10.207688 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c12c5ba9-c87b-41cc-9953-2f3c3bbe23ca tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.208923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d3695022-4a00-4b1a-bc39-455c9fb0f48d tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:10.211459 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c12c5ba9-c87b-41cc-9953-2f3c3bbe23ca tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:10.223022 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c12c5ba9-c87b-41cc-9953-2f3c3bbe23ca tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.227726 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c12c5ba9-c87b-41cc-9953-2f3c3bbe23ca tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.228550 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c12c5ba9-c87b-41cc-9953-2f3c3bbe23ca tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:10.259223 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3695022-4a00-4b1a-bc39-455c9fb0f48d tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.262126 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3695022-4a00-4b1a-bc39-455c9fb0f48d tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.263080 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3695022-4a00-4b1a-bc39-455c9fb0f48d tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:10.268133 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3695022-4a00-4b1a-bc39-455c9fb0f48d tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.286089 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3695022-4a00-4b1a-bc39-455c9fb0f48d tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.287177 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3695022-4a00-4b1a-bc39-455c9fb0f48d tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.617079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c12c5ba9-c87b-41cc-9953-2f3c3bbe23ca tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:11.667228 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c12c5ba9-c87b-41cc-9953-2f3c3bbe23ca tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 1.538994 Oct 04 20:39:11.669481 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 505/1031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:10 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:11.682539 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-52960674-f652-4664-b52e-65c530849ae3 req-87e38541-02b9-474a-8453-4ec3e94000d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bac598-5b49-450a-9297-98c948ede895", "name": "network-vif-deleted", "tag": "3ba03155-a256-4d12-935c-4c94ada17413"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:11.704416 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-52960674-f652-4664-b52e-65c530849ae3 req-87e38541-02b9-474a-8453-4ec3e94000d8 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:11.705829 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-52960674-f652-4664-b52e-65c530849ae3 req-87e38541-02b9-474a-8453-4ec3e94000d8 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:11.706904 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-52960674-f652-4664-b52e-65c530849ae3 req-87e38541-02b9-474a-8453-4ec3e94000d8 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.730280 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-52960674-f652-4664-b52e-65c530849ae3 req-87e38541-02b9-474a-8453-4ec3e94000d8 service nova] Creating event network-vif-deleted:3ba03155-a256-4d12-935c-4c94ada17413 for instance 70bac598-5b49-450a-9297-98c948ede895 on n-h1-852085-12 Oct 04 20:39:11.744470 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-52960674-f652-4664-b52e-65c530849ae3 req-87e38541-02b9-474a-8453-4ec3e94000d8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071150 Oct 04 20:39:11.752032 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 506/1032] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:11.762622 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ff6a09ef-4085-4165-8acd-4fe72aef701b tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] Calling method '.version_select at 0x7f77eef62700>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:11.871604 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-d3695022-4a00-4b1a-bc39-455c9fb0f48d tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:11.902800 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d3695022-4a00-4b1a-bc39-455c9fb0f48d tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 1.721308 Oct 04 20:39:11.910583 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 527/1033] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:10 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:11.925907 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-e1df4921-74ce-4823-ad27-86fd03cedaec req-9866479a-8824-4dbe-b804-617900dc4918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd64c084-10af-4b12-bdd9-ef53866be364", "name": "network-vif-plugged", "status": "completed", "tag": "a55c4fe7-8c63-4a39-819e-95561de2446e"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:11.933169 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ff6a09ef-4085-4165-8acd-4fe72aef701b tempest-LiveMigrationTest-1791906039 tempest-LiveMigrationTest-1791906039-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-383612971" status: 202 len: 0 microversion: 2.1 time: 0.178062 Oct 04 20:39:11.934403 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 507/1034] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 4 20:39:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-383612971 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:39:11.971252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:11.973031 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:11.987115 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:11.989937 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:11.992012 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.998930 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:11.998930 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:11.998930 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.000479 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e1df4921-74ce-4823-ad27-86fd03cedaec req-9866479a-8824-4dbe-b804-617900dc4918 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.004162 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e1df4921-74ce-4823-ad27-86fd03cedaec req-9866479a-8824-4dbe-b804-617900dc4918 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.005326 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e1df4921-74ce-4823-ad27-86fd03cedaec req-9866479a-8824-4dbe-b804-617900dc4918 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.065999 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-e1df4921-74ce-4823-ad27-86fd03cedaec req-9866479a-8824-4dbe-b804-617900dc4918 service nova] Creating event network-vif-plugged:a55c4fe7-8c63-4a39-819e-95561de2446e for instance bd64c084-10af-4b12-bdd9-ef53866be364 on n-h1-852085-12 Oct 04 20:39:12.083598 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-e1df4921-74ce-4823-ad27-86fd03cedaec req-9866479a-8824-4dbe-b804-617900dc4918 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169892 Oct 04 20:39:12.090611 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 528/1035] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:12.120189 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.123012 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.125651 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.127823 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lazy-loading 'fault' on Instance uuid 70bac598-5b49-450a-9297-98c948ede895 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:12.591793 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:12.649071 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bd0c62b0-7e6a-4781-9440-798eeb055b07 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 200 len: 1306 microversion: 2.1 time: 0.691950 Oct 04 20:39:12.662530 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 508/1036] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:11 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 1306 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:12.726557 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3b99fa34-8404-4a82-8277-3dd265f64444 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:12.729187 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3b99fa34-8404-4a82-8277-3dd265f64444 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:12.795661 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b99fa34-8404-4a82-8277-3dd265f64444 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.804136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b99fa34-8404-4a82-8277-3dd265f64444 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.805865 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b99fa34-8404-4a82-8277-3dd265f64444 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.811951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b99fa34-8404-4a82-8277-3dd265f64444 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.813379 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b99fa34-8404-4a82-8277-3dd265f64444 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.820786 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b99fa34-8404-4a82-8277-3dd265f64444 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.987956 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f54d424e-9400-4ba3-bd1c-f43321e8ed67 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:12.991565 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f54d424e-9400-4ba3-bd1c-f43321e8ed67 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:13.019440 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f54d424e-9400-4ba3-bd1c-f43321e8ed67 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:13.020361 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f54d424e-9400-4ba3-bd1c-f43321e8ed67 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:13.021507 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f54d424e-9400-4ba3-bd1c-f43321e8ed67 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:13.024605 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f54d424e-9400-4ba3-bd1c-f43321e8ed67 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:13.037697 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f54d424e-9400-4ba3-bd1c-f43321e8ed67 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:13.039015 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f54d424e-9400-4ba3-bd1c-f43321e8ed67 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:13.887087 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3b99fa34-8404-4a82-8277-3dd265f64444 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:13.903884 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3b99fa34-8404-4a82-8277-3dd265f64444 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 1.189307 Oct 04 20:39:13.905848 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 529/1037] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:12 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:13.915816 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4bee6a24-8b99-49f5-8277-28013acf7fb5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:13.919602 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4bee6a24-8b99-49f5-8277-28013acf7fb5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 70bac598-5b49-450a-9297-98c948ede895] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:13.933613 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4bee6a24-8b99-49f5-8277-28013acf7fb5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:13.935044 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4bee6a24-8b99-49f5-8277-28013acf7fb5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:13.936534 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4bee6a24-8b99-49f5-8277-28013acf7fb5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:13.938254 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4bee6a24-8b99-49f5-8277-28013acf7fb5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:13.939822 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4bee6a24-8b99-49f5-8277-28013acf7fb5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:13.941042 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4bee6a24-8b99-49f5-8277-28013acf7fb5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:13.971909 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-4bee6a24-8b99-49f5-8277-28013acf7fb5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] HTTP exception thrown: Instance 70bac598-5b49-450a-9297-98c948ede895 could not be found. Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4bee6a24-8b99-49f5-8277-28013acf7fb5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Request method failure captured: Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 HTTP/1.1 Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJiX9qFSmM0WIGlyM7HbZzTPpvEuvlvHp38bunRoEM7tEfzOcvUctzJWNch8qf5bzEnXMRNwi_qG22iTzv7XkZD5YSIxebdCaTEMgsrPaAqnGsuLG0461kB-xJ2z1h2lOhJmaxlujAP14GS51da_EIRjI1YwBai6e6BtaI0EwMb_Mrg Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70436b8b504e43dc882f5ee434ecf443", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70436b8b504e43dc882f5ee434ecf443"}]}] Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 5bda0ce3a36747c69b4a78e558a03b1b Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 70bac598-5b49-450a-9297-98c948ede895 could not be found. Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '70bac598-5b49-450a-9297-98c948ede895'} Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70bac598-5b49-450a-9297-98c948ede895 could not be found. Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70bac598-5b49-450a-9297-98c948ede895 could not be found. Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:13.976343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:13.985348 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:13.985348 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:13.985348 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:13.985348 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:13.985348 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:13.985348 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70bac598-5b49-450a-9297-98c948ede895 could not be found. Oct 04 20:39:13.985348 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:13.988023 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4bee6a24-8b99-49f5-8277-28013acf7fb5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Returning 404 to user: Instance 70bac598-5b49-450a-9297-98c948ede895 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:13.990029 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4bee6a24-8b99-49f5-8277-28013acf7fb5 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895" status: 404 len: 111 microversion: 2.1 time: 0.081770 Oct 04 20:39:13.992740 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 530/1038] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:13 2022] GET /compute/v2.1/servers/70bac598-5b49-450a-9297-98c948ede895 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:14.008187 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3e49d42f-c6f1-495a-bd9e-bf88fe843d68 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:14.009413 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3e49d42f-c6f1-495a-bd9e-bf88fe843d68 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:14.022047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3e49d42f-c6f1-495a-bd9e-bf88fe843d68 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.024109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3e49d42f-c6f1-495a-bd9e-bf88fe843d68 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.026548 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3e49d42f-c6f1-495a-bd9e-bf88fe843d68 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.028523 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3e49d42f-c6f1-495a-bd9e-bf88fe843d68 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.030005 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3e49d42f-c6f1-495a-bd9e-bf88fe843d68 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.031120 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3e49d42f-c6f1-495a-bd9e-bf88fe843d68 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.089956 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3e49d42f-c6f1-495a-bd9e-bf88fe843d68 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:14.285239 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f54d424e-9400-4ba3-bd1c-f43321e8ed67 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:14.334231 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f54d424e-9400-4ba3-bd1c-f43321e8ed67 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 1.357036 Oct 04 20:39:14.336571 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 509/1039] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:12 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:14.634461 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3e49d42f-c6f1-495a-bd9e-bf88fe843d68 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "DELETE /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 204 len: 0 microversion: 2.1 time: 0.634000 Oct 04 20:39:14.636588 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 531/1040] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:13 2022] DELETE /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:39:14.661599 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-614e076c-260c-4714-92dd-712a2862278f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:14.669907 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-614e076c-260c-4714-92dd-712a2862278f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:14.691034 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-614e076c-260c-4714-92dd-712a2862278f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.692436 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-614e076c-260c-4714-92dd-712a2862278f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.700143 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-614e076c-260c-4714-92dd-712a2862278f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.702022 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-614e076c-260c-4714-92dd-712a2862278f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.703269 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-614e076c-260c-4714-92dd-712a2862278f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.704452 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-614e076c-260c-4714-92dd-712a2862278f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.973376 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b4e166fe-4e4d-458b-934d-c74036dad662 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:14.984274 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b4e166fe-4e4d-458b-934d-c74036dad662 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:15.017699 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b4e166fe-4e4d-458b-934d-c74036dad662 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.018851 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b4e166fe-4e4d-458b-934d-c74036dad662 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.020083 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b4e166fe-4e4d-458b-934d-c74036dad662 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.021644 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b4e166fe-4e4d-458b-934d-c74036dad662 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.025394 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b4e166fe-4e4d-458b-934d-c74036dad662 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.027115 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b4e166fe-4e4d-458b-934d-c74036dad662 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.560130 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-614e076c-260c-4714-92dd-712a2862278f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:16.589939 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-614e076c-260c-4714-92dd-712a2862278f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1471 microversion: 2.1 time: 1.937477 Oct 04 20:39:16.592786 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 510/1041] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:14 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1471 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:16.607527 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b4e166fe-4e4d-458b-934d-c74036dad662 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:16.610437 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-173fff76-8a11-4c2b-bb76-7df33e2366b3 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:16.613343 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-173fff76-8a11-4c2b-bb76-7df33e2366b3 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:16.630238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-173fff76-8a11-4c2b-bb76-7df33e2366b3 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.632906 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-173fff76-8a11-4c2b-bb76-7df33e2366b3 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.634699 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-173fff76-8a11-4c2b-bb76-7df33e2366b3 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.637569 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-173fff76-8a11-4c2b-bb76-7df33e2366b3 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.640442 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-173fff76-8a11-4c2b-bb76-7df33e2366b3 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.641740 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-173fff76-8a11-4c2b-bb76-7df33e2366b3 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.660555 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b4e166fe-4e4d-458b-934d-c74036dad662 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 1.708081 Oct 04 20:39:16.661698 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 532/1042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:14 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:17.309540 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-72d3060c-5a0f-487b-bf0a-2a03e46aa469 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Calling method '.version_select at 0x7f77ef2fe8b0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:17.776855 n-d-852085-12 devstack@n-api.service[123540]: DEBUG neutronclient.v2_0.client [None req-72d3060c-5a0f-487b-bf0a-2a03e46aa469 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 105ab0cf-2b15-4914-9863-0387d4199d73 does not exist", "detail": ""}} {{(pid=123540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:39:17.778155 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.security_group_api [None req-72d3060c-5a0f-487b-bf0a-2a03e46aa469 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Neutron security group 105ab0cf-2b15-4914-9863-0387d4199d73 not found {{(pid=123540) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:39:17.779329 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-72d3060c-5a0f-487b-bf0a-2a03e46aa469 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] HTTP exception thrown: Security group 105ab0cf-2b15-4914-9863-0387d4199d73 does not exist Oct 04 20:39:17.779329 n-d-852085-12 devstack@n-api.service[123540]: Neutron server returns request_ids: ['req-f5483188-41dd-44cf-a0f0-44109e9ac7a9'] Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-72d3060c-5a0f-487b-bf0a-2a03e46aa469 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Request method failure captured: Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/os-security-groups/105ab0cf-2b15-4914-9863-0387d4199d73 HTTP/1.1 Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJnzXlK8eToC7Z1D04wulxkgey77_8YFfySSAslSoH_gZ1P26MYlZ3r3F31oUGzLJBnkZpTl1sNmNcGbRtjV0tMjyIauNIhxC-ztteEC1gXntVMgF3ty7lW7aDHH46q38R_A-Eal9zDIiHnvi32dvfgl-RaAXtmqh6P-qHjhEjgoNC4 Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 8fe6727c071748399777eac51fd08556 Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1408947949 Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8fe6727c071748399777eac51fd08556", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8fe6727c071748399777eac51fd08556"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8fe6727c071748399777eac51fd08556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8fe6727c071748399777eac51fd08556"}]}] Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1408947949 Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 8fe6727c071748399777eac51fd08556 Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1408947949 Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-SecurityGroupsNegativeTestJSON-1408947949-project Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: cc2baf41db034b27a7799f37999b1a9e Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1408947949-project Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: exception: Security group 105ab0cf-2b15-4914-9863-0387d4199d73 does not exist Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: Neutron server returns request_ids: ['req-f5483188-41dd-44cf-a0f0-44109e9ac7a9'] Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '105ab0cf-2b15-4914-9863-0387d4199d73'} Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:39:17.784619 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 105ab0cf-2b15-4914-9863-0387d4199d73 does not exist Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5483188-41dd-44cf-a0f0-44109e9ac7a9'] Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 105ab0cf-2b15-4914-9863-0387d4199d73 does not exist Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5483188-41dd-44cf-a0f0-44109e9ac7a9'] Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 105ab0cf-2b15-4914-9863-0387d4199d73 does not exist Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5483188-41dd-44cf-a0f0-44109e9ac7a9'] Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 105ab0cf-2b15-4914-9863-0387d4199d73 does not exist Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5483188-41dd-44cf-a0f0-44109e9ac7a9'] Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-72d3060c-5a0f-487b-bf0a-2a03e46aa469 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Returning 404 to user: Security group 105ab0cf-2b15-4914-9863-0387d4199d73 does not exist Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: Neutron server returns request_ids: ['req-f5483188-41dd-44cf-a0f0-44109e9ac7a9'] {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-72d3060c-5a0f-487b-bf0a-2a03e46aa469 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/105ab0cf-2b15-4914-9863-0387d4199d73" status: 404 len: 194 microversion: 2.1 time: 1.124442 Oct 04 20:39:17.814552 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 533/1043] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:39:16 2022] DELETE /compute/v2.1/os-security-groups/105ab0cf-2b15-4914-9863-0387d4199d73 => generated 194 bytes in 1138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:17.830645 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7e546243-3e3a-4a0b-9595-eeb1c7557f3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:17.838122 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7e546243-3e3a-4a0b-9595-eeb1c7557f3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:17.861934 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7e546243-3e3a-4a0b-9595-eeb1c7557f3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:17.873531 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7e546243-3e3a-4a0b-9595-eeb1c7557f3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:17.878606 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7e546243-3e3a-4a0b-9595-eeb1c7557f3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:17.878606 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7e546243-3e3a-4a0b-9595-eeb1c7557f3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:17.884713 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7e546243-3e3a-4a0b-9595-eeb1c7557f3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:17.885525 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7e546243-3e3a-4a0b-9595-eeb1c7557f3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:18.085228 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-173fff76-8a11-4c2b-bb76-7df33e2366b3 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:18.116828 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-173fff76-8a11-4c2b-bb76-7df33e2366b3 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 1.519690 Oct 04 20:39:18.117952 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 511/1044] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:16 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:18.147359 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e027651b-e406-4f9e-b8d9-773464bb7514 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:18.149785 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e027651b-e406-4f9e-b8d9-773464bb7514 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:18.186787 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e027651b-e406-4f9e-b8d9-773464bb7514 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.188411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e027651b-e406-4f9e-b8d9-773464bb7514 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.189223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e027651b-e406-4f9e-b8d9-773464bb7514 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:18.190608 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e027651b-e406-4f9e-b8d9-773464bb7514 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.191583 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e027651b-e406-4f9e-b8d9-773464bb7514 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.192366 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e027651b-e406-4f9e-b8d9-773464bb7514 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.502148 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7e546243-3e3a-4a0b-9595-eeb1c7557f3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:19.548778 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7e546243-3e3a-4a0b-9595-eeb1c7557f3b tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1471 microversion: 2.1 time: 1.726225 Oct 04 20:39:19.550767 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 534/1045] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:17 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1471 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:19.562861 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-98fa9aa7-aaa6-430c-8237-e9f5b9109415 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.008668 Oct 04 20:39:19.564781 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 535/1046] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Oct 4 20:39:19 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 20:39:19.593394 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fd0c326e-d650-46b9-bc14-0d907efa2955 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:19.597826 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-fd0c326e-d650-46b9-bc14-0d907efa2955 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:19.638114 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fd0c326e-d650-46b9-bc14-0d907efa2955 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.642482 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fd0c326e-d650-46b9-bc14-0d907efa2955 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.647357 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fd0c326e-d650-46b9-bc14-0d907efa2955 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.659116 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fd0c326e-d650-46b9-bc14-0d907efa2955 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.661535 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fd0c326e-d650-46b9-bc14-0d907efa2955 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.665015 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fd0c326e-d650-46b9-bc14-0d907efa2955 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.753682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e027651b-e406-4f9e-b8d9-773464bb7514 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:19.791665 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e027651b-e406-4f9e-b8d9-773464bb7514 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 1.668072 Oct 04 20:39:19.798248 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 512/1047] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:18 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:19.826535 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bde8354c-1a47-4de8-9255-c853ef812455 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Calling method '.version_select at 0x7f77eee85040>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:21.140681 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-fd0c326e-d650-46b9-bc14-0d907efa2955 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:21.176667 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fd0c326e-d650-46b9-bc14-0d907efa2955 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 1.609528 Oct 04 20:39:21.178306 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 536/1048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:19 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:21.187066 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-7ed99f4b-40b8-457f-a414-d97d4b95d005 req-82dc6aa4-8d7a-48cd-9afd-d3a2ab1ce662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb70165-8fd0-439d-aa99-cff22896f645", "name": "network-vif-plugged", "status": "completed", "tag": "3816d2e0-249b-44b8-be16-c80be3f1c4e8"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:21.229010 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-7ed99f4b-40b8-457f-a414-d97d4b95d005 req-82dc6aa4-8d7a-48cd-9afd-d3a2ab1ce662 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:21.229853 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-7ed99f4b-40b8-457f-a414-d97d4b95d005 req-82dc6aa4-8d7a-48cd-9afd-d3a2ab1ce662 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:21.230660 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-7ed99f4b-40b8-457f-a414-d97d4b95d005 req-82dc6aa4-8d7a-48cd-9afd-d3a2ab1ce662 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:21.302988 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-7ed99f4b-40b8-457f-a414-d97d4b95d005 req-82dc6aa4-8d7a-48cd-9afd-d3a2ab1ce662 service nova] Creating event network-vif-plugged:3816d2e0-249b-44b8-be16-c80be3f1c4e8 for instance 7bb70165-8fd0-439d-aa99-cff22896f645 on n-h1-852085-12 Oct 04 20:39:21.321102 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-7ed99f4b-40b8-457f-a414-d97d4b95d005 req-82dc6aa4-8d7a-48cd-9afd-d3a2ab1ce662 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140497 Oct 04 20:39:21.328192 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 537/1049] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:21.338188 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3e598aca-fe80-4640-8107-c6b7cd01d44d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:21.353136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3e598aca-fe80-4640-8107-c6b7cd01d44d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:21.373615 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3e598aca-fe80-4640-8107-c6b7cd01d44d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:21.392423 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3e598aca-fe80-4640-8107-c6b7cd01d44d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:21.393639 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3e598aca-fe80-4640-8107-c6b7cd01d44d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:21.395382 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3e598aca-fe80-4640-8107-c6b7cd01d44d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:21.397094 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3e598aca-fe80-4640-8107-c6b7cd01d44d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:21.398107 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3e598aca-fe80-4640-8107-c6b7cd01d44d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.360049 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bde8354c-1a47-4de8-9255-c853ef812455 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 2.559044 Oct 04 20:39:22.384970 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 513/1050] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:39:19 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 2586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:22.416556 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fb2c7bd9-af3d-4d47-9207-7855f6b92dfb tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:22.423439 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-fb2c7bd9-af3d-4d47-9207-7855f6b92dfb tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:22.444798 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:22.468633 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fb2c7bd9-af3d-4d47-9207-7855f6b92dfb tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.472372 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fb2c7bd9-af3d-4d47-9207-7855f6b92dfb tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.472372 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fb2c7bd9-af3d-4d47-9207-7855f6b92dfb tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.476503 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fb2c7bd9-af3d-4d47-9207-7855f6b92dfb tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.493030 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fb2c7bd9-af3d-4d47-9207-7855f6b92dfb tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.497383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fb2c7bd9-af3d-4d47-9207-7855f6b92dfb tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.114608 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3e598aca-fe80-4640-8107-c6b7cd01d44d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:23.157894 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3e598aca-fe80-4640-8107-c6b7cd01d44d tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1471 microversion: 2.1 time: 1.822326 Oct 04 20:39:23.160452 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 538/1051] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:21 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1471 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:23.194740 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-948be230-dc65-4026-9538-199c71b29368 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:23.198700 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-948be230-dc65-4026-9538-199c71b29368 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:23.245315 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-948be230-dc65-4026-9538-199c71b29368 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.249526 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-948be230-dc65-4026-9538-199c71b29368 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.256406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-948be230-dc65-4026-9538-199c71b29368 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.261131 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-948be230-dc65-4026-9538-199c71b29368 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.273567 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-948be230-dc65-4026-9538-199c71b29368 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.278445 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-948be230-dc65-4026-9538-199c71b29368 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.881778 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-948be230-dc65-4026-9538-199c71b29368 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:23.922104 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-948be230-dc65-4026-9538-199c71b29368 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1323 microversion: 2.1 time: 0.755133 Oct 04 20:39:23.924275 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 539/1052] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:23 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1323 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:23.939442 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-919bb3cb-f033-4aea-94e7-63551109886b tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Calling method '.version_select at 0x7f77efa53310>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:24.313220 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-fb2c7bd9-af3d-4d47-9207-7855f6b92dfb tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:24.342676 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fb2c7bd9-af3d-4d47-9207-7855f6b92dfb tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 1.947488 Oct 04 20:39:24.345081 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 514/1053] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:22 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:24.354771 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-3219080d-cf1e-4709-8b8b-8e07ae4fa009 req-43076a72-80d5-4519-ae00-21461097f07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d42994f-e35e-413c-a0a3-14bb3878e209", "name": "network-vif-plugged", "status": "completed", "tag": "2a1a7e79-2aa6-49de-b62c-90d4d8aa18d1"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:24.382168 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-3219080d-cf1e-4709-8b8b-8e07ae4fa009 req-43076a72-80d5-4519-ae00-21461097f07d service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:24.386593 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-3219080d-cf1e-4709-8b8b-8e07ae4fa009 req-43076a72-80d5-4519-ae00-21461097f07d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:24.390718 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-3219080d-cf1e-4709-8b8b-8e07ae4fa009 req-43076a72-80d5-4519-ae00-21461097f07d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:24.454501 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-3219080d-cf1e-4709-8b8b-8e07ae4fa009 req-43076a72-80d5-4519-ae00-21461097f07d service nova] Creating event network-vif-plugged:2a1a7e79-2aa6-49de-b62c-90d4d8aa18d1 for instance 9d42994f-e35e-413c-a0a3-14bb3878e209 on n-h2-852085-12 Oct 04 20:39:24.483317 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-3219080d-cf1e-4709-8b8b-8e07ae4fa009 req-43076a72-80d5-4519-ae00-21461097f07d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121903 Oct 04 20:39:24.485322 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 515/1054] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:24.530710 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-a9b90dfb-8fcc-48ca-ab62-826caab982b9 req-3457954f-b0d7-4226-822d-9752d964ba33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73277283-dff3-403d-a03b-b44ab89b63c8", "name": "network-vif-deleted", "tag": "4d3acb0b-9db4-4859-841b-32026dc92298"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:24.563464 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-a9b90dfb-8fcc-48ca-ab62-826caab982b9 req-3457954f-b0d7-4226-822d-9752d964ba33 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:24.566159 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-a9b90dfb-8fcc-48ca-ab62-826caab982b9 req-3457954f-b0d7-4226-822d-9752d964ba33 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:24.567911 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-a9b90dfb-8fcc-48ca-ab62-826caab982b9 req-3457954f-b0d7-4226-822d-9752d964ba33 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:24.608754 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-a9b90dfb-8fcc-48ca-ab62-826caab982b9 req-3457954f-b0d7-4226-822d-9752d964ba33 service nova] Creating event network-vif-deleted:4d3acb0b-9db4-4859-841b-32026dc92298 for instance 73277283-dff3-403d-a03b-b44ab89b63c8 on n-h1-852085-12 Oct 04 20:39:24.620072 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-a9b90dfb-8fcc-48ca-ab62-826caab982b9 req-3457954f-b0d7-4226-822d-9752d964ba33 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130633 Oct 04 20:39:24.623099 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 516/1055] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:24.634356 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:24.636822 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:24.651193 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:24.654046 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:24.655228 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:24.656942 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:24.658080 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:24.659291 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:24.762386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:24.764267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:24.765594 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:24.767042 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lazy-loading 'fault' on Instance uuid 73277283-dff3-403d-a03b-b44ab89b63c8 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:25.027636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:25.064973 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-34b31895-4306-4194-b7cd-fa991df97f45 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 200 len: 1306 microversion: 2.1 time: 0.439054 Oct 04 20:39:25.093709 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 517/1056] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:24 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 1306 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:25.127029 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ff19a089-1ad5-4487-8cda-1fbb89ddb883 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:25.128222 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ff19a089-1ad5-4487-8cda-1fbb89ddb883 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:25.149311 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff19a089-1ad5-4487-8cda-1fbb89ddb883 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:25.150240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff19a089-1ad5-4487-8cda-1fbb89ddb883 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:25.152013 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff19a089-1ad5-4487-8cda-1fbb89ddb883 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:25.152392 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff19a089-1ad5-4487-8cda-1fbb89ddb883 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:25.153618 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff19a089-1ad5-4487-8cda-1fbb89ddb883 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:25.154700 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff19a089-1ad5-4487-8cda-1fbb89ddb883 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:25.551583 n-d-852085-12 devstack@n-api.service[123540]: DEBUG neutronclient.v2_0.client [None req-919bb3cb-f033-4aea-94e7-63551109886b tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=123540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:39:25.553463 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-919bb3cb-f033-4aea-94e7-63551109886b tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 04 20:39:25.553463 n-d-852085-12 devstack@n-api.service[123540]: Neutron server returns request_ids: ['req-1c1de46f-3de1-444f-9b1c-49b0ef789580'] Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-919bb3cb-f033-4aea-94e7-63551109886b tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Request method failure captured: Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/os-security-groups/8b4db4de-f837-4037-9583-8a808f7266a1 HTTP/1.1 Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJnzXlK8eToC7Z1D04wulxkgey77_8YFfySSAslSoH_gZ1P26MYlZ3r3F31oUGzLJBnkZpTl1sNmNcGbRtjV0tMjyIauNIhxC-ztteEC1gXntVMgF3ty7lW7aDHH46q38R_A-Eal9zDIiHnvi32dvfgl-RaAXtmqh6P-qHjhEjgoNC4 Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 8fe6727c071748399777eac51fd08556 Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1408947949 Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8fe6727c071748399777eac51fd08556", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8fe6727c071748399777eac51fd08556"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8fe6727c071748399777eac51fd08556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8fe6727c071748399777eac51fd08556"}]}] Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1408947949 Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 8fe6727c071748399777eac51fd08556 Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1408947949 Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-SecurityGroupsNegativeTestJSON-1408947949-project Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: cc2baf41db034b27a7799f37999b1a9e Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1408947949-project Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: exception: Insufficient rights for removing default security group. Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: Neutron server returns request_ids: ['req-1c1de46f-3de1-444f-9b1c-49b0ef789580'] Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '8b4db4de-f837-4037-9583-8a808f7266a1'} Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:39:25.560111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c1de46f-3de1-444f-9b1c-49b0ef789580'] Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c1de46f-3de1-444f-9b1c-49b0ef789580'] Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c1de46f-3de1-444f-9b1c-49b0ef789580'] Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c1de46f-3de1-444f-9b1c-49b0ef789580'] Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-919bb3cb-f033-4aea-94e7-63551109886b tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: Neutron server returns request_ids: ['req-1c1de46f-3de1-444f-9b1c-49b0ef789580'] {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-919bb3cb-f033-4aea-94e7-63551109886b tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/8b4db4de-f837-4037-9583-8a808f7266a1" status: 400 len: 182 microversion: 2.1 time: 1.633461 Oct 04 20:39:25.580357 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 540/1057] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:39:23 2022] DELETE /compute/v2.1/os-security-groups/8b4db4de-f837-4037-9583-8a808f7266a1 => generated 182 bytes in 1636 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:39:25.598522 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7a9f76af-09cb-4b36-a307-7256215c8fac tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:25.601755 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7a9f76af-09cb-4b36-a307-7256215c8fac tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:25.632346 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7a9f76af-09cb-4b36-a307-7256215c8fac tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:25.633746 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7a9f76af-09cb-4b36-a307-7256215c8fac tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:25.636478 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7a9f76af-09cb-4b36-a307-7256215c8fac tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:25.640891 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7a9f76af-09cb-4b36-a307-7256215c8fac tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:25.642322 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7a9f76af-09cb-4b36-a307-7256215c8fac tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:25.643065 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7a9f76af-09cb-4b36-a307-7256215c8fac tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:25.957440 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ff19a089-1ad5-4487-8cda-1fbb89ddb883 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:25.989613 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ff19a089-1ad5-4487-8cda-1fbb89ddb883 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1473 microversion: 2.1 time: 0.893744 Oct 04 20:39:25.991437 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 518/1058] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:25 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1473 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:26.007022 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e844897f-551c-4c42-9afc-05c2ef4c7642 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Calling method '.version_select at 0x7f77eef63b80>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.196538 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-e844897f-551c-4c42-9afc-05c2ef4c7642 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e3d98e49-50ab-4df2-a080-d50b00a86548 does not exist", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:39:26.198598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.security_group_api [None req-e844897f-551c-4c42-9afc-05c2ef4c7642 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Neutron security group e3d98e49-50ab-4df2-a080-d50b00a86548 not found {{(pid=123539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:39:26.200645 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-e844897f-551c-4c42-9afc-05c2ef4c7642 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] HTTP exception thrown: Security group e3d98e49-50ab-4df2-a080-d50b00a86548 does not exist Oct 04 20:39:26.200645 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-83eca59d-e3b2-4429-8343-fbb585255b7e'] Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e844897f-551c-4c42-9afc-05c2ef4c7642 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Request method failure captured: Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-security-groups/e3d98e49-50ab-4df2-a080-d50b00a86548 HTTP/1.1 Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJnzXlK8eToC7Z1D04wulxkgey77_8YFfySSAslSoH_gZ1P26MYlZ3r3F31oUGzLJBnkZpTl1sNmNcGbRtjV0tMjyIauNIhxC-ztteEC1gXntVMgF3ty7lW7aDHH46q38R_A-Eal9zDIiHnvi32dvfgl-RaAXtmqh6P-qHjhEjgoNC4 Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 8fe6727c071748399777eac51fd08556 Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1408947949 Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8fe6727c071748399777eac51fd08556", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8fe6727c071748399777eac51fd08556"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8fe6727c071748399777eac51fd08556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8fe6727c071748399777eac51fd08556"}]}] Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1408947949 Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 8fe6727c071748399777eac51fd08556 Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1408947949 Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupsNegativeTestJSON-1408947949-project Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: cc2baf41db034b27a7799f37999b1a9e Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1408947949-project Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: exception: Security group e3d98e49-50ab-4df2-a080-d50b00a86548 does not exist Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-83eca59d-e3b2-4429-8343-fbb585255b7e'] Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'e3d98e49-50ab-4df2-a080-d50b00a86548'} Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:39:26.206175 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e3d98e49-50ab-4df2-a080-d50b00a86548 does not exist Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83eca59d-e3b2-4429-8343-fbb585255b7e'] Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e3d98e49-50ab-4df2-a080-d50b00a86548 does not exist Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83eca59d-e3b2-4429-8343-fbb585255b7e'] Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e3d98e49-50ab-4df2-a080-d50b00a86548 does not exist Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83eca59d-e3b2-4429-8343-fbb585255b7e'] Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e3d98e49-50ab-4df2-a080-d50b00a86548 does not exist Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83eca59d-e3b2-4429-8343-fbb585255b7e'] Oct 04 20:39:26.215801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.226285 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e844897f-551c-4c42-9afc-05c2ef4c7642 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Returning 404 to user: Security group e3d98e49-50ab-4df2-a080-d50b00a86548 does not exist Oct 04 20:39:26.226285 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-83eca59d-e3b2-4429-8343-fbb585255b7e'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:26.233001 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e844897f-551c-4c42-9afc-05c2ef4c7642 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/e3d98e49-50ab-4df2-a080-d50b00a86548" status: 404 len: 194 microversion: 2.1 time: 0.222701 Oct 04 20:39:26.234557 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 519/1059] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:39:25 2022] GET /compute/v2.1/os-security-groups/e3d98e49-50ab-4df2-a080-d50b00a86548 => generated 194 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:26.246788 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f6260aa3-3f3b-40f8-b94c-ec58990aec46 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.248343 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f6260aa3-3f3b-40f8-b94c-ec58990aec46 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:26.266587 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6260aa3-3f3b-40f8-b94c-ec58990aec46 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.268673 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6260aa3-3f3b-40f8-b94c-ec58990aec46 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.269833 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6260aa3-3f3b-40f8-b94c-ec58990aec46 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.271863 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6260aa3-3f3b-40f8-b94c-ec58990aec46 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.274919 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6260aa3-3f3b-40f8-b94c-ec58990aec46 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.278973 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f6260aa3-3f3b-40f8-b94c-ec58990aec46 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.391323 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f6260aa3-3f3b-40f8-b94c-ec58990aec46 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f6260aa3-3f3b-40f8-b94c-ec58990aec46 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Request method failure captured: Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645/diagnostics HTTP/1.1 Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJm-Mq8tGYS2U7RR4QOF1A-rM067Qe2xViXk2BeLJ3ZaArEtalIdI6ousGmU4UY__BFa6-O_ukwCKUOHk_5UMwx6x9nX_w1bLQOwyAlJUyWEC_ptUINCrqxtWQkj_dhsdFMBAxWIRPac-IH1if1WAwLidsapBn7-jRCTVrhsJ5ybZzQ Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 7129909d365645369fbe27a2fd00fc88 Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-993072865 Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7129909d365645369fbe27a2fd00fc88", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7129909d365645369fbe27a2fd00fc88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7129909d365645369fbe27a2fd00fc88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7129909d365645369fbe27a2fd00fc88"}]}] Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-993072865 Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 7129909d365645369fbe27a2fd00fc88 Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-993072865 Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServerDiagnosticsNegativeTest-993072865-project Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 96f056a5a16e449385f1b503e1d2231a Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-993072865-project Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'server_id': '7bb70165-8fd0-439d-aa99-cff22896f645'} Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.397643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.415889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:26.415889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:26.415889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:39:26.415889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:39:26.415889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 20:39:26.415889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.415889 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f6260aa3-3f3b-40f8-b94c-ec58990aec46 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:26.415889 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f6260aa3-3f3b-40f8-b94c-ec58990aec46 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.163929 Oct 04 20:39:26.415889 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 520/1060] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:39:26 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645/diagnostics => generated 117 bytes in 167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:26.415889 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-841889d7-46bc-4747-b42a-3060d41b69ac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.415889 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-841889d7-46bc-4747-b42a-3060d41b69ac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 73277283-dff3-403d-a03b-b44ab89b63c8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:26.438695 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-841889d7-46bc-4747-b42a-3060d41b69ac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.441363 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-841889d7-46bc-4747-b42a-3060d41b69ac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.442355 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-841889d7-46bc-4747-b42a-3060d41b69ac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.448461 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-841889d7-46bc-4747-b42a-3060d41b69ac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.456014 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-841889d7-46bc-4747-b42a-3060d41b69ac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.457539 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-841889d7-46bc-4747-b42a-3060d41b69ac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.506794 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-841889d7-46bc-4747-b42a-3060d41b69ac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] HTTP exception thrown: Instance 73277283-dff3-403d-a03b-b44ab89b63c8 could not be found. Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-841889d7-46bc-4747-b42a-3060d41b69ac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Request method failure captured: Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 HTTP/1.1 Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJiX9qFSmM0WIGlyM7HbZzTPpvEuvlvHp38bunRoEM7tEfzOcvUctzJWNch8qf5bzEnXMRNwi_qG22iTzv7XkZD5YSIxebdCaTEMgsrPaAqnGsuLG0461kB-xJ2z1h2lOhJmaxlujAP14GS51da_EIRjI1YwBai6e6BtaI0EwMb_Mrg Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70436b8b504e43dc882f5ee434ecf443", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70436b8b504e43dc882f5ee434ecf443"}]}] Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 5bda0ce3a36747c69b4a78e558a03b1b Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 73277283-dff3-403d-a03b-b44ab89b63c8 could not be found. Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '73277283-dff3-403d-a03b-b44ab89b63c8'} Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73277283-dff3-403d-a03b-b44ab89b63c8 could not be found. Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73277283-dff3-403d-a03b-b44ab89b63c8 could not be found. Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:26.517707 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.544255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.544255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:26.544255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:26.544255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:26.544255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:26.544255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73277283-dff3-403d-a03b-b44ab89b63c8 could not be found. Oct 04 20:39:26.544255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.544255 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-841889d7-46bc-4747-b42a-3060d41b69ac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Returning 404 to user: Instance 73277283-dff3-403d-a03b-b44ab89b63c8 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:26.544255 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-841889d7-46bc-4747-b42a-3060d41b69ac tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8" status: 404 len: 111 microversion: 2.1 time: 0.116446 Oct 04 20:39:26.544255 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 521/1061] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:26 2022] GET /compute/v2.1/servers/73277283-dff3-403d-a03b-b44ab89b63c8 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:26.544255 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-52f7188e-c1a5-4a19-a0f8-54743d1cb118 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Action: 'update', calling method: .version_select at 0x7f77eee81280>, body: {"security_group": {"name": "tempest-sg-1908595545", "description": "tempest-description-2101750447"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:26.639534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-52f7188e-c1a5-4a19-a0f8-54743d1cb118 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d does not exist", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:39:26.639534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.security_group_api [None req-52f7188e-c1a5-4a19-a0f8-54743d1cb118 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Neutron security group 80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d not found {{(pid=123539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:39:26.639534 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-52f7188e-c1a5-4a19-a0f8-54743d1cb118 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] HTTP exception thrown: Security group 80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d does not exist Oct 04 20:39:26.639534 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-a6dd9cb1-37d0-457d-85dc-bf93b48499d5'] Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-52f7188e-c1a5-4a19-a0f8-54743d1cb118 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Request method failure captured: Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: request: PUT /compute/v2.1/os-security-groups/80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d HTTP/1.1 Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 102 Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJnzXlK8eToC7Z1D04wulxkgey77_8YFfySSAslSoH_gZ1P26MYlZ3r3F31oUGzLJBnkZpTl1sNmNcGbRtjV0tMjyIauNIhxC-ztteEC1gXntVMgF3ty7lW7aDHH46q38R_A-Eal9zDIiHnvi32dvfgl-RaAXtmqh6P-qHjhEjgoNC4 Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 8fe6727c071748399777eac51fd08556 Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1408947949 Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8fe6727c071748399777eac51fd08556", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8fe6727c071748399777eac51fd08556"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8fe6727c071748399777eac51fd08556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8fe6727c071748399777eac51fd08556"}]}] Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1408947949 Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 8fe6727c071748399777eac51fd08556 Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1408947949 Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupsNegativeTestJSON-1408947949-project Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: cc2baf41db034b27a7799f37999b1a9e Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1408947949-project Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: {"security_group": {"name": "tempest-sg-1908595545", "description": "tempest-description-2101750447"}} Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: exception: Security group 80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d does not exist Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-a6dd9cb1-37d0-457d-85dc-bf93b48499d5'] Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d', 'body': {'security_group': {'name': 'tempest-sg-1908595545', 'description': 'tempest-description-2101750447'}}} Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:39:26.640456 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d does not exist Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a6dd9cb1-37d0-457d-85dc-bf93b48499d5'] Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d does not exist Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a6dd9cb1-37d0-457d-85dc-bf93b48499d5'] Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d does not exist Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a6dd9cb1-37d0-457d-85dc-bf93b48499d5'] Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d does not exist Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a6dd9cb1-37d0-457d-85dc-bf93b48499d5'] Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-52f7188e-c1a5-4a19-a0f8-54743d1cb118 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] Returning 404 to user: Security group 80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d does not exist Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-a6dd9cb1-37d0-457d-85dc-bf93b48499d5'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:26.649569 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-52f7188e-c1a5-4a19-a0f8-54743d1cb118 tempest-SecurityGroupsNegativeTestJSON-1408947949 tempest-SecurityGroupsNegativeTestJSON-1408947949-project] 10.222.0.78 "PUT /compute/v2.1/os-security-groups/80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d" status: 404 len: 194 microversion: 2.1 time: 0.119288 Oct 04 20:39:26.660068 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 522/1062] 10.222.0.78 () {60 vars in 1290 bytes} [Tue Oct 4 20:39:26 2022] PUT /compute/v2.1/os-security-groups/80dc0f40-574c-42ef-b3b8-6f4f8ea28a1d => generated 194 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:26.684969 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-59c3a5bb-eab5-4dd0-b3fd-0c134e96ff6b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.685875 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-59c3a5bb-eab5-4dd0-b3fd-0c134e96ff6b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:26.727605 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-59c3a5bb-eab5-4dd0-b3fd-0c134e96ff6b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.745832 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-59c3a5bb-eab5-4dd0-b3fd-0c134e96ff6b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.748996 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-59c3a5bb-eab5-4dd0-b3fd-0c134e96ff6b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.754371 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-59c3a5bb-eab5-4dd0-b3fd-0c134e96ff6b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.756459 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-59c3a5bb-eab5-4dd0-b3fd-0c134e96ff6b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.757777 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-59c3a5bb-eab5-4dd0-b3fd-0c134e96ff6b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.878176 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-59c3a5bb-eab5-4dd0-b3fd-0c134e96ff6b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:27.078143 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7a9f76af-09cb-4b36-a307-7256215c8fac tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:27.099155 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7a9f76af-09cb-4b36-a307-7256215c8fac tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1318 microversion: 2.1 time: 1.535471 Oct 04 20:39:27.101199 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 541/1063] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:25 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1318 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:27.121510 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a6d14a85-197e-46e3-98ee-f6770d085c50 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:27.125616 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a6d14a85-197e-46e3-98ee-f6770d085c50 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: d937ec04-8d81-4926-a578-27ca4e58ca63] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:27.152852 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a6d14a85-197e-46e3-98ee-f6770d085c50 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.154384 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a6d14a85-197e-46e3-98ee-f6770d085c50 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.169547 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a6d14a85-197e-46e3-98ee-f6770d085c50 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.171639 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a6d14a85-197e-46e3-98ee-f6770d085c50 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.174317 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a6d14a85-197e-46e3-98ee-f6770d085c50 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.175732 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a6d14a85-197e-46e3-98ee-f6770d085c50 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.260176 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a6d14a85-197e-46e3-98ee-f6770d085c50 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: d937ec04-8d81-4926-a578-27ca4e58ca63] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:27.395586 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:27.493457 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-59c3a5bb-eab5-4dd0-b3fd-0c134e96ff6b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 204 len: 0 microversion: 2.1 time: 0.834349 Oct 04 20:39:27.495226 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 523/1064] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:26 2022] DELETE /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:27.526498 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7a61ab79-a625-43c2-9d04-a1ba963a547b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:27.529081 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7a61ab79-a625-43c2-9d04-a1ba963a547b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:27.560586 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7a61ab79-a625-43c2-9d04-a1ba963a547b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.561577 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7a61ab79-a625-43c2-9d04-a1ba963a547b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.572631 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7a61ab79-a625-43c2-9d04-a1ba963a547b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.574079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7a61ab79-a625-43c2-9d04-a1ba963a547b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.575023 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7a61ab79-a625-43c2-9d04-a1ba963a547b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.575885 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7a61ab79-a625-43c2-9d04-a1ba963a547b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.617437 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:28.085861 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a6d14a85-197e-46e3-98ee-f6770d085c50 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63" status: 204 len: 0 microversion: 2.1 time: 0.982140 Oct 04 20:39:28.093559 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 542/1065] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:27 2022] DELETE /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63 => generated 0 bytes in 986 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:28.110552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d9356dc8-7f8f-4ac5-b381-c8ef550568eb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:28.115318 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d9356dc8-7f8f-4ac5-b381-c8ef550568eb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:28.145205 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9356dc8-7f8f-4ac5-b381-c8ef550568eb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.148724 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9356dc8-7f8f-4ac5-b381-c8ef550568eb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.150205 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9356dc8-7f8f-4ac5-b381-c8ef550568eb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.153653 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9356dc8-7f8f-4ac5-b381-c8ef550568eb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.160177 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9356dc8-7f8f-4ac5-b381-c8ef550568eb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.161564 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d9356dc8-7f8f-4ac5-b381-c8ef550568eb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.279306 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d9356dc8-7f8f-4ac5-b381-c8ef550568eb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:28.886638 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d9356dc8-7f8f-4ac5-b381-c8ef550568eb tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "DELETE /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 204 len: 0 microversion: 2.1 time: 0.789625 Oct 04 20:39:28.896187 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 543/1066] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:28 2022] DELETE /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:28.906584 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-48728ad2-96aa-4319-b8cd-975e011f4a68 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:28.908821 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-48728ad2-96aa-4319-b8cd-975e011f4a68 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:28.924086 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-48728ad2-96aa-4319-b8cd-975e011f4a68 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.924086 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-48728ad2-96aa-4319-b8cd-975e011f4a68 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.925284 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-48728ad2-96aa-4319-b8cd-975e011f4a68 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.927038 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-48728ad2-96aa-4319-b8cd-975e011f4a68 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.929666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-48728ad2-96aa-4319-b8cd-975e011f4a68 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.930958 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-48728ad2-96aa-4319-b8cd-975e011f4a68 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:30.094144 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7a61ab79-a625-43c2-9d04-a1ba963a547b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:30.126827 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7a61ab79-a625-43c2-9d04-a1ba963a547b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1479 microversion: 2.1 time: 2.624135 Oct 04 20:39:30.137743 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 524/1067] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:27 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1479 bytes in 2628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:30.170550 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ca2dee5a-89e1-4b20-b6a4-501b48e3d4fc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:30.172089 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ca2dee5a-89e1-4b20-b6a4-501b48e3d4fc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: d937ec04-8d81-4926-a578-27ca4e58ca63] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:30.210386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ca2dee5a-89e1-4b20-b6a4-501b48e3d4fc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:30.214178 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ca2dee5a-89e1-4b20-b6a4-501b48e3d4fc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:30.218712 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ca2dee5a-89e1-4b20-b6a4-501b48e3d4fc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:30.224673 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ca2dee5a-89e1-4b20-b6a4-501b48e3d4fc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:30.236315 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ca2dee5a-89e1-4b20-b6a4-501b48e3d4fc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:30.237226 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ca2dee5a-89e1-4b20-b6a4-501b48e3d4fc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.110678 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-48728ad2-96aa-4319-b8cd-975e011f4a68 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:31.158043 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-48728ad2-96aa-4319-b8cd-975e011f4a68 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1468 microversion: 2.1 time: 2.259387 Oct 04 20:39:31.159840 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 544/1068] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:28 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1468 bytes in 2264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:31.198941 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-84875e5b-e240-4804-9dd4-bbe280ed8f1c tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:31.211391 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-84875e5b-e240-4804-9dd4-bbe280ed8f1c tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:31.227988 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84875e5b-e240-4804-9dd4-bbe280ed8f1c tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.232189 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84875e5b-e240-4804-9dd4-bbe280ed8f1c tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.235859 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84875e5b-e240-4804-9dd4-bbe280ed8f1c tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.238249 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84875e5b-e240-4804-9dd4-bbe280ed8f1c tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.241938 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84875e5b-e240-4804-9dd4-bbe280ed8f1c tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.243489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84875e5b-e240-4804-9dd4-bbe280ed8f1c tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:32.379952 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ca2dee5a-89e1-4b20-b6a4-501b48e3d4fc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:32.450281 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ca2dee5a-89e1-4b20-b6a4-501b48e3d4fc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63" status: 200 len: 1475 microversion: 2.1 time: 2.310917 Oct 04 20:39:32.467952 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 525/1069] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:30 2022] GET /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63 => generated 1475 bytes in 2330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:32.537521 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8f70128a-8bdc-47e3-a2b8-3c76401db266 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:32.547405 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8f70128a-8bdc-47e3-a2b8-3c76401db266 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:32.597309 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8f70128a-8bdc-47e3-a2b8-3c76401db266 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:32.599054 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8f70128a-8bdc-47e3-a2b8-3c76401db266 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:32.601099 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8f70128a-8bdc-47e3-a2b8-3c76401db266 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:32.612545 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8f70128a-8bdc-47e3-a2b8-3c76401db266 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:32.614293 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8f70128a-8bdc-47e3-a2b8-3c76401db266 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:32.620564 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8f70128a-8bdc-47e3-a2b8-3c76401db266 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.537472 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-84875e5b-e240-4804-9dd4-bbe280ed8f1c tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:33.589929 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-84875e5b-e240-4804-9dd4-bbe280ed8f1c tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1479 microversion: 2.1 time: 2.396822 Oct 04 20:39:33.591610 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 545/1070] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:31 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1479 bytes in 2408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:33.609433 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2640d931-4f5d-45f4-9f1b-382df91f7d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:33.614570 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2640d931-4f5d-45f4-9f1b-382df91f7d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: d937ec04-8d81-4926-a578-27ca4e58ca63] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:33.635308 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2640d931-4f5d-45f4-9f1b-382df91f7d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.637498 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2640d931-4f5d-45f4-9f1b-382df91f7d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.639079 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2640d931-4f5d-45f4-9f1b-382df91f7d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.644564 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2640d931-4f5d-45f4-9f1b-382df91f7d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.645895 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2640d931-4f5d-45f4-9f1b-382df91f7d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.648347 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2640d931-4f5d-45f4-9f1b-382df91f7d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:35.645872 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8f70128a-8bdc-47e3-a2b8-3c76401db266 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:35.676484 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8f70128a-8bdc-47e3-a2b8-3c76401db266 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364" status: 200 len: 1467 microversion: 2.1 time: 3.202722 Oct 04 20:39:35.709722 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 526/1071] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:32 2022] GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364 => generated 1467 bytes in 3239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:36.325463 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-62d644dd-7baf-4571-b99c-70b965f62007 tempest-FloatingIPDetailsNegativeTestJSON-2142526674 tempest-FloatingIPDetailsNegativeTestJSON-2142526674-project] Calling method '.version_select at 0x7f77eef1ea60>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:37.352985 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-62d644dd-7baf-4571-b99c-70b965f62007 tempest-FloatingIPDetailsNegativeTestJSON-2142526674 tempest-FloatingIPDetailsNegativeTestJSON-2142526674-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3aebf7e5-aa93-4a02-b6bc-2c989702a2ec could not be found", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:39:37.354183 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-62d644dd-7baf-4571-b99c-70b965f62007 tempest-FloatingIPDetailsNegativeTestJSON-2142526674 tempest-FloatingIPDetailsNegativeTestJSON-2142526674-project] HTTP exception thrown: Floating IP not found for ID 3aebf7e5-aa93-4a02-b6bc-2c989702a2ec Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-62d644dd-7baf-4571-b99c-70b965f62007 tempest-FloatingIPDetailsNegativeTestJSON-2142526674 tempest-FloatingIPDetailsNegativeTestJSON-2142526674-project] Request method failure captured: Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-floating-ips/3aebf7e5-aa93-4a02-b6bc-2c989702a2ec HTTP/1.1 Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJoFSYs0JlH7RqtMuyOxLbPEniWNcTDfaKOAkw6E3UaHqN9AKXDre3WGMJEwDOXO4FY4QDpKj3J2xncM7Pe6e_4iWJXl6OAsWTTIjzY_fR8WlziLhDFQqjQd9_arCydYWKYb3xYF4xaRrjOsIWS_fB2iFo-2rTc-MVZxJo4Zak9nWXA Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: ab7f55d3f0d44d26b00ae52218511449 Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2142526674 Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ab7f55d3f0d44d26b00ae52218511449", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ab7f55d3f0d44d26b00ae52218511449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ab7f55d3f0d44d26b00ae52218511449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ab7f55d3f0d44d26b00ae52218511449"}]}] Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2142526674 Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: ab7f55d3f0d44d26b00ae52218511449 Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2142526674 Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2142526674-project Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: aba032bf12f24d9eb0aeef133ba7b10c Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2142526674-project Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: exception: Floating IP not found for ID 3aebf7e5-aa93-4a02-b6bc-2c989702a2ec Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '3aebf7e5-aa93-4a02-b6bc-2c989702a2ec'} Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:39:37.358788 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3aebf7e5-aa93-4a02-b6bc-2c989702a2ec could not be found Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c73596f5-1db2-42fc-abc5-18edf98e6a40'] Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3aebf7e5-aa93-4a02-b6bc-2c989702a2ec. Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3aebf7e5-aa93-4a02-b6bc-2c989702a2ec Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3aebf7e5-aa93-4a02-b6bc-2c989702a2ec Oct 04 20:39:37.370860 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:37.381074 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-62d644dd-7baf-4571-b99c-70b965f62007 tempest-FloatingIPDetailsNegativeTestJSON-2142526674 tempest-FloatingIPDetailsNegativeTestJSON-2142526674-project] Returning 404 to user: Floating IP not found for ID 3aebf7e5-aa93-4a02-b6bc-2c989702a2ec {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:37.386144 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-62d644dd-7baf-4571-b99c-70b965f62007 tempest-FloatingIPDetailsNegativeTestJSON-2142526674 tempest-FloatingIPDetailsNegativeTestJSON-2142526674-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/3aebf7e5-aa93-4a02-b6bc-2c989702a2ec" status: 404 len: 111 microversion: 2.1 time: 1.672565 Oct 04 20:39:37.387713 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 527/1072] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:39:35 2022] GET /compute/v2.1/os-floating-ips/3aebf7e5-aa93-4a02-b6bc-2c989702a2ec => generated 111 bytes in 1679 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:37.427182 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-cdce264c-23e9-48ad-a79d-498b29d50cff req-894e7ab9-672c-49dc-ae71-774a5b387ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74855781-6009-4525-8bdc-cad56a09a352", "name": "network-vif-unplugged", "status": "completed", "tag": "f1539adb-7984-4760-843a-2936f8ddf173"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:37.480756 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-cdce264c-23e9-48ad-a79d-498b29d50cff req-894e7ab9-672c-49dc-ae71-774a5b387ef9 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:37.481642 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-cdce264c-23e9-48ad-a79d-498b29d50cff req-894e7ab9-672c-49dc-ae71-774a5b387ef9 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:37.482473 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-cdce264c-23e9-48ad-a79d-498b29d50cff req-894e7ab9-672c-49dc-ae71-774a5b387ef9 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:37.515548 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-cdce264c-23e9-48ad-a79d-498b29d50cff req-894e7ab9-672c-49dc-ae71-774a5b387ef9 service nova] Creating event network-vif-unplugged:f1539adb-7984-4760-843a-2936f8ddf173 for instance 74855781-6009-4525-8bdc-cad56a09a352 on n-h2-852085-12 Oct 04 20:39:37.527456 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-cdce264c-23e9-48ad-a79d-498b29d50cff req-894e7ab9-672c-49dc-ae71-774a5b387ef9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134653 Oct 04 20:39:37.530270 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 528/1073] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:37.542123 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a1b7d16c-6600-4f70-ac65-63cec1556913 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:37.544218 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a1b7d16c-6600-4f70-ac65-63cec1556913 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:37.558313 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1b7d16c-6600-4f70-ac65-63cec1556913 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:37.560565 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1b7d16c-6600-4f70-ac65-63cec1556913 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:37.561761 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1b7d16c-6600-4f70-ac65-63cec1556913 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:37.563666 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1b7d16c-6600-4f70-ac65-63cec1556913 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:37.580730 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1b7d16c-6600-4f70-ac65-63cec1556913 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:37.582059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1b7d16c-6600-4f70-ac65-63cec1556913 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:37.999896 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a1b7d16c-6600-4f70-ac65-63cec1556913 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:38.039548 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a1b7d16c-6600-4f70-ac65-63cec1556913 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1437 microversion: 2.1 time: 0.506490 Oct 04 20:39:38.040898 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 529/1074] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:37 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1437 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:38.065981 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0fa0f0a5-ac92-4cb1-afae-d6d191e51482 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-850193967"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:38.079180 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-0fa0f0a5-ac92-4cb1-afae-d6d191e51482 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:38.116591 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0fa0f0a5-ac92-4cb1-afae-d6d191e51482 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.124890 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0fa0f0a5-ac92-4cb1-afae-d6d191e51482 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.125892 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0fa0f0a5-ac92-4cb1-afae-d6d191e51482 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:38.127114 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0fa0f0a5-ac92-4cb1-afae-d6d191e51482 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.128131 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0fa0f0a5-ac92-4cb1-afae-d6d191e51482 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.128862 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0fa0f0a5-ac92-4cb1-afae-d6d191e51482 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:38.190380 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-2640d931-4f5d-45f4-9f1b-382df91f7d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:38.240811 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2640d931-4f5d-45f4-9f1b-382df91f7d70 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63" status: 200 len: 1475 microversion: 2.1 time: 4.642608 Oct 04 20:39:38.284611 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 546/1075] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:33 2022] GET /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63 => generated 1475 bytes in 4692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:38.348502 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-e2c87842-e356-4f21-a387-8878c5d44220 req-53973645-98b3-432a-bb09-9ebc0f991bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d937ec04-8d81-4926-a578-27ca4e58ca63", "name": "network-vif-deleted", "tag": "f5495aac-c2d7-419a-9cc9-79e9ec72c16c"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:38.388432 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=3 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:38.455919 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e2c87842-e356-4f21-a387-8878c5d44220 req-53973645-98b3-432a-bb09-9ebc0f991bfc service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.458401 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e2c87842-e356-4f21-a387-8878c5d44220 req-53973645-98b3-432a-bb09-9ebc0f991bfc service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.467683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-e2c87842-e356-4f21-a387-8878c5d44220 req-53973645-98b3-432a-bb09-9ebc0f991bfc service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:38.580597 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-e2c87842-e356-4f21-a387-8878c5d44220 req-53973645-98b3-432a-bb09-9ebc0f991bfc service nova] Creating event network-vif-deleted:f5495aac-c2d7-419a-9cc9-79e9ec72c16c for instance d937ec04-8d81-4926-a578-27ca4e58ca63 on n-h1-852085-12 Oct 04 20:39:38.626626 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-e2c87842-e356-4f21-a387-8878c5d44220 req-53973645-98b3-432a-bb09-9ebc0f991bfc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.339289 Oct 04 20:39:38.635686 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 547/1076] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:38.750642 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-05752798-e474-4f65-9811-768b7df0e5c5 req-db0babca-f72a-47fa-bb93-503379ae3a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb70165-8fd0-439d-aa99-cff22896f645", "name": "network-vif-deleted", "tag": "3816d2e0-249b-44b8-be16-c80be3f1c4e8"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:38.777711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-05752798-e474-4f65-9811-768b7df0e5c5 req-db0babca-f72a-47fa-bb93-503379ae3a6f service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.781045 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-05752798-e474-4f65-9811-768b7df0e5c5 req-db0babca-f72a-47fa-bb93-503379ae3a6f service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.782520 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-05752798-e474-4f65-9811-768b7df0e5c5 req-db0babca-f72a-47fa-bb93-503379ae3a6f service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:38.821924 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-05752798-e474-4f65-9811-768b7df0e5c5 req-db0babca-f72a-47fa-bb93-503379ae3a6f service nova] Creating event network-vif-deleted:3816d2e0-249b-44b8-be16-c80be3f1c4e8 for instance 7bb70165-8fd0-439d-aa99-cff22896f645 on n-h1-852085-12 Oct 04 20:39:38.836054 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-05752798-e474-4f65-9811-768b7df0e5c5 req-db0babca-f72a-47fa-bb93-503379ae3a6f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097237 Oct 04 20:39:38.838126 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 548/1077] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:39.098402 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1de94a1d-be7b-4757-a78a-df6041657f20 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.100390 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1de94a1d-be7b-4757-a78a-df6041657f20 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:39.169227 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1de94a1d-be7b-4757-a78a-df6041657f20 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.172965 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1de94a1d-be7b-4757-a78a-df6041657f20 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.175620 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1de94a1d-be7b-4757-a78a-df6041657f20 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.189475 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1de94a1d-be7b-4757-a78a-df6041657f20 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.190372 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1de94a1d-be7b-4757-a78a-df6041657f20 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.196286 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1de94a1d-be7b-4757-a78a-df6041657f20 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.465797 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0fa0f0a5-ac92-4cb1-afae-d6d191e51482 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "POST /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364/action" status: 202 len: 0 microversion: 2.1 time: 1.419600 Oct 04 20:39:39.466899 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 530/1078] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:39:38 2022] POST /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364/action => generated 0 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:39:39.501494 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c1ec226c-c6b9-4ff8-aa2a-e9f501ece9bc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.506240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c1ec226c-c6b9-4ff8-aa2a-e9f501ece9bc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: d937ec04-8d81-4926-a578-27ca4e58ca63] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:39.531552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1de94a1d-be7b-4757-a78a-df6041657f20 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:39.549892 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c1ec226c-c6b9-4ff8-aa2a-e9f501ece9bc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.560766 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c1ec226c-c6b9-4ff8-aa2a-e9f501ece9bc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.564442 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c1ec226c-c6b9-4ff8-aa2a-e9f501ece9bc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.570263 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c1ec226c-c6b9-4ff8-aa2a-e9f501ece9bc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.571576 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c1ec226c-c6b9-4ff8-aa2a-e9f501ece9bc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.572559 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c1ec226c-c6b9-4ff8-aa2a-e9f501ece9bc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.574540 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1de94a1d-be7b-4757-a78a-df6041657f20 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1308 microversion: 2.1 time: 0.493077 Oct 04 20:39:39.580800 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 549/1079] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:39 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1308 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:39.608822 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-904142f5-7be9-4c0b-a54f-ad861c516c56 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef82b670>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.638594 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-c1ec226c-c6b9-4ff8-aa2a-e9f501ece9bc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] HTTP exception thrown: Instance d937ec04-8d81-4926-a578-27ca4e58ca63 could not be found. Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c1ec226c-c6b9-4ff8-aa2a-e9f501ece9bc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Request method failure captured: Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63 HTTP/1.1 Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJiX9qFSmM0WIGlyM7HbZzTPpvEuvlvHp38bunRoEM7tEfzOcvUctzJWNch8qf5bzEnXMRNwi_qG22iTzv7XkZD5YSIxebdCaTEMgsrPaAqnGsuLG0461kB-xJ2z1h2lOhJmaxlujAP14GS51da_EIRjI1YwBai6e6BtaI0EwMb_Mrg Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70436b8b504e43dc882f5ee434ecf443", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70436b8b504e43dc882f5ee434ecf443"}]}] Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 5bda0ce3a36747c69b4a78e558a03b1b Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance d937ec04-8d81-4926-a578-27ca4e58ca63 could not be found. Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'd937ec04-8d81-4926-a578-27ca4e58ca63'} Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d937ec04-8d81-4926-a578-27ca4e58ca63 could not be found. Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d937ec04-8d81-4926-a578-27ca4e58ca63 could not be found. Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:39.644197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.651801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:39.651801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:39.651801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:39.651801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:39.651801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:39.651801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d937ec04-8d81-4926-a578-27ca4e58ca63 could not be found. Oct 04 20:39:39.651801 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.660246 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c1ec226c-c6b9-4ff8-aa2a-e9f501ece9bc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Returning 404 to user: Instance d937ec04-8d81-4926-a578-27ca4e58ca63 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:39.663634 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c1ec226c-c6b9-4ff8-aa2a-e9f501ece9bc tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63" status: 404 len: 111 microversion: 2.1 time: 0.183035 Oct 04 20:39:39.670893 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 531/1080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:39 2022] GET /compute/v2.1/servers/d937ec04-8d81-4926-a578-27ca4e58ca63 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:39.699108 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-562acf7c-146a-4a55-8351-ae6105fb548f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.703671 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-562acf7c-146a-4a55-8351-ae6105fb548f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 74855781-6009-4525-8bdc-cad56a09a352] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:39.743566 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-562acf7c-146a-4a55-8351-ae6105fb548f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.744705 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-562acf7c-146a-4a55-8351-ae6105fb548f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.750834 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-562acf7c-146a-4a55-8351-ae6105fb548f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.752920 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-562acf7c-146a-4a55-8351-ae6105fb548f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.754358 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-562acf7c-146a-4a55-8351-ae6105fb548f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.756614 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-562acf7c-146a-4a55-8351-ae6105fb548f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.791065 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-904142f5-7be9-4c0b-a54f-ad861c516c56 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.207365 Oct 04 20:39:39.792981 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 550/1081] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:39 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:39.871329 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-562acf7c-146a-4a55-8351-ae6105fb548f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] HTTP exception thrown: Instance 74855781-6009-4525-8bdc-cad56a09a352 could not be found. Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-562acf7c-146a-4a55-8351-ae6105fb548f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Request method failure captured: Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 HTTP/1.1 Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJiX9qFSmM0WIGlyM7HbZzTPpvEuvlvHp38bunRoEM7tEfzOcvUctzJWNch8qf5bzEnXMRNwi_qG22iTzv7XkZD5YSIxebdCaTEMgsrPaAqnGsuLG0461kB-xJ2z1h2lOhJmaxlujAP14GS51da_EIRjI1YwBai6e6BtaI0EwMb_Mrg Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70436b8b504e43dc882f5ee434ecf443", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70436b8b504e43dc882f5ee434ecf443"}]}] Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 5bda0ce3a36747c69b4a78e558a03b1b Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 74855781-6009-4525-8bdc-cad56a09a352 could not be found. Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '74855781-6009-4525-8bdc-cad56a09a352'} Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74855781-6009-4525-8bdc-cad56a09a352 could not be found. Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74855781-6009-4525-8bdc-cad56a09a352 could not be found. Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:39.872239 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.885294 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:39.885294 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:39.885294 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:39.885294 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:39.885294 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:39.885294 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74855781-6009-4525-8bdc-cad56a09a352 could not be found. Oct 04 20:39:39.885294 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.897094 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-562acf7c-146a-4a55-8351-ae6105fb548f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Returning 404 to user: Instance 74855781-6009-4525-8bdc-cad56a09a352 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:39.897094 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-562acf7c-146a-4a55-8351-ae6105fb548f tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352" status: 404 len: 111 microversion: 2.1 time: 0.215326 Oct 04 20:39:39.907444 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-35c52ee1-d163-42f9-a2ba-2372ab1d4ba7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.908145 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 532/1082] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:39 2022] GET /compute/v2.1/servers/74855781-6009-4525-8bdc-cad56a09a352 => generated 111 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:40.100857 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-35c52ee1-d163-42f9-a2ba-2372ab1d4ba7 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/f8f639ea-6302-42b9-87dc-b2de964d9733" status: 204 len: 0 microversion: 2.1 time: 0.200806 Oct 04 20:39:40.107418 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 551/1083] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:39:39 2022] DELETE /compute/v2.1/os-server-groups/f8f639ea-6302-42b9-87dc-b2de964d9733 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:40.122192 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9f43c06b-8abc-4ab4-bb09-96c07749b764 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:40.123790 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9f43c06b-8abc-4ab4-bb09-96c07749b764 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 75de593c-9f57-471f-a519-d97960ccde5f] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:40.155253 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9f43c06b-8abc-4ab4-bb09-96c07749b764 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:40.156160 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9f43c06b-8abc-4ab4-bb09-96c07749b764 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:40.156972 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9f43c06b-8abc-4ab4-bb09-96c07749b764 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.158338 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9f43c06b-8abc-4ab4-bb09-96c07749b764 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:40.159259 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9f43c06b-8abc-4ab4-bb09-96c07749b764 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:40.164986 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9f43c06b-8abc-4ab4-bb09-96c07749b764 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.331447 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9f43c06b-8abc-4ab4-bb09-96c07749b764 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 75de593c-9f57-471f-a519-d97960ccde5f] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:40.477217 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-4fcd2f65-50c3-4ccd-b747-52d832f53f16 req-41b8c1f4-fe4e-4e8e-bf97-5842258a03a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb70165-8fd0-439d-aa99-cff22896f645", "name": "network-vif-unplugged", "status": "completed", "tag": "3816d2e0-249b-44b8-be16-c80be3f1c4e8"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:40.513597 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-4fcd2f65-50c3-4ccd-b747-52d832f53f16 req-41b8c1f4-fe4e-4e8e-bf97-5842258a03a4 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:40.523772 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-4fcd2f65-50c3-4ccd-b747-52d832f53f16 req-41b8c1f4-fe4e-4e8e-bf97-5842258a03a4 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:40.525126 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-4fcd2f65-50c3-4ccd-b747-52d832f53f16 req-41b8c1f4-fe4e-4e8e-bf97-5842258a03a4 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.588462 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-4fcd2f65-50c3-4ccd-b747-52d832f53f16 req-41b8c1f4-fe4e-4e8e-bf97-5842258a03a4 service nova] Creating event network-vif-unplugged:3816d2e0-249b-44b8-be16-c80be3f1c4e8 for instance 7bb70165-8fd0-439d-aa99-cff22896f645 on n-h1-852085-12 Oct 04 20:39:40.626589 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-4fcd2f65-50c3-4ccd-b747-52d832f53f16 req-41b8c1f4-fe4e-4e8e-bf97-5842258a03a4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.158211 Oct 04 20:39:40.630361 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 552/1084] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:39:40.662279 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:40.664744 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:40.696995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:40.704615 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:40.705878 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.707638 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:40.713231 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:40.714769 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.936448 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:40.936775 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9f43c06b-8abc-4ab4-bb09-96c07749b764 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "DELETE /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f" status: 204 len: 0 microversion: 2.1 time: 0.825848 Oct 04 20:39:40.943096 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 533/1085] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:40 2022] DELETE /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f => generated 0 bytes in 830 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:39:40.949252 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:40.950013 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c5b6f34b-85e7-4afe-83e4-b2d15003aba0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eef1e550>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:40.954960 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.956471 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lazy-loading 'fault' on Instance uuid 7bb70165-8fd0-439d-aa99-cff22896f645 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:41.071596 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c5b6f34b-85e7-4afe-83e4-b2d15003aba0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.130734 Oct 04 20:39:41.072764 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 534/1086] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:40 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:41.097421 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-36d3d769-1a9b-4952-827d-32d269b896d2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:41.103501 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-36d3d769-1a9b-4952-827d-32d269b896d2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:41.114025 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-36d3d769-1a9b-4952-827d-32d269b896d2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:41.115599 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-36d3d769-1a9b-4952-827d-32d269b896d2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:41.116872 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-36d3d769-1a9b-4952-827d-32d269b896d2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:41.118596 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-36d3d769-1a9b-4952-827d-32d269b896d2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:41.119902 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-36d3d769-1a9b-4952-827d-32d269b896d2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:41.123065 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-36d3d769-1a9b-4952-827d-32d269b896d2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:41.203882 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-36d3d769-1a9b-4952-827d-32d269b896d2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:41.691645 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f056a5a16e449385f1b503e1d2231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7129909d365645369fbe27a2fd00fc88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:41.730712 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1987fab0-8e63-4c54-bc4a-35dde231fb9b tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 200 len: 1313 microversion: 2.1 time: 1.095390 Oct 04 20:39:41.736882 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 553/1087] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:40 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 1313 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:41.771936 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-1d7d84bb-4355-44f6-a940-37a4b6a1a1f0 req-0a70901d-d078-4add-b3df-3a3d0effd27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74855781-6009-4525-8bdc-cad56a09a352", "name": "network-vif-deleted", "tag": "f1539adb-7984-4760-843a-2936f8ddf173"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:41.835508 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-1d7d84bb-4355-44f6-a940-37a4b6a1a1f0 req-0a70901d-d078-4add-b3df-3a3d0effd27a service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:41.838728 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-1d7d84bb-4355-44f6-a940-37a4b6a1a1f0 req-0a70901d-d078-4add-b3df-3a3d0effd27a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:41.843091 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-1d7d84bb-4355-44f6-a940-37a4b6a1a1f0 req-0a70901d-d078-4add-b3df-3a3d0effd27a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:41.908345 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-1d7d84bb-4355-44f6-a940-37a4b6a1a1f0 req-0a70901d-d078-4add-b3df-3a3d0effd27a service nova] Creating event network-vif-deleted:f1539adb-7984-4760-843a-2936f8ddf173 for instance 74855781-6009-4525-8bdc-cad56a09a352 on n-h2-852085-12 Oct 04 20:39:41.908673 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-36d3d769-1a9b-4952-827d-32d269b896d2 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "DELETE /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 204 len: 0 microversion: 2.1 time: 0.820331 Oct 04 20:39:41.914942 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 535/1088] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:41 2022] DELETE /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:41.928343 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-1d7d84bb-4355-44f6-a940-37a4b6a1a1f0 req-0a70901d-d078-4add-b3df-3a3d0effd27a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180533 Oct 04 20:39:41.929999 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3af233c1-77be-46cb-81e1-36f1f3fa54c8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:41.931556 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3af233c1-77be-46cb-81e1-36f1f3fa54c8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 75de593c-9f57-471f-a519-d97960ccde5f] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:41.931936 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 554/1089] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:41.951025 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3af233c1-77be-46cb-81e1-36f1f3fa54c8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:41.953920 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3af233c1-77be-46cb-81e1-36f1f3fa54c8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:41.956477 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3af233c1-77be-46cb-81e1-36f1f3fa54c8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:41.958244 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3af233c1-77be-46cb-81e1-36f1f3fa54c8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:41.959682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3af233c1-77be-46cb-81e1-36f1f3fa54c8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:41.960924 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3af233c1-77be-46cb-81e1-36f1f3fa54c8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:42.106531 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2687d63c-4adc-4718-8256-25d468024450 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77efab1820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:42.217611 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2687d63c-4adc-4718-8256-25d468024450 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.123521 Oct 04 20:39:42.219997 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 555/1090] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:42 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:42.570255 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3af233c1-77be-46cb-81e1-36f1f3fa54c8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:42.604513 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3af233c1-77be-46cb-81e1-36f1f3fa54c8 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f" status: 200 len: 1474 microversion: 2.1 time: 0.686925 Oct 04 20:39:42.609765 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 536/1091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:41 2022] GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f => generated 1474 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:42.788723 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d3fce1eb-0325-4cef-a752-87f337b46cf6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:42.792112 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d3fce1eb-0325-4cef-a752-87f337b46cf6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] [instance: 7bb70165-8fd0-439d-aa99-cff22896f645] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:42.824173 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3fce1eb-0325-4cef-a752-87f337b46cf6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:42.832563 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3fce1eb-0325-4cef-a752-87f337b46cf6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:42.832563 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3fce1eb-0325-4cef-a752-87f337b46cf6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:42.832563 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3fce1eb-0325-4cef-a752-87f337b46cf6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:42.832563 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3fce1eb-0325-4cef-a752-87f337b46cf6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:42.832563 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d3fce1eb-0325-4cef-a752-87f337b46cf6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:42.899511 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-d3fce1eb-0325-4cef-a752-87f337b46cf6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] HTTP exception thrown: Instance 7bb70165-8fd0-439d-aa99-cff22896f645 could not be found. Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d3fce1eb-0325-4cef-a752-87f337b46cf6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Request method failure captured: Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 HTTP/1.1 Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJm-Mq8tGYS2U7RR4QOF1A-rM067Qe2xViXk2BeLJ3ZaArEtalIdI6ousGmU4UY__BFa6-O_ukwCKUOHk_5UMwx6x9nX_w1bLQOwyAlJUyWEC_ptUINCrqxtWQkj_dhsdFMBAxWIRPac-IH1if1WAwLidsapBn7-jRCTVrhsJ5ybZzQ Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 7129909d365645369fbe27a2fd00fc88 Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-993072865 Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7129909d365645369fbe27a2fd00fc88", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7129909d365645369fbe27a2fd00fc88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7129909d365645369fbe27a2fd00fc88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7129909d365645369fbe27a2fd00fc88"}]}] Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-993072865 Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 7129909d365645369fbe27a2fd00fc88 Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-993072865 Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerDiagnosticsNegativeTest-993072865-project Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 96f056a5a16e449385f1b503e1d2231a Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-993072865-project Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 7bb70165-8fd0-439d-aa99-cff22896f645 could not be found. Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '7bb70165-8fd0-439d-aa99-cff22896f645'} Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb70165-8fd0-439d-aa99-cff22896f645 could not be found. Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb70165-8fd0-439d-aa99-cff22896f645 could not be found. Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:42.911969 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:42.929659 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:42.929659 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:42.929659 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:42.929659 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:42.929659 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:42.929659 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:42.929659 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb70165-8fd0-439d-aa99-cff22896f645 could not be found. Oct 04 20:39:42.929659 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:42.929659 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d3fce1eb-0325-4cef-a752-87f337b46cf6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] Returning 404 to user: Instance 7bb70165-8fd0-439d-aa99-cff22896f645 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:42.937129 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d3fce1eb-0325-4cef-a752-87f337b46cf6 tempest-ServerDiagnosticsNegativeTest-993072865 tempest-ServerDiagnosticsNegativeTest-993072865-project] 10.222.0.78 "GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645" status: 404 len: 111 microversion: 2.1 time: 0.146202 Oct 04 20:39:42.938350 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 556/1092] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:42 2022] GET /compute/v2.1/servers/7bb70165-8fd0-439d-aa99-cff22896f645 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:43.250644 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3950b270-071e-4570-aa15-20351d6b638f tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eef62f70>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:43.402759 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3950b270-071e-4570-aa15-20351d6b638f tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.163077 Oct 04 20:39:43.411708 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 537/1093] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:43 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:43.659158 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8942baf5-9eed-4c4c-b06e-800dade7402a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:43.660352 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8942baf5-9eed-4c4c-b06e-800dade7402a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 75de593c-9f57-471f-a519-d97960ccde5f] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:43.706129 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8942baf5-9eed-4c4c-b06e-800dade7402a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:43.707016 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8942baf5-9eed-4c4c-b06e-800dade7402a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:43.707930 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8942baf5-9eed-4c4c-b06e-800dade7402a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:43.715331 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8942baf5-9eed-4c4c-b06e-800dade7402a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:43.716296 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8942baf5-9eed-4c4c-b06e-800dade7402a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:43.719463 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8942baf5-9eed-4c4c-b06e-800dade7402a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:44.441945 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ad972e26-85b7-4a7a-9f56-f768c1a87fc9 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee858b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:44.637769 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ad972e26-85b7-4a7a-9f56-f768c1a87fc9 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.204106 Oct 04 20:39:44.640830 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 538/1094] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:44 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:44.756812 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8942baf5-9eed-4c4c-b06e-800dade7402a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:44.774198 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8942baf5-9eed-4c4c-b06e-800dade7402a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f" status: 200 len: 1474 microversion: 2.1 time: 1.124178 Oct 04 20:39:44.777362 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 557/1095] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:43 2022] GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f => generated 1474 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:45.692227 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ac97e324-654c-4529-aeb2-5ba2ae63d6fd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee851f0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:45.832701 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ac97e324-654c-4529-aeb2-5ba2ae63d6fd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.166475 Oct 04 20:39:45.844105 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 539/1096] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:45 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:45.850102 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8601495f-5f06-4397-a76d-131bdee0f257 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:45.861959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8601495f-5f06-4397-a76d-131bdee0f257 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 75de593c-9f57-471f-a519-d97960ccde5f] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:45.883951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8601495f-5f06-4397-a76d-131bdee0f257 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:45.888354 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8601495f-5f06-4397-a76d-131bdee0f257 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:45.890994 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8601495f-5f06-4397-a76d-131bdee0f257 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:45.898821 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8601495f-5f06-4397-a76d-131bdee0f257 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:45.901454 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8601495f-5f06-4397-a76d-131bdee0f257 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:45.905016 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8601495f-5f06-4397-a76d-131bdee0f257 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:46.889210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-54efae85-1bb9-4934-9c1f-294bd9da113b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eef01790>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:47.065668 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-54efae85-1bb9-4934-9c1f-294bd9da113b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.196879 Oct 04 20:39:47.068398 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 540/1097] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:46 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:47.454100 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8601495f-5f06-4397-a76d-131bdee0f257 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:47.493668 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8601495f-5f06-4397-a76d-131bdee0f257 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f" status: 200 len: 1474 microversion: 2.1 time: 1.678886 Oct 04 20:39:47.529034 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 558/1098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:45 2022] GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f => generated 1474 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:48.098399 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6b6bc7a8-6681-4b61-b88f-8a3efd0a4539 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eeed1b80>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:48.263295 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6b6bc7a8-6681-4b61-b88f-8a3efd0a4539 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.169999 Oct 04 20:39:48.268678 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 541/1099] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:48 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:48.340215 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-be3497a5-66fa-44ba-a99e-f3e1d3b70800 req-356c6e23-9e08-42a4-ba44-0d342c925efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acea6767-d8a4-488e-8d07-1c7362778255", "name": "network-vif-deleted", "tag": "883b816a-c7ca-4854-9627-ee3644556a24"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:48.366515 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-be3497a5-66fa-44ba-a99e-f3e1d3b70800 req-356c6e23-9e08-42a4-ba44-0d342c925efd service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:48.373520 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-be3497a5-66fa-44ba-a99e-f3e1d3b70800 req-356c6e23-9e08-42a4-ba44-0d342c925efd service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:48.375011 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-be3497a5-66fa-44ba-a99e-f3e1d3b70800 req-356c6e23-9e08-42a4-ba44-0d342c925efd service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:48.453386 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-be3497a5-66fa-44ba-a99e-f3e1d3b70800 req-356c6e23-9e08-42a4-ba44-0d342c925efd service nova] Creating event network-vif-deleted:883b816a-c7ca-4854-9627-ee3644556a24 for instance acea6767-d8a4-488e-8d07-1c7362778255 on n-h2-852085-12 Oct 04 20:39:48.471755 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-be3497a5-66fa-44ba-a99e-f3e1d3b70800 req-356c6e23-9e08-42a4-ba44-0d342c925efd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142288 Oct 04 20:39:48.474813 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 559/1100] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:48.551056 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bdd2dcba-ec97-4b47-be5d-8c737ac09445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:48.553686 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-bdd2dcba-ec97-4b47-be5d-8c737ac09445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 75de593c-9f57-471f-a519-d97960ccde5f] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:48.582331 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bdd2dcba-ec97-4b47-be5d-8c737ac09445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:48.588568 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bdd2dcba-ec97-4b47-be5d-8c737ac09445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:48.588568 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bdd2dcba-ec97-4b47-be5d-8c737ac09445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:48.588568 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bdd2dcba-ec97-4b47-be5d-8c737ac09445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:48.605250 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bdd2dcba-ec97-4b47-be5d-8c737ac09445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:48.609312 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bdd2dcba-ec97-4b47-be5d-8c737ac09445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:49.072645 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-7f484d77-09bd-4aa1-bd1b-dec748a6ec62 req-bbf74fa4-46d3-412c-837b-e1ef75be1ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75de593c-9f57-471f-a519-d97960ccde5f", "name": "network-vif-deleted", "tag": "1d4c616d-0938-4b70-9e11-adcaef4edc51"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:49.130940 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bdd2dcba-ec97-4b47-be5d-8c737ac09445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:49.186029 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bdd2dcba-ec97-4b47-be5d-8c737ac09445 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f" status: 200 len: 1432 microversion: 2.1 time: 0.645365 Oct 04 20:39:49.187859 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-7f484d77-09bd-4aa1-bd1b-dec748a6ec62 req-bbf74fa4-46d3-412c-837b-e1ef75be1ebe service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:49.189721 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-7f484d77-09bd-4aa1-bd1b-dec748a6ec62 req-bbf74fa4-46d3-412c-837b-e1ef75be1ebe service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:49.206805 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 542/1101] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:48 2022] GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f => generated 1432 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:49.225604 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-7f484d77-09bd-4aa1-bd1b-dec748a6ec62 req-bbf74fa4-46d3-412c-837b-e1ef75be1ebe service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:49.340798 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-eaccb063-10f1-452a-8976-7b7214c6f6f2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eef5e0d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:49.347709 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-7f484d77-09bd-4aa1-bd1b-dec748a6ec62 req-bbf74fa4-46d3-412c-837b-e1ef75be1ebe service nova] Creating event network-vif-deleted:1d4c616d-0938-4b70-9e11-adcaef4edc51 for instance 75de593c-9f57-471f-a519-d97960ccde5f on n-h2-852085-12 Oct 04 20:39:49.382405 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-7f484d77-09bd-4aa1-bd1b-dec748a6ec62 req-bbf74fa4-46d3-412c-837b-e1ef75be1ebe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328202 Oct 04 20:39:49.386077 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 560/1102] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:39:49.584313 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-eaccb063-10f1-452a-8976-7b7214c6f6f2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.292478 Oct 04 20:39:49.637003 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 543/1103] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:49 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:50.283688 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:50.294620 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 75de593c-9f57-471f-a519-d97960ccde5f] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:50.359370 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:50.372436 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:50.372436 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:50.373243 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:50.376911 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:50.379419 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:50.602666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:50.604281 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:50.605641 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:50.606758 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lazy-loading 'fault' on Instance uuid 75de593c-9f57-471f-a519-d97960ccde5f {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:50.664659 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-78df9534-f674-46fe-a136-27e9d83e4a00 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee85700>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:50.932682 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-78df9534-f674-46fe-a136-27e9d83e4a00 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.206036 Oct 04 20:39:50.932682 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 544/1104] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:50 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:51.105863 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:51.153521 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e33229ab-a3f1-4310-9761-188ab09757aa tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f" status: 200 len: 1308 microversion: 2.1 time: 0.910974 Oct 04 20:39:51.154616 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 561/1105] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:50 2022] GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f => generated 1308 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:51.948644 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dca701a1-af0d-4580-98d0-75cc8ed044fa tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eef63b80>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:52.163748 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-dca701a1-af0d-4580-98d0-75cc8ed044fa tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.224015 Oct 04 20:39:52.165000 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 545/1106] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:51 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:52.206253 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b7b2c8a5-de57-470d-813b-cf8a50b40eb1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:52.215009 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b7b2c8a5-de57-470d-813b-cf8a50b40eb1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 75de593c-9f57-471f-a519-d97960ccde5f] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:52.250326 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b7b2c8a5-de57-470d-813b-cf8a50b40eb1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:52.256031 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b7b2c8a5-de57-470d-813b-cf8a50b40eb1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:52.265586 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b7b2c8a5-de57-470d-813b-cf8a50b40eb1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:52.270223 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b7b2c8a5-de57-470d-813b-cf8a50b40eb1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:52.276142 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b7b2c8a5-de57-470d-813b-cf8a50b40eb1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:52.276904 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b7b2c8a5-de57-470d-813b-cf8a50b40eb1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:52.354723 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-b7b2c8a5-de57-470d-813b-cf8a50b40eb1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] HTTP exception thrown: Instance 75de593c-9f57-471f-a519-d97960ccde5f could not be found. Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b7b2c8a5-de57-470d-813b-cf8a50b40eb1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Request method failure captured: Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f HTTP/1.1 Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJiX9qFSmM0WIGlyM7HbZzTPpvEuvlvHp38bunRoEM7tEfzOcvUctzJWNch8qf5bzEnXMRNwi_qG22iTzv7XkZD5YSIxebdCaTEMgsrPaAqnGsuLG0461kB-xJ2z1h2lOhJmaxlujAP14GS51da_EIRjI1YwBai6e6BtaI0EwMb_Mrg Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70436b8b504e43dc882f5ee434ecf443", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70436b8b504e43dc882f5ee434ecf443"}]}] Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 5bda0ce3a36747c69b4a78e558a03b1b Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 75de593c-9f57-471f-a519-d97960ccde5f could not be found. Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '75de593c-9f57-471f-a519-d97960ccde5f'} Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75de593c-9f57-471f-a519-d97960ccde5f could not be found. Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75de593c-9f57-471f-a519-d97960ccde5f could not be found. Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:52.370674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:52.380952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:52.380952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:52.380952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:52.380952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:52.380952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:52.380952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75de593c-9f57-471f-a519-d97960ccde5f could not be found. Oct 04 20:39:52.380952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:52.393255 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b7b2c8a5-de57-470d-813b-cf8a50b40eb1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Returning 404 to user: Instance 75de593c-9f57-471f-a519-d97960ccde5f could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:52.393255 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b7b2c8a5-de57-470d-813b-cf8a50b40eb1 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f" status: 404 len: 111 microversion: 2.1 time: 0.185395 Oct 04 20:39:52.393255 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 562/1107] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:52 2022] GET /compute/v2.1/servers/75de593c-9f57-471f-a519-d97960ccde5f => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:39:52.401188 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7cc937c6-8a68-4ecb-92ae-10f1dcdc8f37 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:52.408177 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7cc937c6-8a68-4ecb-92ae-10f1dcdc8f37 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: acea6767-d8a4-488e-8d07-1c7362778255] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:52.435424 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cc937c6-8a68-4ecb-92ae-10f1dcdc8f37 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:52.452746 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cc937c6-8a68-4ecb-92ae-10f1dcdc8f37 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:52.453815 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cc937c6-8a68-4ecb-92ae-10f1dcdc8f37 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:52.461899 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cc937c6-8a68-4ecb-92ae-10f1dcdc8f37 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:52.463419 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cc937c6-8a68-4ecb-92ae-10f1dcdc8f37 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:52.468669 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cc937c6-8a68-4ecb-92ae-10f1dcdc8f37 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:52.497415 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-7cc937c6-8a68-4ecb-92ae-10f1dcdc8f37 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] HTTP exception thrown: Instance acea6767-d8a4-488e-8d07-1c7362778255 could not be found. Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7cc937c6-8a68-4ecb-92ae-10f1dcdc8f37 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Request method failure captured: Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 HTTP/1.1 Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJiX9qFSmM0WIGlyM7HbZzTPpvEuvlvHp38bunRoEM7tEfzOcvUctzJWNch8qf5bzEnXMRNwi_qG22iTzv7XkZD5YSIxebdCaTEMgsrPaAqnGsuLG0461kB-xJ2z1h2lOhJmaxlujAP14GS51da_EIRjI1YwBai6e6BtaI0EwMb_Mrg Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70436b8b504e43dc882f5ee434ecf443", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70436b8b504e43dc882f5ee434ecf443"}]}] Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 5bda0ce3a36747c69b4a78e558a03b1b Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance acea6767-d8a4-488e-8d07-1c7362778255 could not be found. Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'acea6767-d8a4-488e-8d07-1c7362778255'} Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acea6767-d8a4-488e-8d07-1c7362778255 could not be found. Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acea6767-d8a4-488e-8d07-1c7362778255 could not be found. Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:52.502292 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:52.512737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:52.512737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:52.512737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:52.512737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:52.512737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:52.512737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acea6767-d8a4-488e-8d07-1c7362778255 could not be found. Oct 04 20:39:52.512737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:39:52.523474 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7cc937c6-8a68-4ecb-92ae-10f1dcdc8f37 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Returning 404 to user: Instance acea6767-d8a4-488e-8d07-1c7362778255 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:52.526132 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7cc937c6-8a68-4ecb-92ae-10f1dcdc8f37 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255" status: 404 len: 111 microversion: 2.1 time: 0.133997 Oct 04 20:39:52.528425 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 546/1108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:52 2022] GET /compute/v2.1/servers/acea6767-d8a4-488e-8d07-1c7362778255 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:39:52.542554 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ae7502bb-00e8-49c1-8dc9-dde78f044a78 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:52.809386 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ae7502bb-00e8-49c1-8dc9-dde78f044a78 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/4e4d59f0-e230-4ab8-9191-d4a781ad480e" status: 204 len: 0 microversion: 2.1 time: 0.273498 Oct 04 20:39:52.818465 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 563/1109] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:39:52 2022] DELETE /compute/v2.1/os-server-groups/4e4d59f0-e230-4ab8-9191-d4a781ad480e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:52.827273 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-697354d3-f3f6-408f-855c-6187c6114c4a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:52.832762 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-697354d3-f3f6-408f-855c-6187c6114c4a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:52.857868 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-697354d3-f3f6-408f-855c-6187c6114c4a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:52.859312 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-697354d3-f3f6-408f-855c-6187c6114c4a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:52.864735 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-697354d3-f3f6-408f-855c-6187c6114c4a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:52.866386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-697354d3-f3f6-408f-855c-6187c6114c4a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:52.870850 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-697354d3-f3f6-408f-855c-6187c6114c4a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:52.872334 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-697354d3-f3f6-408f-855c-6187c6114c4a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:53.000411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-697354d3-f3f6-408f-855c-6187c6114c4a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:53.200186 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f115917f-277d-4dd3-bb0a-cec67046018d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28c310>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:53.215913 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:53.350609 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f115917f-277d-4dd3-bb0a-cec67046018d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.160023 Oct 04 20:39:53.353805 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 564/1110] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:53 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:53.734705 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:53.836323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bbee6d76-c284-46b5-91d0-8c005c89a2f0 tempest-ServerTagsTestJSON-798090356 tempest-ServerTagsTestJSON-798090356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-11892889", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "fb937f49-ef4f-4907-8633-5381d328450a"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:53.947877 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-697354d3-f3f6-408f-855c-6187c6114c4a tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "DELETE /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 204 len: 0 microversion: 2.1 time: 1.127425 Oct 04 20:39:53.949581 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 547/1111] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:52 2022] DELETE /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 0 bytes in 1131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:53.970307 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7dcbec76-0ccb-412a-9665-c0c3fb146984 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:53.977195 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7dcbec76-0ccb-412a-9665-c0c3fb146984 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:54.008333 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7dcbec76-0ccb-412a-9665-c0c3fb146984 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:54.009354 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7dcbec76-0ccb-412a-9665-c0c3fb146984 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:54.009890 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7dcbec76-0ccb-412a-9665-c0c3fb146984 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:54.027438 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7dcbec76-0ccb-412a-9665-c0c3fb146984 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:54.032439 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7dcbec76-0ccb-412a-9665-c0c3fb146984 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:54.032439 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7dcbec76-0ccb-412a-9665-c0c3fb146984 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:54.136549 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-bbee6d76-c284-46b5-91d0-8c005c89a2f0 tempest-ServerTagsTestJSON-798090356 tempest-ServerTagsTestJSON-798090356-project] validate_networks() for [('fb937f49-ef4f-4907-8633-5381d328450a', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:39:54.988423 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7dcbec76-0ccb-412a-9665-c0c3fb146984 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:55.027926 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7dcbec76-0ccb-412a-9665-c0c3fb146984 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1472 microversion: 2.1 time: 1.065011 Oct 04 20:39:55.052190 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 548/1112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:53 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1472 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:55.066560 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-64f4cf44-7229-44cd-a202-45fc437b5bbc tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee85040>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:55.261149 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-64f4cf44-7229-44cd-a202-45fc437b5bbc tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.197689 Oct 04 20:39:55.262764 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 549/1113] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:55 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-bbee6d76-c284-46b5-91d0-8c005c89a2f0 tempest-ServerTagsTestJSON-798090356 tempest-ServerTagsTestJSON-798090356-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d7705261-45b6-4128-aa7f-722a0c4b9f6b) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:39:55.651205 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d7705261-45b6-4128-aa7f-722a0c4b9f6b) Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-bbee6d76-c284-46b5-91d0-8c005c89a2f0 tempest-ServerTagsTestJSON-798090356 tempest-ServerTagsTestJSON-798090356-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bbee6d76-c284-46b5-91d0-8c005c89a2f0 tempest-ServerTagsTestJSON-798090356 tempest-ServerTagsTestJSON-798090356-project] Request method failure captured: Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 202 Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJoYI1kaMAu44r5EpFi_h6tx7TpDqQXZA7OlazovV0fNkRlDWC_Cfa2zOZXSp3L0Lv5G2SIJcu_7MojJlmx39NopN3wpYMiySylHKOCm7t4Ug4O8AZVdEj1wA-Q4nJiFMiee8426u3Gf8iwss4ZrTtbIwkQIyJvgK1rYU0khwN-kQo8 Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.26 Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 8e0f9649604d45b996d238ad4395b51a Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerTagsTestJSON-798090356 Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e0f9649604d45b996d238ad4395b51a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e0f9649604d45b996d238ad4395b51a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e0f9649604d45b996d238ad4395b51a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e0f9649604d45b996d238ad4395b51a"}]}] Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerTagsTestJSON-798090356 Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 8e0f9649604d45b996d238ad4395b51a Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerTagsTestJSON-798090356 Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerTagsTestJSON-798090356-project Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 7a0e1e2323354582a27e3aa9a4355da0 Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerTagsTestJSON-798090356-project Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServerTagsTestJSON-server-11892889", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "fb937f49-ef4f-4907-8633-5381d328450a"}]}} Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServerTagsTestJSON-server-11892889', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'fb937f49-ef4f-4907-8633-5381d328450a'}]}}} Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:55.661694 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:39:55.686158 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d7705261-45b6-4128-aa7f-722a0c4b9f6b) Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bbee6d76-c284-46b5-91d0-8c005c89a2f0 tempest-ServerTagsTestJSON-798090356 tempest-ServerTagsTestJSON-798090356-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bbee6d76-c284-46b5-91d0-8c005c89a2f0 tempest-ServerTagsTestJSON-798090356 tempest-ServerTagsTestJSON-798090356-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.26 time: 2.306370 Oct 04 20:39:55.703315 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 565/1114] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:39:53 2022] POST /compute/v2.1/servers => generated 214 bytes in 2314 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 04 20:39:56.084556 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b7f8785e-9d1c-4f31-b2d1-630fc3052876 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:56.090880 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b7f8785e-9d1c-4f31-b2d1-630fc3052876 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:56.124904 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b7f8785e-9d1c-4f31-b2d1-630fc3052876 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:56.132898 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b7f8785e-9d1c-4f31-b2d1-630fc3052876 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:56.133815 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b7f8785e-9d1c-4f31-b2d1-630fc3052876 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:56.143252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b7f8785e-9d1c-4f31-b2d1-630fc3052876 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:56.144341 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b7f8785e-9d1c-4f31-b2d1-630fc3052876 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:56.145344 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b7f8785e-9d1c-4f31-b2d1-630fc3052876 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:56.300330 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7adbe55e-9bbf-4067-b763-6feeb30d1e5b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2d6ee0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:56.516997 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7adbe55e-9bbf-4067-b763-6feeb30d1e5b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.227450 Oct 04 20:39:56.531048 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 566/1115] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:56 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:57.580490 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c39789a2-25be-47c5-aedf-a88bbff5543d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77efd2d310>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:57.835378 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c39789a2-25be-47c5-aedf-a88bbff5543d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.269161 Oct 04 20:39:57.837373 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 567/1116] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:57 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:58.216289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b7f8785e-9d1c-4f31-b2d1-630fc3052876 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:58.253364 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b7f8785e-9d1c-4f31-b2d1-630fc3052876 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1472 microversion: 2.1 time: 2.174436 Oct 04 20:39:58.257281 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 550/1117] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:56 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1472 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:58.870860 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6232927a-83f8-4dce-a3c3-c72352f7eb63 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28c280>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:59.073609 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6232927a-83f8-4dce-a3c3-c72352f7eb63 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.215239 Oct 04 20:39:59.090777 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 568/1118] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:58 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:59.316275 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ff0b893e-086c-4b14-8337-c5e9d3e3c627 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:59.334769 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ff0b893e-086c-4b14-8337-c5e9d3e3c627 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:59.373951 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff0b893e-086c-4b14-8337-c5e9d3e3c627 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:59.385238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff0b893e-086c-4b14-8337-c5e9d3e3c627 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:59.385238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff0b893e-086c-4b14-8337-c5e9d3e3c627 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:59.385238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff0b893e-086c-4b14-8337-c5e9d3e3c627 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:59.385238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff0b893e-086c-4b14-8337-c5e9d3e3c627 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:59.385238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff0b893e-086c-4b14-8337-c5e9d3e3c627 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:59.418692 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-446e6101-c505-4ccd-bcdb-e807504fb0ca req-7f88e67d-8b91-4e80-8689-4bd9395e3ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c29121-e094-4132-8ef4-b4c28da9df8a", "name": "network-vif-unplugged", "status": "completed", "tag": "978b2a22-cd30-468a-af9b-1b86275c1460"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:59.501370 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-446e6101-c505-4ccd-bcdb-e807504fb0ca req-7f88e67d-8b91-4e80-8689-4bd9395e3ad1 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:59.506682 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-446e6101-c505-4ccd-bcdb-e807504fb0ca req-7f88e67d-8b91-4e80-8689-4bd9395e3ad1 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:59.514354 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-446e6101-c505-4ccd-bcdb-e807504fb0ca req-7f88e67d-8b91-4e80-8689-4bd9395e3ad1 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:59.551970 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:59.637905 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-446e6101-c505-4ccd-bcdb-e807504fb0ca req-7f88e67d-8b91-4e80-8689-4bd9395e3ad1 service nova] Creating event network-vif-unplugged:978b2a22-cd30-468a-af9b-1b86275c1460 for instance 50c29121-e094-4132-8ef4-b4c28da9df8a on n-h2-852085-12 Oct 04 20:39:59.666968 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-446e6101-c505-4ccd-bcdb-e807504fb0ca req-7f88e67d-8b91-4e80-8689-4bd9395e3ad1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.247284 Oct 04 20:39:59.672300 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 569/1119] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:40:00.120227 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-eefaa028-e9ac-40b4-87f0-11e231259e85 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2fef70>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:00.366218 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-eefaa028-e9ac-40b4-87f0-11e231259e85 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.243639 Oct 04 20:40:00.370453 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 570/1120] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:00 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:01.273000 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ff0b893e-086c-4b14-8337-c5e9d3e3c627 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:01.315361 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ff0b893e-086c-4b14-8337-c5e9d3e3c627 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1472 microversion: 2.1 time: 2.008105 Oct 04 20:40:01.327612 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 551/1121] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:59 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1472 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:01.402677 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bafee659-ac84-4a1e-8d83-bb79a96f9471 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28cc10>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:01.591395 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bafee659-ac84-4a1e-8d83-bb79a96f9471 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.197064 Oct 04 20:40:01.606543 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 571/1122] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:01 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:01.870196 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-6f881009-50cb-49a1-9a01-bb70ca1d8bde req-7787e827-43ce-4afb-9b35-134e5973939a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd64c084-10af-4b12-bdd9-ef53866be364", "name": "network-vif-plugged", "status": "completed", "tag": "a55c4fe7-8c63-4a39-819e-95561de2446e"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:01.949047 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-6f881009-50cb-49a1-9a01-bb70ca1d8bde req-7787e827-43ce-4afb-9b35-134e5973939a service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:01.949936 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-6f881009-50cb-49a1-9a01-bb70ca1d8bde req-7787e827-43ce-4afb-9b35-134e5973939a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:01.950751 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-6f881009-50cb-49a1-9a01-bb70ca1d8bde req-7787e827-43ce-4afb-9b35-134e5973939a service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.054746 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-6f881009-50cb-49a1-9a01-bb70ca1d8bde req-7787e827-43ce-4afb-9b35-134e5973939a service nova] Creating event network-vif-plugged:a55c4fe7-8c63-4a39-819e-95561de2446e for instance bd64c084-10af-4b12-bdd9-ef53866be364 on n-h1-852085-12 Oct 04 20:40:02.103855 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-6f881009-50cb-49a1-9a01-bb70ca1d8bde req-7787e827-43ce-4afb-9b35-134e5973939a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230955 Oct 04 20:40:02.105577 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 552/1123] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:02.376315 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-78b3e84f-0c23-4a74-ac04-71ba80411f46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:02.384924 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-78b3e84f-0c23-4a74-ac04-71ba80411f46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:02.428545 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78b3e84f-0c23-4a74-ac04-71ba80411f46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.429542 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78b3e84f-0c23-4a74-ac04-71ba80411f46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.430059 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78b3e84f-0c23-4a74-ac04-71ba80411f46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.439722 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78b3e84f-0c23-4a74-ac04-71ba80411f46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.440616 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78b3e84f-0c23-4a74-ac04-71ba80411f46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.441548 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78b3e84f-0c23-4a74-ac04-71ba80411f46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.624922 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-693c4c45-3a99-4627-a5c4-6479e35ea754 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eef1e8b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:02.899775 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-693c4c45-3a99-4627-a5c4-6479e35ea754 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.287553 Oct 04 20:40:02.903737 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 553/1124] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:02 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:02.940560 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-e067dfd3-3a19-4a92-a3e9-0086472342be req-289aa0d1-ac44-4b5f-ab96-52cc0138cead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c29121-e094-4132-8ef4-b4c28da9df8a", "name": "network-vif-deleted", "tag": "978b2a22-cd30-468a-af9b-1b86275c1460"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:03.032543 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-e067dfd3-3a19-4a92-a3e9-0086472342be req-289aa0d1-ac44-4b5f-ab96-52cc0138cead service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:03.033488 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-e067dfd3-3a19-4a92-a3e9-0086472342be req-289aa0d1-ac44-4b5f-ab96-52cc0138cead service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:03.034313 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-e067dfd3-3a19-4a92-a3e9-0086472342be req-289aa0d1-ac44-4b5f-ab96-52cc0138cead service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:03.092030 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-78b3e84f-0c23-4a74-ac04-71ba80411f46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bda0ce3a36747c69b4a78e558a03b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70436b8b504e43dc882f5ee434ecf443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:03.164012 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-78b3e84f-0c23-4a74-ac04-71ba80411f46 tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 200 len: 1430 microversion: 2.1 time: 0.794724 Oct 04 20:40:03.165180 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 572/1125] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:02 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 1430 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:03.186994 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-e067dfd3-3a19-4a92-a3e9-0086472342be req-289aa0d1-ac44-4b5f-ab96-52cc0138cead service nova] Creating event network-vif-deleted:978b2a22-cd30-468a-af9b-1b86275c1460 for instance 50c29121-e094-4132-8ef4-b4c28da9df8a on n-h2-852085-12 Oct 04 20:40:03.242608 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-e067dfd3-3a19-4a92-a3e9-0086472342be req-289aa0d1-ac44-4b5f-ab96-52cc0138cead service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323627 Oct 04 20:40:03.244827 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 554/1126] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:03.996569 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-416917521", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": "none"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:04.048204 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7741c3b6-c299-4329-904a-e1f38a72be53 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Action: 'create', calling method: .version_select at 0x7f77eef01a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-211688361", "description": "tempest-description-557787086"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:04.300132 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:40:04.301769 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:40:04.302658 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:40:04.303434 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:40:04.304197 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:40:04.356272 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:04.357114 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:04.361439 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:04.365713 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:04.369571 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:04.371969 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:04.468698 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Getting quotas for project 060a53e4fead4141a343b3e54bb09eff. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:04.505205 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Getting quotas for user a9990d76e7b941ee9dcedb1cb7974d3e and project 060a53e4fead4141a343b3e54bb09eff. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:04.583681 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Going to run 1 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:40:04.607817 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:40:04.928026 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6d650069-ea57-4a44-b790-eb0d0fa4b14a tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 1.718201 Oct 04 20:40:04.931218 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 573/1127] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:40:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:40:04.967158 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f210e543-f5eb-4b73-b0c1-fd89b8aabdfc tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28cee0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:05.132961 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f210e543-f5eb-4b73-b0c1-fd89b8aabdfc tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.184393 Oct 04 20:40:05.147181 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 574/1128] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:04 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:05.162685 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-26ac6913-8807-40f9-bf45-3385b8851e2e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:05.165270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-26ac6913-8807-40f9-bf45-3385b8851e2e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] [instance: 50c29121-e094-4132-8ef4-b4c28da9df8a] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:05.189896 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26ac6913-8807-40f9-bf45-3385b8851e2e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.197046 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26ac6913-8807-40f9-bf45-3385b8851e2e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.200265 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26ac6913-8807-40f9-bf45-3385b8851e2e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.202085 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26ac6913-8807-40f9-bf45-3385b8851e2e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.205616 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26ac6913-8807-40f9-bf45-3385b8851e2e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.208059 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-26ac6913-8807-40f9-bf45-3385b8851e2e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.281481 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-26ac6913-8807-40f9-bf45-3385b8851e2e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] HTTP exception thrown: Instance 50c29121-e094-4132-8ef4-b4c28da9df8a could not be found. Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-26ac6913-8807-40f9-bf45-3385b8851e2e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Request method failure captured: Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a HTTP/1.1 Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJiX9qFSmM0WIGlyM7HbZzTPpvEuvlvHp38bunRoEM7tEfzOcvUctzJWNch8qf5bzEnXMRNwi_qG22iTzv7XkZD5YSIxebdCaTEMgsrPaAqnGsuLG0461kB-xJ2z1h2lOhJmaxlujAP14GS51da_EIRjI1YwBai6e6BtaI0EwMb_Mrg Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70436b8b504e43dc882f5ee434ecf443", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70436b8b504e43dc882f5ee434ecf443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70436b8b504e43dc882f5ee434ecf443"}]}] Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 70436b8b504e43dc882f5ee434ecf443 Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-982337406 Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 5bda0ce3a36747c69b4a78e558a03b1b Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersOnMultiNodesTest-982337406-project Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 50c29121-e094-4132-8ef4-b4c28da9df8a could not be found. Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '50c29121-e094-4132-8ef4-b4c28da9df8a'} Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c29121-e094-4132-8ef4-b4c28da9df8a could not be found. Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c29121-e094-4132-8ef4-b4c28da9df8a could not be found. Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:05.292982 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:05.302312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:05.302312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:05.302312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:05.302312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:05.302312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:05.302312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c29121-e094-4132-8ef4-b4c28da9df8a could not be found. Oct 04 20:40:05.302312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:05.302312 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-26ac6913-8807-40f9-bf45-3385b8851e2e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] Returning 404 to user: Instance 50c29121-e094-4132-8ef4-b4c28da9df8a could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:05.302312 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-26ac6913-8807-40f9-bf45-3385b8851e2e tempest-ServersOnMultiNodesTest-982337406 tempest-ServersOnMultiNodesTest-982337406-project] 10.222.0.78 "GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a" status: 404 len: 111 microversion: 2.1 time: 0.155020 Oct 04 20:40:05.307125 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 575/1129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:05 2022] GET /compute/v2.1/servers/50c29121-e094-4132-8ef4-b4c28da9df8a => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:05.342320 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-35c02b8f-2645-4227-a7da-a5083d21db41 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:05.346264 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-35c02b8f-2645-4227-a7da-a5083d21db41 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:06.369367 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-35c02b8f-2645-4227-a7da-a5083d21db41 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:06.415030 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-35c02b8f-2645-4227-a7da-a5083d21db41 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:06.435591 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-35c02b8f-2645-4227-a7da-a5083d21db41 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:06.470383 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-35c02b8f-2645-4227-a7da-a5083d21db41 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1452 microversion: 2.91 time: 1.150443 Oct 04 20:40:06.474596 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 576/1130] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:05 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1452 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:06.516749 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-56aa23e6-c949-4344-abcb-528ab2270bad tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28ce50>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.571541 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7741c3b6-c299-4329-904a-e1f38a72be53 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 3.197498 Oct 04 20:40:06.576529 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 555/1131] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:03 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 3204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:06.607389 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9c107fd9-d331-4666-af8c-e51a956f584e tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Action: 'create', calling method: .version_select at 0x7f77eee85700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-481824131", "description": "tempest-description-2126239099"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:06.689248 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-56aa23e6-c949-4344-abcb-528ab2270bad tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.209636 Oct 04 20:40:06.690998 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 577/1132] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:06 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:07.537083 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2fa0e9ce-1d3b-40c1-8318-d6450a37179f tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:07.540728 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2fa0e9ce-1d3b-40c1-8318-d6450a37179f tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:08.211484 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-2fa0e9ce-1d3b-40c1-8318-d6450a37179f tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:08.271209 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-2fa0e9ce-1d3b-40c1-8318-d6450a37179f tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:08.290414 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-2fa0e9ce-1d3b-40c1-8318-d6450a37179f tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:08.355650 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2fa0e9ce-1d3b-40c1-8318-d6450a37179f tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1452 microversion: 2.91 time: 0.827953 Oct 04 20:40:08.368410 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 578/1133] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:07 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1452 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:08.401246 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-253a6cd9-f58c-4c03-aabb-93bb9dbaf3fc tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2fe280>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:08.501092 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9c107fd9-d331-4666-af8c-e51a956f584e tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.906409 Oct 04 20:40:08.502387 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 556/1134] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:06 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:40:08.718692 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-253a6cd9-f58c-4c03-aabb-93bb9dbaf3fc tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.345215 Oct 04 20:40:08.719819 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 579/1135] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:08 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:09.075706 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5a8693b2-a13b-4ed4-8752-e79ced4b7576 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-243639364", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0bca21b9-d9dd-47ed-b98b-fa1ff3590c09"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:09.342824 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-5a8693b2-a13b-4ed4-8752-e79ced4b7576 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] validate_networks() for [('0bca21b9-d9dd-47ed-b98b-fa1ff3590c09', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:09.426136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8a9555e3-2acf-49c2-a7d0-0281e70dcd03 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:09.434772 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8a9555e3-2acf-49c2-a7d0-0281e70dcd03 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:09.441015 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:09.495404 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a9555e3-2acf-49c2-a7d0-0281e70dcd03 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:09.497127 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a9555e3-2acf-49c2-a7d0-0281e70dcd03 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:09.502247 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a9555e3-2acf-49c2-a7d0-0281e70dcd03 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:09.510270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a9555e3-2acf-49c2-a7d0-0281e70dcd03 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:09.515700 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a9555e3-2acf-49c2-a7d0-0281e70dcd03 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:09.529315 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a9555e3-2acf-49c2-a7d0-0281e70dcd03 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:10.122668 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8a9555e3-2acf-49c2-a7d0-0281e70dcd03 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:10.122668 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8a9555e3-2acf-49c2-a7d0-0281e70dcd03 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:10.122668 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8a9555e3-2acf-49c2-a7d0-0281e70dcd03 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:10.157232 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8a9555e3-2acf-49c2-a7d0-0281e70dcd03 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1448 microversion: 2.91 time: 0.740494 Oct 04 20:40:10.166411 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 580/1136] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:09 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1448 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:10.187062 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d1a5a1fe-8c31-4328-b0d5-3e76ec7bff01 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2fe550>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:10.365309 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d1a5a1fe-8c31-4328-b0d5-3e76ec7bff01 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.193834 Oct 04 20:40:10.366468 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 581/1137] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:10 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-5a8693b2-a13b-4ed4-8752-e79ced4b7576 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c1667eaa-e215-4b16-911b-5b7829c8576c) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:40:10.507910 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c1667eaa-e215-4b16-911b-5b7829c8576c) Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-5a8693b2-a13b-4ed4-8752-e79ced4b7576 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5a8693b2-a13b-4ed4-8752-e79ced4b7576 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Request method failure captured: Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 207 Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJoj5Co0k63X7911hCPGILvFaEcALGX3U5nnNcrAw6SQrdvM0tEtxyVw1eD-oG8LrEEcPsAootimejAT_rkU6efWU-bjthk6QKv7Zze2RliUvqHOC_LSJUie5bJpGqlcec4P2dopUyLBEuuuWU1w7dh-Bk-tcEqLZk62p3D8YKqRh04 Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dddbee054f49f3ac862994488fc147", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dddbee054f49f3ac862994488fc147"}]}] Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 65eee15492da4c449b3238e50e987bd5 Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-243639364", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0bca21b9-d9dd-47ed-b98b-fa1ff3590c09"}]}} Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-SecurityGroupsTestJSON-server-243639364', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '0bca21b9-d9dd-47ed-b98b-fa1ff3590c09'}]}}} Oct 04 20:40:10.532800 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:40:10.542933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c1667eaa-e215-4b16-911b-5b7829c8576c) Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5a8693b2-a13b-4ed4-8752-e79ced4b7576 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5a8693b2-a13b-4ed4-8752-e79ced4b7576 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.458922 Oct 04 20:40:10.557482 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 557/1138] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:09 2022] POST /compute/v2.1/servers => generated 214 bytes in 1465 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:40:10.569534 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6fdcc489-914d-4f6f-8036-0ba4a643dad8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Action: 'create', calling method: .version_select at 0x7f77ef2f6e50>, body: {"security_group": {"name": " tempest-securitygroup -845387153 ", "description": "tempest-description-1519112382"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:11.229460 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-764cf5dc-26ad-4583-a84d-dc71cdc6a52d tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:11.234783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-764cf5dc-26ad-4583-a84d-dc71cdc6a52d tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:11.263373 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-764cf5dc-26ad-4583-a84d-dc71cdc6a52d tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.264955 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-764cf5dc-26ad-4583-a84d-dc71cdc6a52d tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.270995 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-764cf5dc-26ad-4583-a84d-dc71cdc6a52d tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:11.272865 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-764cf5dc-26ad-4583-a84d-dc71cdc6a52d tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.281783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-764cf5dc-26ad-4583-a84d-dc71cdc6a52d tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.283422 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-764cf5dc-26ad-4583-a84d-dc71cdc6a52d tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.134683 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-764cf5dc-26ad-4583-a84d-dc71cdc6a52d tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:12.191211 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-764cf5dc-26ad-4583-a84d-dc71cdc6a52d tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:12.210898 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-764cf5dc-26ad-4583-a84d-dc71cdc6a52d tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:12.273337 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-764cf5dc-26ad-4583-a84d-dc71cdc6a52d tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1504 microversion: 2.91 time: 1.054808 Oct 04 20:40:12.277746 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 558/1139] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:11 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1504 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:40:12.328483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-81bc320b-4117-4704-bc9c-a31935aa0530 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee81310>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:12.566929 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-81bc320b-4117-4704-bc9c-a31935aa0530 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.287062 Oct 04 20:40:12.568091 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 559/1140] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:12 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:13.341739 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f2d5c05e-b0f7-4d65-bfc2-aa82d757f448 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:13.349666 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f2d5c05e-b0f7-4d65-bfc2-aa82d757f448 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:13.393688 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f2d5c05e-b0f7-4d65-bfc2-aa82d757f448 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:13.399255 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f2d5c05e-b0f7-4d65-bfc2-aa82d757f448 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:13.404223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f2d5c05e-b0f7-4d65-bfc2-aa82d757f448 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:13.406267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f2d5c05e-b0f7-4d65-bfc2-aa82d757f448 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:13.409004 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f2d5c05e-b0f7-4d65-bfc2-aa82d757f448 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:13.426850 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f2d5c05e-b0f7-4d65-bfc2-aa82d757f448 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:13.486807 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6fdcc489-914d-4f6f-8036-0ba4a643dad8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 2.930227 Oct 04 20:40:13.501325 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 582/1141] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:10 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 2933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:40:13.524119 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b9182bf8-ee36-4e2f-9559-33c718779d58 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77ef28c160>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:14.420875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:14.959927 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f2d5c05e-b0f7-4d65-bfc2-aa82d757f448 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:15.002665 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f2d5c05e-b0f7-4d65-bfc2-aa82d757f448 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:15.013581 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f2d5c05e-b0f7-4d65-bfc2-aa82d757f448 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:15.034545 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f2d5c05e-b0f7-4d65-bfc2-aa82d757f448 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1510 microversion: 2.91 time: 1.703159 Oct 04 20:40:15.040287 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 560/1142] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:13 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1510 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:40:15.099029 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fda0441a-832d-421d-9577-2b28c24e3d0a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eef01ca0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:15.300051 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b9182bf8-ee36-4e2f-9559-33c718779d58 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/02d0c889-14e7-4e0a-b5ea-08df472b3e01" status: 200 len: 223 microversion: 2.1 time: 1.792850 Oct 04 20:40:15.302713 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 583/1143] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:40:13 2022] GET /compute/v2.1/os-security-groups/02d0c889-14e7-4e0a-b5ea-08df472b3e01 => generated 223 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:15.313922 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fda0441a-832d-421d-9577-2b28c24e3d0a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.253221 Oct 04 20:40:15.313922 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 561/1144] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:15 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:15.348141 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-64884a58-9f0c-459f-a5d8-434268ce674d tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77ef290af0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:16.098451 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6ea0f338-4bc7-4987-9d56-2f59fd9543f5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:16.105913 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6ea0f338-4bc7-4987-9d56-2f59fd9543f5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:16.123595 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6ea0f338-4bc7-4987-9d56-2f59fd9543f5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:16.133372 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6ea0f338-4bc7-4987-9d56-2f59fd9543f5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:16.136568 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6ea0f338-4bc7-4987-9d56-2f59fd9543f5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:16.139262 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6ea0f338-4bc7-4987-9d56-2f59fd9543f5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:16.145196 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6ea0f338-4bc7-4987-9d56-2f59fd9543f5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:16.146589 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6ea0f338-4bc7-4987-9d56-2f59fd9543f5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:16.486642 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6ea0f338-4bc7-4987-9d56-2f59fd9543f5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:16.525252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6ea0f338-4bc7-4987-9d56-2f59fd9543f5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:16.549737 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6ea0f338-4bc7-4987-9d56-2f59fd9543f5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:16.575182 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6ea0f338-4bc7-4987-9d56-2f59fd9543f5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1510 microversion: 2.91 time: 0.487134 Oct 04 20:40:16.583304 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 562/1145] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:16 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1510 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:40:16.612496 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e0bb7383-d5cd-415c-b3bb-5578be6b0269 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee81040>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:16.828445 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e0bb7383-d5cd-415c-b3bb-5578be6b0269 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.247327 Oct 04 20:40:16.830454 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 563/1146] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:16 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:17.012541 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-64884a58-9f0c-459f-a5d8-434268ce674d tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/02d0c889-14e7-4e0a-b5ea-08df472b3e01" status: 202 len: 0 microversion: 2.1 time: 1.672121 Oct 04 20:40:17.017028 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 584/1147] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:15 2022] DELETE /compute/v2.1/os-security-groups/02d0c889-14e7-4e0a-b5ea-08df472b3e01 => generated 0 bytes in 1678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:40:17.042496 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9c936625-2896-457b-994f-aa4d47843f65 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77eef01280>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:17.143786 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-9c936625-2896-457b-994f-aa4d47843f65 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:40:17.147666 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.security_group_api [None req-9c936625-2896-457b-994f-aa4d47843f65 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Neutron security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 not found {{(pid=123539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:40:17.149620 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-9c936625-2896-457b-994f-aa4d47843f65 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] HTTP exception thrown: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:17.149620 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-08fdbd5b-bdff-4ac3-ba40-f23229fb9f8c'] Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9c936625-2896-457b-994f-aa4d47843f65 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Request method failure captured: Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-security-groups/02d0c889-14e7-4e0a-b5ea-08df472b3e01 HTTP/1.1 Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJoj5Co0k63X7911hCPGILvFaEcALGX3U5nnNcrAw6SQrdvM0tEtxyVw1eD-oG8LrEEcPsAootimejAT_rkU6efWU-bjthk6QKv7Zze2RliUvqHOC_LSJUie5bJpGqlcec4P2dopUyLBEuuuWU1w7dh-Bk-tcEqLZk62p3D8YKqRh04 Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dddbee054f49f3ac862994488fc147", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dddbee054f49f3ac862994488fc147"}]}] Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 65eee15492da4c449b3238e50e987bd5 Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: exception: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-08fdbd5b-bdff-4ac3-ba40-f23229fb9f8c'] Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '02d0c889-14e7-4e0a-b5ea-08df472b3e01'} Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:40:17.154341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08fdbd5b-bdff-4ac3-ba40-f23229fb9f8c'] Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08fdbd5b-bdff-4ac3-ba40-f23229fb9f8c'] Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08fdbd5b-bdff-4ac3-ba40-f23229fb9f8c'] Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08fdbd5b-bdff-4ac3-ba40-f23229fb9f8c'] Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9c936625-2896-457b-994f-aa4d47843f65 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Returning 404 to user: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-08fdbd5b-bdff-4ac3-ba40-f23229fb9f8c'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:17.172568 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9c936625-2896-457b-994f-aa4d47843f65 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/02d0c889-14e7-4e0a-b5ea-08df472b3e01" status: 404 len: 194 microversion: 2.1 time: 0.134911 Oct 04 20:40:17.187409 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 564/1148] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:40:17 2022] GET /compute/v2.1/os-security-groups/02d0c889-14e7-4e0a-b5ea-08df472b3e01 => generated 194 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:17.187654 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0ff1db86-a9ef-4765-899b-2c982e1a6c0a tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Action: 'create', calling method: .version_select at 0x7f77ef2b0280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1390025256", "description": "tempest-description-1379562564"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:17.661162 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b5509fc8-1a07-4705-9b42-9c5d6498b8da tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:17.668347 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b5509fc8-1a07-4705-9b42-9c5d6498b8da tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:17.701646 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b5509fc8-1a07-4705-9b42-9c5d6498b8da tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.705732 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b5509fc8-1a07-4705-9b42-9c5d6498b8da tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.707763 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b5509fc8-1a07-4705-9b42-9c5d6498b8da tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.710360 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b5509fc8-1a07-4705-9b42-9c5d6498b8da tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.715979 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b5509fc8-1a07-4705-9b42-9c5d6498b8da tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.717026 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b5509fc8-1a07-4705-9b42-9c5d6498b8da tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.964741 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b5509fc8-1a07-4705-9b42-9c5d6498b8da tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:17.991898 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b5509fc8-1a07-4705-9b42-9c5d6498b8da tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:17.996209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b5509fc8-1a07-4705-9b42-9c5d6498b8da tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:18.010969 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b5509fc8-1a07-4705-9b42-9c5d6498b8da tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1531 microversion: 2.91 time: 0.380141 Oct 04 20:40:18.013255 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 565/1149] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:17 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1531 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:18.023518 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-db8e5433-ad3b-458c-8626-6c221eba7237 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eeed1af0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:18.220454 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0ff1db86-a9ef-4765-899b-2c982e1a6c0a tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.050558 Oct 04 20:40:18.221803 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-db8e5433-ad3b-458c-8626-6c221eba7237 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.205524 Oct 04 20:40:18.242222 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 566/1151] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:18 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:18.242486 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 585/1151] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:17 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:18.257337 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=10 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:18.304123 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6c9d52eb-d9e6-4b85-bb29-cc0308e347f8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Action: 'create', calling method: .version_select at 0x7f77eeeb59d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1703249544", "description": "tempest-description-1607222677"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:19.100325 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-95cbf183-1567-4de3-94d8-ae897ead9a4b tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:19.101629 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-95cbf183-1567-4de3-94d8-ae897ead9a4b tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:19.149378 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-95cbf183-1567-4de3-94d8-ae897ead9a4b tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.152647 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-95cbf183-1567-4de3-94d8-ae897ead9a4b tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.157769 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-95cbf183-1567-4de3-94d8-ae897ead9a4b tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:19.164000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-95cbf183-1567-4de3-94d8-ae897ead9a4b tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.164000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-95cbf183-1567-4de3-94d8-ae897ead9a4b tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.170108 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-95cbf183-1567-4de3-94d8-ae897ead9a4b tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:19.271491 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6c9d52eb-d9e6-4b85-bb29-cc0308e347f8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.995512 Oct 04 20:40:19.273102 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 567/1152] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:18 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:19.289328 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-99a0c054-76c5-4cb3-b20e-0d78484296c7 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee854c0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:19.413181 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-99a0c054-76c5-4cb3-b20e-0d78484296c7 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.136032 Oct 04 20:40:19.416698 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 568/1153] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:19 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:19.427827 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-95cbf183-1567-4de3-94d8-ae897ead9a4b tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lazy-loading 'services' on Instance uuid 6d44adbe-9208-452a-a8f7-8802ac29dfb8 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:19.444763 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-da7aa57e-8922-4c16-927d-441b86b82762 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Action: 'create', calling method: .version_select at 0x7f77eeed1d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-899606868", "description": "tempest-description-31399548"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:19.497418 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-95cbf183-1567-4de3-94d8-ae897ead9a4b tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1938 microversion: 2.91 time: 1.252696 Oct 04 20:40:19.515665 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 586/1154] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:18 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1938 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:19.552475 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1a7459ca-174d-4691-85fc-f922603e5f38 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:19.554071 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1a7459ca-174d-4691-85fc-f922603e5f38 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:19.566768 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a7459ca-174d-4691-85fc-f922603e5f38 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.568034 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a7459ca-174d-4691-85fc-f922603e5f38 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.569828 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a7459ca-174d-4691-85fc-f922603e5f38 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:19.572021 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a7459ca-174d-4691-85fc-f922603e5f38 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.573409 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a7459ca-174d-4691-85fc-f922603e5f38 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.574523 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1a7459ca-174d-4691-85fc-f922603e5f38 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:19.776880 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-1a7459ca-174d-4691-85fc-f922603e5f38 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lazy-loading 'services' on Instance uuid 6d44adbe-9208-452a-a8f7-8802ac29dfb8 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:19.880755 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1a7459ca-174d-4691-85fc-f922603e5f38 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1938 microversion: 2.91 time: 0.333627 Oct 04 20:40:19.915789 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 587/1155] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:19 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1938 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:40:19.952665 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bdb24472-c564-440d-a8e7-245f90de8898 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:19.964452 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bdb24472-c564-440d-a8e7-245f90de8898 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.975892 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bdb24472-c564-440d-a8e7-245f90de8898 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.977318 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bdb24472-c564-440d-a8e7-245f90de8898 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:19.980300 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bdb24472-c564-440d-a8e7-245f90de8898 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.990415 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bdb24472-c564-440d-a8e7-245f90de8898 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.991612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bdb24472-c564-440d-a8e7-245f90de8898 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.102093 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bdb24472-c564-440d-a8e7-245f90de8898 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.145929 Oct 04 20:40:20.103750 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 588/1156] 10.222.0.78 () {60 vars in 1217 bytes} [Tue Oct 4 20:40:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:20.130214 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c94f8c24-ea87-47fb-ba42-9494c22a0199 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:20.138018 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c94f8c24-ea87-47fb-ba42-9494c22a0199 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:20.165476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c94f8c24-ea87-47fb-ba42-9494c22a0199 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.166809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c94f8c24-ea87-47fb-ba42-9494c22a0199 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.168460 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c94f8c24-ea87-47fb-ba42-9494c22a0199 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.171417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c94f8c24-ea87-47fb-ba42-9494c22a0199 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.172793 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c94f8c24-ea87-47fb-ba42-9494c22a0199 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.179392 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c94f8c24-ea87-47fb-ba42-9494c22a0199 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.288929 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-c94f8c24-ea87-47fb-ba42-9494c22a0199 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lazy-loading 'flavor' on Instance uuid 6d44adbe-9208-452a-a8f7-8802ac29dfb8 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:20.378449 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-da7aa57e-8922-4c16-927d-441b86b82762 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.958145 Oct 04 20:40:20.379223 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 569/1157] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:19 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:20.409385 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b4269e46-bcff-4b22-b627-c2ec6d51d70c tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77eef014c0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:21.123070 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b4269e46-bcff-4b22-b627-c2ec6d51d70c tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.721530 Oct 04 20:40:21.124573 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 570/1158] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:40:20 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:21.165964 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dac70218-a467-41a6-a026-b235d4f58136 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eefcaf70>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:21.842788 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c94f8c24-ea87-47fb-ba42-9494c22a0199 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "POST /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8/action" status: 202 len: 0 microversion: 2.91 time: 1.716611 Oct 04 20:40:21.855322 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 589/1159] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 4 20:40:20 2022] POST /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8/action => generated 0 bytes in 1732 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:21.914225 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c6317f09-deb8-43f0-8960-734df9dc42e7 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77ef290280>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:21.967781 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-dac70218-a467-41a6-a026-b235d4f58136 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.840614 Oct 04 20:40:21.972438 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 571/1160] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:21 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:21.998710 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-983386d9-fa1c-444d-a9db-cbe8a99b5cdf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:22.001545 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-983386d9-fa1c-444d-a9db-cbe8a99b5cdf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:22.021657 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-983386d9-fa1c-444d-a9db-cbe8a99b5cdf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:22.023125 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-983386d9-fa1c-444d-a9db-cbe8a99b5cdf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:22.024337 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-983386d9-fa1c-444d-a9db-cbe8a99b5cdf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:22.025968 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-983386d9-fa1c-444d-a9db-cbe8a99b5cdf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:22.027204 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-983386d9-fa1c-444d-a9db-cbe8a99b5cdf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:22.028474 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-983386d9-fa1c-444d-a9db-cbe8a99b5cdf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:22.322726 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-983386d9-fa1c-444d-a9db-cbe8a99b5cdf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:22.365702 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-983386d9-fa1c-444d-a9db-cbe8a99b5cdf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:22.372543 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-983386d9-fa1c-444d-a9db-cbe8a99b5cdf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:22.406366 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-983386d9-fa1c-444d-a9db-cbe8a99b5cdf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.429063 Oct 04 20:40:22.410371 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 572/1161] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:21 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:22.835235 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c6317f09-deb8-43f0-8960-734df9dc42e7 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/90959bc5-99a2-4f29-9158-c9fd3f00e774" status: 202 len: 0 microversion: 2.1 time: 0.955096 Oct 04 20:40:22.835235 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 590/1162] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:21 2022] DELETE /compute/v2.1/os-security-groups/90959bc5-99a2-4f29-9158-c9fd3f00e774 => generated 0 bytes in 970 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:22.859290 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ba3bf799-1e8e-4dc9-80de-ab954d1a53b8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77eef62c10>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:22.933549 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-ba3bf799-1e8e-4dc9-80de-ab954d1a53b8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:40:22.937278 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.security_group_api [None req-ba3bf799-1e8e-4dc9-80de-ab954d1a53b8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Neutron security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 not found {{(pid=123539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:40:22.943879 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-ba3bf799-1e8e-4dc9-80de-ab954d1a53b8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] HTTP exception thrown: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:22.943879 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-560d41c3-3496-4e08-ae0d-753c66ec4721'] Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ba3bf799-1e8e-4dc9-80de-ab954d1a53b8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Request method failure captured: Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-security-groups/90959bc5-99a2-4f29-9158-c9fd3f00e774 HTTP/1.1 Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJoj5Co0k63X7911hCPGILvFaEcALGX3U5nnNcrAw6SQrdvM0tEtxyVw1eD-oG8LrEEcPsAootimejAT_rkU6efWU-bjthk6QKv7Zze2RliUvqHOC_LSJUie5bJpGqlcec4P2dopUyLBEuuuWU1w7dh-Bk-tcEqLZk62p3D8YKqRh04 Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dddbee054f49f3ac862994488fc147", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dddbee054f49f3ac862994488fc147"}]}] Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 65eee15492da4c449b3238e50e987bd5 Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: exception: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-560d41c3-3496-4e08-ae0d-753c66ec4721'] Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '90959bc5-99a2-4f29-9158-c9fd3f00e774'} Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:40:22.952960 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-560d41c3-3496-4e08-ae0d-753c66ec4721'] Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-560d41c3-3496-4e08-ae0d-753c66ec4721'] Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-560d41c3-3496-4e08-ae0d-753c66ec4721'] Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-560d41c3-3496-4e08-ae0d-753c66ec4721'] Oct 04 20:40:22.963013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:22.986372 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ba3bf799-1e8e-4dc9-80de-ab954d1a53b8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Returning 404 to user: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:22.986372 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-560d41c3-3496-4e08-ae0d-753c66ec4721'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:22.986372 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ba3bf799-1e8e-4dc9-80de-ab954d1a53b8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/90959bc5-99a2-4f29-9158-c9fd3f00e774" status: 404 len: 194 microversion: 2.1 time: 0.141547 Oct 04 20:40:22.988963 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 573/1163] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:40:22 2022] GET /compute/v2.1/os-security-groups/90959bc5-99a2-4f29-9158-c9fd3f00e774 => generated 194 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:22.996331 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3602691a-6732-4ad8-b590-5bde9e3460e1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2fe5e0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:23.034401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-220f22b4-98f2-4ea6-aef6-d1280b5e934f tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77eeeb5430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:23.212592 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3602691a-6732-4ad8-b590-5bde9e3460e1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.217242 Oct 04 20:40:23.218025 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 591/1164] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:22 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:23.468776 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cfae354c-b475-46a4-a766-bcc4b4b17bd4 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:23.473200 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-cfae354c-b475-46a4-a766-bcc4b4b17bd4 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:23.503777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cfae354c-b475-46a4-a766-bcc4b4b17bd4 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.515838 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cfae354c-b475-46a4-a766-bcc4b4b17bd4 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.517183 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cfae354c-b475-46a4-a766-bcc4b4b17bd4 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.519476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cfae354c-b475-46a4-a766-bcc4b4b17bd4 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.520733 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cfae354c-b475-46a4-a766-bcc4b4b17bd4 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.521822 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cfae354c-b475-46a4-a766-bcc4b4b17bd4 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.865014 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-cfae354c-b475-46a4-a766-bcc4b4b17bd4 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:23.896501 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-cfae354c-b475-46a4-a766-bcc4b4b17bd4 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:23.900806 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-cfae354c-b475-46a4-a766-bcc4b4b17bd4 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:23.917683 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cfae354c-b475-46a4-a766-bcc4b4b17bd4 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.456503 Oct 04 20:40:23.920357 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 592/1165] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:23 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:40:24.167296 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-220f22b4-98f2-4ea6-aef6-d1280b5e934f tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/b6c2207d-8522-4d59-b2a1-24a89ffad91a" status: 202 len: 0 microversion: 2.1 time: 1.170018 Oct 04 20:40:24.174346 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 574/1166] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:22 2022] DELETE /compute/v2.1/os-security-groups/b6c2207d-8522-4d59-b2a1-24a89ffad91a => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:24.187407 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c814a7a0-8cc1-42f1-a6ce-d34934ad8bc3 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77ef2feaf0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:24.242520 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d5c3e2a4-8abb-4e37-af80-aa64baef4e43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eeeb5940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:24.292705 n-d-852085-12 devstack@n-api.service[123540]: DEBUG neutronclient.v2_0.client [None req-c814a7a0-8cc1-42f1-a6ce-d34934ad8bc3 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist", "detail": ""}} {{(pid=123540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:40:24.297079 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.security_group_api [None req-c814a7a0-8cc1-42f1-a6ce-d34934ad8bc3 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Neutron security group b6c2207d-8522-4d59-b2a1-24a89ffad91a not found {{(pid=123540) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:40:24.299047 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-c814a7a0-8cc1-42f1-a6ce-d34934ad8bc3 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] HTTP exception thrown: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:24.299047 n-d-852085-12 devstack@n-api.service[123540]: Neutron server returns request_ids: ['req-dff6dd47-d525-421a-b326-8578b3907893'] Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c814a7a0-8cc1-42f1-a6ce-d34934ad8bc3 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Request method failure captured: Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-security-groups/b6c2207d-8522-4d59-b2a1-24a89ffad91a HTTP/1.1 Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJoj5Co0k63X7911hCPGILvFaEcALGX3U5nnNcrAw6SQrdvM0tEtxyVw1eD-oG8LrEEcPsAootimejAT_rkU6efWU-bjthk6QKv7Zze2RliUvqHOC_LSJUie5bJpGqlcec4P2dopUyLBEuuuWU1w7dh-Bk-tcEqLZk62p3D8YKqRh04 Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dddbee054f49f3ac862994488fc147", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dddbee054f49f3ac862994488fc147"}]}] Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 65eee15492da4c449b3238e50e987bd5 Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: exception: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: Neutron server returns request_ids: ['req-dff6dd47-d525-421a-b326-8578b3907893'] Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'b6c2207d-8522-4d59-b2a1-24a89ffad91a'} Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:40:24.305334 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dff6dd47-d525-421a-b326-8578b3907893'] Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dff6dd47-d525-421a-b326-8578b3907893'] Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dff6dd47-d525-421a-b326-8578b3907893'] Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dff6dd47-d525-421a-b326-8578b3907893'] Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c814a7a0-8cc1-42f1-a6ce-d34934ad8bc3 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Returning 404 to user: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:24.321190 n-d-852085-12 devstack@n-api.service[123540]: Neutron server returns request_ids: ['req-dff6dd47-d525-421a-b326-8578b3907893'] {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:24.333540 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c814a7a0-8cc1-42f1-a6ce-d34934ad8bc3 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/b6c2207d-8522-4d59-b2a1-24a89ffad91a" status: 404 len: 194 microversion: 2.1 time: 0.144608 Oct 04 20:40:24.333540 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 593/1167] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:40:24 2022] GET /compute/v2.1/os-security-groups/b6c2207d-8522-4d59-b2a1-24a89ffad91a => generated 194 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:40:24.351185 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d89d3372-896a-4008-a43a-af8ad3a82b59 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77ef28c820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:24.443786 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d5c3e2a4-8abb-4e37-af80-aa64baef4e43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.208887 Oct 04 20:40:24.452169 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 575/1168] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:24 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:24.993790 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dfd68545-8d4e-45bb-b9f9-4d73c1fe33a5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:24.994992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-dfd68545-8d4e-45bb-b9f9-4d73c1fe33a5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:25.017786 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:25.022894 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dfd68545-8d4e-45bb-b9f9-4d73c1fe33a5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:25.030271 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dfd68545-8d4e-45bb-b9f9-4d73c1fe33a5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:25.032607 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dfd68545-8d4e-45bb-b9f9-4d73c1fe33a5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:25.036174 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dfd68545-8d4e-45bb-b9f9-4d73c1fe33a5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:25.039189 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dfd68545-8d4e-45bb-b9f9-4d73c1fe33a5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:25.041254 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dfd68545-8d4e-45bb-b9f9-4d73c1fe33a5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:25.059927 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:25.579061 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d89d3372-896a-4008-a43a-af8ad3a82b59 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/28bcd731-007f-4ea3-b1f1-7ea1732a5ef5" status: 202 len: 0 microversion: 2.1 time: 1.240681 Oct 04 20:40:25.582067 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 594/1169] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:24 2022] DELETE /compute/v2.1/os-security-groups/28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 => generated 0 bytes in 1246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:40:25.610791 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2a4b9aa5-280f-49d9-b43d-65003f8b5fe9 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28c9d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:25.656990 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-dfd68545-8d4e-45bb-b9f9-4d73c1fe33a5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:25.724270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-dfd68545-8d4e-45bb-b9f9-4d73c1fe33a5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:25.735421 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-dfd68545-8d4e-45bb-b9f9-4d73c1fe33a5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:25.765491 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-dfd68545-8d4e-45bb-b9f9-4d73c1fe33a5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.783122 Oct 04 20:40:25.777848 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 576/1170] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:24 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:25.802686 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-68e041d4-e0d7-4405-8944-e3d38dbd8455 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77eeeb58b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:25.849441 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2a4b9aa5-280f-49d9-b43d-65003f8b5fe9 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.264498 Oct 04 20:40:25.853716 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 595/1171] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:25 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:25.899124 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-68e041d4-e0d7-4405-8944-e3d38dbd8455 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:40:25.900235 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.security_group_api [None req-68e041d4-e0d7-4405-8944-e3d38dbd8455 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Neutron security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 not found {{(pid=123539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:40:25.901161 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-68e041d4-e0d7-4405-8944-e3d38dbd8455 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] HTTP exception thrown: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:25.901161 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-123820bd-f022-4dc6-b17d-28bd67a9f5dd'] Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-68e041d4-e0d7-4405-8944-e3d38dbd8455 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Request method failure captured: Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-security-groups/28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 HTTP/1.1 Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJoj5Co0k63X7911hCPGILvFaEcALGX3U5nnNcrAw6SQrdvM0tEtxyVw1eD-oG8LrEEcPsAootimejAT_rkU6efWU-bjthk6QKv7Zze2RliUvqHOC_LSJUie5bJpGqlcec4P2dopUyLBEuuuWU1w7dh-Bk-tcEqLZk62p3D8YKqRh04 Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dddbee054f49f3ac862994488fc147", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dddbee054f49f3ac862994488fc147"}]}] Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 65eee15492da4c449b3238e50e987bd5 Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: exception: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-123820bd-f022-4dc6-b17d-28bd67a9f5dd'] Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '28bcd731-007f-4ea3-b1f1-7ea1732a5ef5'} Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:40:25.905259 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-123820bd-f022-4dc6-b17d-28bd67a9f5dd'] Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-123820bd-f022-4dc6-b17d-28bd67a9f5dd'] Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-123820bd-f022-4dc6-b17d-28bd67a9f5dd'] Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-123820bd-f022-4dc6-b17d-28bd67a9f5dd'] Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-68e041d4-e0d7-4405-8944-e3d38dbd8455 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Returning 404 to user: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-123820bd-f022-4dc6-b17d-28bd67a9f5dd'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-68e041d4-e0d7-4405-8944-e3d38dbd8455 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/28bcd731-007f-4ea3-b1f1-7ea1732a5ef5" status: 404 len: 194 microversion: 2.1 time: 0.127922 Oct 04 20:40:25.919907 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 577/1172] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:40:25 2022] GET /compute/v2.1/os-security-groups/28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 => generated 194 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:25.931200 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8bf69116-0c9e-4bb2-973b-72cd40ccf42e tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77ef2feee0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:26.784180 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8bf69116-0c9e-4bb2-973b-72cd40ccf42e tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.853736 Oct 04 20:40:26.784180 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 596/1173] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:40:25 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:26.814712 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-51bd13ec-36c6-46c9-bb66-e6ac4b2ff5d8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Action: 'create', calling method: .version_select at 0x7f77eeeba040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1022678932", "description": "tempest-description-1827483017"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:26.859951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9cdba7b2-1168-4e7c-8ca8-f0e4bc528de1 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:26.861499 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9cdba7b2-1168-4e7c-8ca8-f0e4bc528de1 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:26.923775 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9cdba7b2-1168-4e7c-8ca8-f0e4bc528de1 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:26.925778 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9cdba7b2-1168-4e7c-8ca8-f0e4bc528de1 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:26.926898 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9cdba7b2-1168-4e7c-8ca8-f0e4bc528de1 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:26.928599 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9cdba7b2-1168-4e7c-8ca8-f0e4bc528de1 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:26.936399 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9cdba7b2-1168-4e7c-8ca8-f0e4bc528de1 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:26.937695 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9cdba7b2-1168-4e7c-8ca8-f0e4bc528de1 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:27.169514 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9cdba7b2-1168-4e7c-8ca8-f0e4bc528de1 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:27.244082 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9cdba7b2-1168-4e7c-8ca8-f0e4bc528de1 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:27.249904 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9cdba7b2-1168-4e7c-8ca8-f0e4bc528de1 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:27.291106 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9cdba7b2-1168-4e7c-8ca8-f0e4bc528de1 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.443339 Oct 04 20:40:27.292404 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 597/1174] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:26 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:27.366381 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-defef180-ffeb-47d3-a6b4-9fdd227d7f65 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2fe8b0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:27.561549 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-defef180-ffeb-47d3-a6b4-9fdd227d7f65 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.232198 Oct 04 20:40:27.586798 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 598/1175] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:27 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:27.810946 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-51bd13ec-36c6-46c9-bb66-e6ac4b2ff5d8 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.992908 Oct 04 20:40:27.819829 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 578/1176] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:26 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:40:27.835415 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-31d1fd7c-959e-45db-bd8c-aa1452f41eca tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Action: 'create', calling method: .version_select at 0x7f77ef2901f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1712452947", "description": "tempest-description-1928813346"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:28.361984 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6c0edb52-cca3-4d83-aa0d-85507c1fb504 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:28.364009 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6c0edb52-cca3-4d83-aa0d-85507c1fb504 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:28.433780 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6c0edb52-cca3-4d83-aa0d-85507c1fb504 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:28.434738 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6c0edb52-cca3-4d83-aa0d-85507c1fb504 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:28.435620 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6c0edb52-cca3-4d83-aa0d-85507c1fb504 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:28.459296 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6c0edb52-cca3-4d83-aa0d-85507c1fb504 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:28.460240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6c0edb52-cca3-4d83-aa0d-85507c1fb504 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:28.461073 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6c0edb52-cca3-4d83-aa0d-85507c1fb504 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:28.840513 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6c0edb52-cca3-4d83-aa0d-85507c1fb504 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:28.878267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6c0edb52-cca3-4d83-aa0d-85507c1fb504 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:28.886945 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6c0edb52-cca3-4d83-aa0d-85507c1fb504 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:28.916683 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6c0edb52-cca3-4d83-aa0d-85507c1fb504 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.560852 Oct 04 20:40:28.927378 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 579/1177] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:28 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:28.952233 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d6768eff-23d8-4d11-8a7b-d2f9e8cb77a6 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eeeb5a60>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:29.069272 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-31d1fd7c-959e-45db-bd8c-aa1452f41eca tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.254841 Oct 04 20:40:29.072438 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 599/1178] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:27 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:29.198834 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d6768eff-23d8-4d11-8a7b-d2f9e8cb77a6 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.267276 Oct 04 20:40:29.200182 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 580/1179] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:28 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:29.518135 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2ff2e8c4-8ebc-4868-9e8e-7bbeb9202128 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1232963312", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0bca21b9-d9dd-47ed-b98b-fa1ff3590c09"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:29.895621 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-2ff2e8c4-8ebc-4868-9e8e-7bbeb9202128 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] validate_networks() for [('0bca21b9-d9dd-47ed-b98b-fa1ff3590c09', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:29.986603 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9dfd5f4c-a7cd-492a-9c5a-2eb666caaae9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:29.988068 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9dfd5f4c-a7cd-492a-9c5a-2eb666caaae9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:30.017228 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9dfd5f4c-a7cd-492a-9c5a-2eb666caaae9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:30.018148 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9dfd5f4c-a7cd-492a-9c5a-2eb666caaae9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:30.022666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:30.028261 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9dfd5f4c-a7cd-492a-9c5a-2eb666caaae9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:30.028261 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9dfd5f4c-a7cd-492a-9c5a-2eb666caaae9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:30.028261 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9dfd5f4c-a7cd-492a-9c5a-2eb666caaae9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:30.028261 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9dfd5f4c-a7cd-492a-9c5a-2eb666caaae9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:30.577249 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9dfd5f4c-a7cd-492a-9c5a-2eb666caaae9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:30.631881 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9dfd5f4c-a7cd-492a-9c5a-2eb666caaae9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:30.648671 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9dfd5f4c-a7cd-492a-9c5a-2eb666caaae9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:30.700863 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9dfd5f4c-a7cd-492a-9c5a-2eb666caaae9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.721938 Oct 04 20:40:30.703894 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 581/1180] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:29 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:30.717811 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-44914ce1-0fd3-4e98-b42a-0eff56eb4d61 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eeed1d30>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:30.884050 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-44914ce1-0fd3-4e98-b42a-0eff56eb4d61 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.175502 Oct 04 20:40:30.886670 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 582/1181] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:30 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-2ff2e8c4-8ebc-4868-9e8e-7bbeb9202128 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3d4708ae-4dfe-4f69-9227-9575ac9c78fe) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:40:31.102617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3d4708ae-4dfe-4f69-9227-9575ac9c78fe) Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-2ff2e8c4-8ebc-4868-9e8e-7bbeb9202128 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2ff2e8c4-8ebc-4868-9e8e-7bbeb9202128 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Request method failure captured: Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 208 Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJoj5Co0k63X7911hCPGILvFaEcALGX3U5nnNcrAw6SQrdvM0tEtxyVw1eD-oG8LrEEcPsAootimejAT_rkU6efWU-bjthk6QKv7Zze2RliUvqHOC_LSJUie5bJpGqlcec4P2dopUyLBEuuuWU1w7dh-Bk-tcEqLZk62p3D8YKqRh04 Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dddbee054f49f3ac862994488fc147", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dddbee054f49f3ac862994488fc147"}]}] Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 65eee15492da4c449b3238e50e987bd5 Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1232963312", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0bca21b9-d9dd-47ed-b98b-fa1ff3590c09"}]}} Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-SecurityGroupsTestJSON-server-1232963312', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '0bca21b9-d9dd-47ed-b98b-fa1ff3590c09'}]}}} Oct 04 20:40:31.113921 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:40:31.148668 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3d4708ae-4dfe-4f69-9227-9575ac9c78fe) Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2ff2e8c4-8ebc-4868-9e8e-7bbeb9202128 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2ff2e8c4-8ebc-4868-9e8e-7bbeb9202128 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.602983 Oct 04 20:40:31.164974 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 600/1182] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:29 2022] POST /compute/v2.1/servers => generated 214 bytes in 1652 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:40:31.187729 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9602ec01-9d7e-4b5b-9f06-96b59b87ab61 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Action: 'create', calling method: .version_select at 0x7f77ef2d6a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-21847719", "description": "tempest-description-284771308"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:31.656391 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1216645144", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:31.891561 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:32.314988 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9602ec01-9d7e-4b5b-9f06-96b59b87ab61 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 1.150713 Oct 04 20:40:32.317195 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 601/1183] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:31 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:32.355921 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c99d5c91-8899-4d72-aeeb-5448f8f7aec6 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:32.366642 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c99d5c91-8899-4d72-aeeb-5448f8f7aec6 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:32.430377 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c99d5c91-8899-4d72-aeeb-5448f8f7aec6 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:32.441702 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c99d5c91-8899-4d72-aeeb-5448f8f7aec6 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:32.445502 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c99d5c91-8899-4d72-aeeb-5448f8f7aec6 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:32.448828 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c99d5c91-8899-4d72-aeeb-5448f8f7aec6 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:32.457941 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c99d5c91-8899-4d72-aeeb-5448f8f7aec6 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:32.460671 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c99d5c91-8899-4d72-aeeb-5448f8f7aec6 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:32.616298 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:32.868601 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c99d5c91-8899-4d72-aeeb-5448f8f7aec6 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:32.926717 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c99d5c91-8899-4d72-aeeb-5448f8f7aec6 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:32.930113 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c99d5c91-8899-4d72-aeeb-5448f8f7aec6 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:33.011339 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c99d5c91-8899-4d72-aeeb-5448f8f7aec6 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.687551 Oct 04 20:40:33.024125 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 602/1184] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:32 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:33.053732 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c8f7d5c6-11eb-41cf-8234-b6e639597534 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2feb80>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:33.306756 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c8f7d5c6-11eb-41cf-8234-b6e639597534 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.259817 Oct 04 20:40:33.312400 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 603/1185] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:33 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:33.338482 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-247b212b-f07f-45fb-8469-6871176b8287 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Action: 'update', calling method: .version_select at 0x7f77ef28ce50>, body: {"security_group": {"name": "tempest-sg-hth-1489069326", "description": "tempest-description-hth-887901178"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:34.468271 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:40:34.470195 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:40:34.471581 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:40:34.474745 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:40:34.476044 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:40:34.564568 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:34.566725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:34.569406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:34.580327 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:34.582036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:34.591831 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:34.680459 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Getting quotas for project f4fa3c2885ec48db880029d93907789d. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:34.693636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Getting quotas for user ca528ff45435455aa4fce16549993ab5 and project f4fa3c2885ec48db880029d93907789d. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:34.723520 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:40:34.728804 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:40:35.084721 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-77ab1c42-1067-41b2-8074-02d95c81f936 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.195538 Oct 04 20:40:35.087773 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 583/1186] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 4200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:40:35.122161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-618446dc-0bda-4472-b4c0-309da8ae1269 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:35.130638 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-618446dc-0bda-4472-b4c0-309da8ae1269 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:35.156202 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-618446dc-0bda-4472-b4c0-309da8ae1269 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:35.161993 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-618446dc-0bda-4472-b4c0-309da8ae1269 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:35.164158 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-618446dc-0bda-4472-b4c0-309da8ae1269 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:35.166071 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-618446dc-0bda-4472-b4c0-309da8ae1269 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:35.170727 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-618446dc-0bda-4472-b4c0-309da8ae1269 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:35.172121 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-618446dc-0bda-4472-b4c0-309da8ae1269 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:35.611626 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-247b212b-f07f-45fb-8469-6871176b8287 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "PUT /compute/v2.1/os-security-groups/bc535bc2-db85-4b07-8412-5938728a6030" status: 200 len: 217 microversion: 2.1 time: 2.290813 Oct 04 20:40:35.614402 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 604/1187] 10.222.0.78 () {60 vars in 1290 bytes} [Tue Oct 4 20:40:33 2022] PUT /compute/v2.1/os-security-groups/bc535bc2-db85-4b07-8412-5938728a6030 => generated 217 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:35.626585 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8ee98831-f5fc-40de-8c41-0e7db732e53a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef290f70>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:35.809893 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8ee98831-f5fc-40de-8c41-0e7db732e53a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.192669 Oct 04 20:40:35.817240 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 605/1188] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:35 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:35.834518 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-618446dc-0bda-4472-b4c0-309da8ae1269 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:35.836109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7c48ece7-f84d-471b-9964-ecffc71848a6 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:35.838471 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7c48ece7-f84d-471b-9964-ecffc71848a6 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:35.891896 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-618446dc-0bda-4472-b4c0-309da8ae1269 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:35.914104 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-618446dc-0bda-4472-b4c0-309da8ae1269 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:35.949998 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-618446dc-0bda-4472-b4c0-309da8ae1269 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.857600 Oct 04 20:40:35.952308 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 584/1189] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:35 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:36.420201 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7c48ece7-f84d-471b-9964-ecffc71848a6 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:36.472535 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7c48ece7-f84d-471b-9964-ecffc71848a6 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1214 microversion: 2.1 time: 0.652830 Oct 04 20:40:36.480257 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 606/1190] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:35 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1214 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:36.531956 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-95e7c44f-5d97-4fb5-aa7c-651ee800578f tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77ef2fed30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:36.606243 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2b4a9ed3-0448-4e3c-8c47-c9d10c3e4f01 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Action: 'update', calling method: .version_select at 0x7f77eef5eca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:36.917414 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b4a9ed3-0448-4e3c-8c47-c9d10c3e4f01 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:36.918478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b4a9ed3-0448-4e3c-8c47-c9d10c3e4f01 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:36.919095 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b4a9ed3-0448-4e3c-8c47-c9d10c3e4f01 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:36.920593 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b4a9ed3-0448-4e3c-8c47-c9d10c3e4f01 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:36.921666 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b4a9ed3-0448-4e3c-8c47-c9d10c3e4f01 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:36.922626 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b4a9ed3-0448-4e3c-8c47-c9d10c3e4f01 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:36.943088 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-95e7c44f-5d97-4fb5-aa7c-651ee800578f tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/bc535bc2-db85-4b07-8412-5938728a6030" status: 200 len: 217 microversion: 2.1 time: 0.456085 Oct 04 20:40:36.945426 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 607/1191] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:40:36 2022] GET /compute/v2.1/os-security-groups/bc535bc2-db85-4b07-8412-5938728a6030 => generated 217 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:36.971987 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d6cc6d78-9357-48a0-8892-1e6693023bba tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28c940>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:37.199270 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d6cc6d78-9357-48a0-8892-1e6693023bba tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.250865 Oct 04 20:40:37.216893 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 608/1192] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:36 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:37.279002 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f7c0b5f4-ed6a-4865-b4b5-7f5839d6f67e tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77efab1820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:37.400504 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2b4a9ed3-0448-4e3c-8c47-c9d10c3e4f01 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/8eb02b29a6a14cc1ac936a2ee2f7c9e6" status: 200 len: 240 microversion: 2.36 time: 1.437926 Oct 04 20:40:37.410486 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 585/1193] 10.222.0.78 () {62 vars in 1303 bytes} [Tue Oct 4 20:40:35 2022] PUT /compute/v2.1/os-quota-sets/8eb02b29a6a14cc1ac936a2ee2f7c9e6 => generated 240 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:37.457584 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-926475cc-4f19-4bc4-ac64-87a6acd7eb18 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:37.458735 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-926475cc-4f19-4bc4-ac64-87a6acd7eb18 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:37.507061 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-926475cc-4f19-4bc4-ac64-87a6acd7eb18 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:37.508056 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-926475cc-4f19-4bc4-ac64-87a6acd7eb18 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:37.508861 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-926475cc-4f19-4bc4-ac64-87a6acd7eb18 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:37.520843 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-926475cc-4f19-4bc4-ac64-87a6acd7eb18 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:37.521494 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-926475cc-4f19-4bc4-ac64-87a6acd7eb18 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:37.522148 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-926475cc-4f19-4bc4-ac64-87a6acd7eb18 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:38.216270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-926475cc-4f19-4bc4-ac64-87a6acd7eb18 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:38.269423 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-926475cc-4f19-4bc4-ac64-87a6acd7eb18 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:38.274235 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-926475cc-4f19-4bc4-ac64-87a6acd7eb18 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:38.317567 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-926475cc-4f19-4bc4-ac64-87a6acd7eb18 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.903225 Oct 04 20:40:38.323729 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 586/1194] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:37 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:38.338294 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-872bbab2-65e1-4346-b98e-4a7ea1b276be tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Calling method '.version_select at 0x7f77eee859d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:38.649923 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-872bbab2-65e1-4346-b98e-4a7ea1b276be tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:38.650776 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-872bbab2-65e1-4346-b98e-4a7ea1b276be tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:38.651598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-872bbab2-65e1-4346-b98e-4a7ea1b276be tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:38.662368 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-872bbab2-65e1-4346-b98e-4a7ea1b276be tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:38.718978 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-872bbab2-65e1-4346-b98e-4a7ea1b276be tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.057s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:38.729868 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-872bbab2-65e1-4346-b98e-4a7ea1b276be tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:39.055719 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-872bbab2-65e1-4346-b98e-4a7ea1b276be tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/8eb02b29a6a14cc1ac936a2ee2f7c9e6/detail" status: 200 len: 672 microversion: 2.36 time: 0.669313 Oct 04 20:40:39.063027 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 587/1195] 10.222.0.78 () {60 vars in 1304 bytes} [Tue Oct 4 20:40:38 2022] GET /compute/v2.1/os-quota-sets/8eb02b29a6a14cc1ac936a2ee2f7c9e6/detail => generated 672 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:39.085707 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-76969dd8-ccc5-46f7-a154-cb6703c04fee tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:39.097242 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-76969dd8-ccc5-46f7-a154-cb6703c04fee tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:39.131240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-76969dd8-ccc5-46f7-a154-cb6703c04fee tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:39.133847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-76969dd8-ccc5-46f7-a154-cb6703c04fee tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:39.135023 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-76969dd8-ccc5-46f7-a154-cb6703c04fee tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:39.138287 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-76969dd8-ccc5-46f7-a154-cb6703c04fee tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:39.146566 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-76969dd8-ccc5-46f7-a154-cb6703c04fee tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:39.149924 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-76969dd8-ccc5-46f7-a154-cb6703c04fee tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:39.592486 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-76969dd8-ccc5-46f7-a154-cb6703c04fee tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:39.623594 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f7c0b5f4-ed6a-4865-b4b5-7f5839d6f67e tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/bc535bc2-db85-4b07-8412-5938728a6030" status: 202 len: 0 microversion: 2.1 time: 2.391392 Oct 04 20:40:39.624846 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 609/1196] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:37 2022] DELETE /compute/v2.1/os-security-groups/bc535bc2-db85-4b07-8412-5938728a6030 => generated 0 bytes in 2407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:39.641116 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-76969dd8-ccc5-46f7-a154-cb6703c04fee tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1218 microversion: 2.1 time: 0.574786 Oct 04 20:40:39.644834 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 588/1197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:39 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1218 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:39.652154 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ead919e7-bacc-46fa-b2bc-80b93abb228d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2fef70>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:39.672402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4e05f080-0bbf-4077-855e-d9445c0b3b9b tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:39.675043 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4e05f080-0bbf-4077-855e-d9445c0b3b9b tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:39.708179 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e05f080-0bbf-4077-855e-d9445c0b3b9b tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:39.710193 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e05f080-0bbf-4077-855e-d9445c0b3b9b tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:39.714207 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e05f080-0bbf-4077-855e-d9445c0b3b9b tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:39.719892 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e05f080-0bbf-4077-855e-d9445c0b3b9b tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:39.721162 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e05f080-0bbf-4077-855e-d9445c0b3b9b tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:39.722315 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e05f080-0bbf-4077-855e-d9445c0b3b9b tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:39.986037 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ead919e7-bacc-46fa-b2bc-80b93abb228d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.358862 Oct 04 20:40:40.008200 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 610/1198] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:39 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:40.039907 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a9d6d8c5-53e3-4065-a753-242ebcb0355f tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77ef681a60>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:40.226232 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4e05f080-0bbf-4077-855e-d9445c0b3b9b tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:40.295802 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4e05f080-0bbf-4077-855e-d9445c0b3b9b tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:40.304071 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4e05f080-0bbf-4077-855e-d9445c0b3b9b tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:40.371877 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4e05f080-0bbf-4077-855e-d9445c0b3b9b tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.718263 Oct 04 20:40:40.382306 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 589/1199] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:39 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:40.431605 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Action: 'update', calling method: .version_select at 0x7f77eeeb51f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:40.808877 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.825636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.830411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:40.833783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.841481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.842448 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:41.094046 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:41.098204 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:41.099550 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:41.102406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:41.103863 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:41.104974 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:41.467430 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-97266e20-6ba1-48b1-a92e-98f55ff1fe79 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/8eb02b29a6a14cc1ac936a2ee2f7c9e6?user_id=0961c921d6454ab9b67c118b145fa2d0" status: 200 len: 240 microversion: 2.36 time: 1.082815 Oct 04 20:40:41.481933 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 590/1200] 10.222.0.78 () {62 vars in 1384 bytes} [Tue Oct 4 20:40:40 2022] PUT /compute/v2.1/os-quota-sets/8eb02b29a6a14cc1ac936a2ee2f7c9e6?user_id=0961c921d6454ab9b67c118b145fa2d0 => generated 240 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:41.492247 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0a67a813-a86f-4a1c-92c5-bb1881e360a5 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:41.506486 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-0a67a813-a86f-4a1c-92c5-bb1881e360a5 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:41.538172 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0a67a813-a86f-4a1c-92c5-bb1881e360a5 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:41.539202 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0a67a813-a86f-4a1c-92c5-bb1881e360a5 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:41.550636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0a67a813-a86f-4a1c-92c5-bb1881e360a5 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:41.553228 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0a67a813-a86f-4a1c-92c5-bb1881e360a5 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:41.554127 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0a67a813-a86f-4a1c-92c5-bb1881e360a5 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:41.555063 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0a67a813-a86f-4a1c-92c5-bb1881e360a5 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.855927 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-0a67a813-a86f-4a1c-92c5-bb1881e360a5 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:42.889911 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0a67a813-a86f-4a1c-92c5-bb1881e360a5 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1266 microversion: 2.1 time: 1.418576 Oct 04 20:40:42.899208 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 591/1201] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:41 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1266 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:42.918186 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-144452cc-47f5-4f0b-92a4-de99a75d4504 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eeeb5c10>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:43.050173 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-144452cc-47f5-4f0b-92a4-de99a75d4504 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1454 microversion: 2.1 time: 0.148668 Oct 04 20:40:43.051168 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 592/1202] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:42 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:43.073301 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8d81a745-b27a-4d1f-ab93-4e9555a52cfc tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:43.074635 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8d81a745-b27a-4d1f-ab93-4e9555a52cfc tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:43.098986 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d81a745-b27a-4d1f-ab93-4e9555a52cfc tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.108541 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d81a745-b27a-4d1f-ab93-4e9555a52cfc tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.109350 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d81a745-b27a-4d1f-ab93-4e9555a52cfc tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.110743 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d81a745-b27a-4d1f-ab93-4e9555a52cfc tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.111692 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d81a745-b27a-4d1f-ab93-4e9555a52cfc tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.112494 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8d81a745-b27a-4d1f-ab93-4e9555a52cfc tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.402111 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a9d6d8c5-53e3-4065-a753-242ebcb0355f tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/adcc0ca9-17a4-42c4-8cf1-974c36840639" status: 202 len: 0 microversion: 2.1 time: 3.391826 Oct 04 20:40:43.413051 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 611/1203] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:40 2022] DELETE /compute/v2.1/os-security-groups/adcc0ca9-17a4-42c4-8cf1-974c36840639 => generated 0 bytes in 3404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:43.428655 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-532d811f-bbeb-4cc4-8499-a21c68293009 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Calling method '.version_select at 0x7f77ef28c670>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:43.512411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8d81a745-b27a-4d1f-ab93-4e9555a52cfc tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:43.545298 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8d81a745-b27a-4d1f-ab93-4e9555a52cfc tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:43.557363 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8d81a745-b27a-4d1f-ab93-4e9555a52cfc tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:43.572475 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8d81a745-b27a-4d1f-ab93-4e9555a52cfc tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.505825 Oct 04 20:40:43.572907 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 593/1204] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:43 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:43.580182 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d052ec08-ffe2-4860-ac42-6e5ddae9bf32 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77eee85160>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:43.753848 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=36 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:43.812404 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=5 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:43.834536 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-532d811f-bbeb-4cc4-8499-a21c68293009 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/8eb02b29a6a14cc1ac936a2ee2f7c9e6?user_id=0961c921d6454ab9b67c118b145fa2d0" status: 200 len: 282 microversion: 2.36 time: 0.416826 Oct 04 20:40:43.847888 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 612/1205] 10.222.0.78 () {60 vars in 1364 bytes} [Tue Oct 4 20:40:43 2022] GET /compute/v2.1/os-quota-sets/8eb02b29a6a14cc1ac936a2ee2f7c9e6?user_id=0961c921d6454ab9b67c118b145fa2d0 => generated 282 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:43.953199 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c899e759-1a78-4bb2-a2b2-158134d2e64b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:43.960779 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c899e759-1a78-4bb2-a2b2-158134d2e64b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:43.985157 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c899e759-1a78-4bb2-a2b2-158134d2e64b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.987331 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c899e759-1a78-4bb2-a2b2-158134d2e64b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.988914 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c899e759-1a78-4bb2-a2b2-158134d2e64b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.990557 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c899e759-1a78-4bb2-a2b2-158134d2e64b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.991912 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c899e759-1a78-4bb2-a2b2-158134d2e64b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.992983 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c899e759-1a78-4bb2-a2b2-158134d2e64b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.225984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c899e759-1a78-4bb2-a2b2-158134d2e64b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:44.262633 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c899e759-1a78-4bb2-a2b2-158134d2e64b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1272 microversion: 2.1 time: 0.316695 Oct 04 20:40:44.275177 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 613/1206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:43 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1272 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:44.292349 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8e74e8ea-a9b1-4499-ae4a-df7118a819e6 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef290af0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:44.465757 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8e74e8ea-a9b1-4499-ae4a-df7118a819e6 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1463 microversion: 2.1 time: 0.177835 Oct 04 20:40:44.481273 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 614/1207] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:44 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1463 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:44.528300 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0250f162-6b75-4255-ad40-126aa1da39cd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28c430>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:44.748318 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0250f162-6b75-4255-ad40-126aa1da39cd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 200 len: 1463 microversion: 2.1 time: 0.264428 Oct 04 20:40:44.765936 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 615/1208] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:44 2022] GET /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 1463 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:44.805483 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b70cf1d3-772b-4a0a-ac97-8994cadfe4a7 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:44.815349 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b70cf1d3-772b-4a0a-ac97-8994cadfe4a7 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:44.851983 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b70cf1d3-772b-4a0a-ac97-8994cadfe4a7 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.852908 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b70cf1d3-772b-4a0a-ac97-8994cadfe4a7 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.853757 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b70cf1d3-772b-4a0a-ac97-8994cadfe4a7 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.878929 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b70cf1d3-772b-4a0a-ac97-8994cadfe4a7 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.882009 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b70cf1d3-772b-4a0a-ac97-8994cadfe4a7 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.884536 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b70cf1d3-772b-4a0a-ac97-8994cadfe4a7 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.064332 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b70cf1d3-772b-4a0a-ac97-8994cadfe4a7 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:45.105351 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b70cf1d3-772b-4a0a-ac97-8994cadfe4a7 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:45.108668 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b70cf1d3-772b-4a0a-ac97-8994cadfe4a7 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:45.140720 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b70cf1d3-772b-4a0a-ac97-8994cadfe4a7 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.371276 Oct 04 20:40:45.152409 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 616/1209] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:44 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:45.171311 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-05f78cf4-c00f-45c8-8f46-b675997aed0a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:45.176931 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-05f78cf4-c00f-45c8-8f46-b675997aed0a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:45.209986 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-05f78cf4-c00f-45c8-8f46-b675997aed0a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.211264 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-05f78cf4-c00f-45c8-8f46-b675997aed0a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.212238 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-05f78cf4-c00f-45c8-8f46-b675997aed0a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.213792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-05f78cf4-c00f-45c8-8f46-b675997aed0a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.216170 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-05f78cf4-c00f-45c8-8f46-b675997aed0a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.220394 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-05f78cf4-c00f-45c8-8f46-b675997aed0a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.797219 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d052ec08-ffe2-4860-ac42-6e5ddae9bf32 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/1a6f7f03-4ef0-4ee2-a3bf-218200ff2fa6" status: 202 len: 0 microversion: 2.1 time: 2.222605 Oct 04 20:40:45.800195 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 594/1210] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:43 2022] DELETE /compute/v2.1/os-security-groups/1a6f7f03-4ef0-4ee2-a3bf-218200ff2fa6 => generated 0 bytes in 2227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:45.817616 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-98168ced-3edb-49da-b9ea-74598694e1f2 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:45.831257 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-98168ced-3edb-49da-b9ea-74598694e1f2 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:45.874453 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-98168ced-3edb-49da-b9ea-74598694e1f2 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.877969 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-98168ced-3edb-49da-b9ea-74598694e1f2 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.880503 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-98168ced-3edb-49da-b9ea-74598694e1f2 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.886581 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-98168ced-3edb-49da-b9ea-74598694e1f2 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.889993 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-98168ced-3edb-49da-b9ea-74598694e1f2 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.894325 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-98168ced-3edb-49da-b9ea-74598694e1f2 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.531264 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-05f78cf4-c00f-45c8-8f46-b675997aed0a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:46.539663 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-98168ced-3edb-49da-b9ea-74598694e1f2 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:46.563701 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-98168ced-3edb-49da-b9ea-74598694e1f2 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1272 microversion: 2.1 time: 0.760994 Oct 04 20:40:46.579502 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-05f78cf4-c00f-45c8-8f46-b675997aed0a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364" status: 200 len: 1467 microversion: 2.1 time: 1.422178 Oct 04 20:40:46.598110 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 617/1211] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:45 2022] GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364 => generated 1467 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:46.598727 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 595/1212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:45 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1272 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:46.619263 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-702ee45e-e348-465e-a7aa-5fcb1358735e tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:46.620633 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-702ee45e-e348-465e-a7aa-5fcb1358735e tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:46.644188 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-015b5d89-4d89-4c6e-9461-418751a536c0 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77ef28ca60>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:46.645223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-702ee45e-e348-465e-a7aa-5fcb1358735e tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.646423 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-702ee45e-e348-465e-a7aa-5fcb1358735e tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.647529 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-702ee45e-e348-465e-a7aa-5fcb1358735e tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.649170 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-702ee45e-e348-465e-a7aa-5fcb1358735e tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.657252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-702ee45e-e348-465e-a7aa-5fcb1358735e tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.658602 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-702ee45e-e348-465e-a7aa-5fcb1358735e tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.729407 n-d-852085-12 devstack@n-api.service[123540]: DEBUG neutronclient.v2_0.client [None req-015b5d89-4d89-4c6e-9461-418751a536c0 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist", "detail": ""}} {{(pid=123540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:40:46.731047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.security_group_api [None req-015b5d89-4d89-4c6e-9461-418751a536c0 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Neutron security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 not found {{(pid=123540) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:40:46.732351 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-015b5d89-4d89-4c6e-9461-418751a536c0 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] HTTP exception thrown: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:46.732351 n-d-852085-12 devstack@n-api.service[123540]: Neutron server returns request_ids: ['req-3ab4b1bb-ec8a-4a6f-b9ba-67fe907388e9'] Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-015b5d89-4d89-4c6e-9461-418751a536c0 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Request method failure captured: Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/os-security-groups/28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 HTTP/1.1 Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJoj5Co0k63X7911hCPGILvFaEcALGX3U5nnNcrAw6SQrdvM0tEtxyVw1eD-oG8LrEEcPsAootimejAT_rkU6efWU-bjthk6QKv7Zze2RliUvqHOC_LSJUie5bJpGqlcec4P2dopUyLBEuuuWU1w7dh-Bk-tcEqLZk62p3D8YKqRh04 Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dddbee054f49f3ac862994488fc147", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dddbee054f49f3ac862994488fc147"}]}] Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 65eee15492da4c449b3238e50e987bd5 Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: exception: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: Neutron server returns request_ids: ['req-3ab4b1bb-ec8a-4a6f-b9ba-67fe907388e9'] Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '28bcd731-007f-4ea3-b1f1-7ea1732a5ef5'} Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:40:46.738181 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ab4b1bb-ec8a-4a6f-b9ba-67fe907388e9'] Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ab4b1bb-ec8a-4a6f-b9ba-67fe907388e9'] Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ab4b1bb-ec8a-4a6f-b9ba-67fe907388e9'] Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ab4b1bb-ec8a-4a6f-b9ba-67fe907388e9'] Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-015b5d89-4d89-4c6e-9461-418751a536c0 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Returning 404 to user: Security group 28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 does not exist Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: Neutron server returns request_ids: ['req-3ab4b1bb-ec8a-4a6f-b9ba-67fe907388e9'] {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-015b5d89-4d89-4c6e-9461-418751a536c0 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/28bcd731-007f-4ea3-b1f1-7ea1732a5ef5" status: 404 len: 194 microversion: 2.1 time: 0.161826 Oct 04 20:40:46.761447 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 618/1213] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:46 2022] DELETE /compute/v2.1/os-security-groups/28bcd731-007f-4ea3-b1f1-7ea1732a5ef5 => generated 194 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:46.779464 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-09eb7f77-de1a-40a9-bdd5-5693166f4980 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-482492191"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:46.785719 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-09eb7f77-de1a-40a9-bdd5-5693166f4980 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:46.803850 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-09eb7f77-de1a-40a9-bdd5-5693166f4980 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.806221 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-09eb7f77-de1a-40a9-bdd5-5693166f4980 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.828971 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-09eb7f77-de1a-40a9-bdd5-5693166f4980 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.828971 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-09eb7f77-de1a-40a9-bdd5-5693166f4980 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.828971 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-09eb7f77-de1a-40a9-bdd5-5693166f4980 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.828971 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-09eb7f77-de1a-40a9-bdd5-5693166f4980 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.865065 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-702ee45e-e348-465e-a7aa-5fcb1358735e tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:46.897817 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-702ee45e-e348-465e-a7aa-5fcb1358735e tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:46.897817 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-702ee45e-e348-465e-a7aa-5fcb1358735e tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:46.906133 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-702ee45e-e348-465e-a7aa-5fcb1358735e tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.305159 Oct 04 20:40:46.908027 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 596/1214] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:46 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:46.919398 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-88246195-d5f0-4264-a6b9-7569161c4519 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77eeed13a0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:47.184041 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-88246195-d5f0-4264-a6b9-7569161c4519 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:40:47.185755 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.security_group_api [None req-88246195-d5f0-4264-a6b9-7569161c4519 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Neutron security group b6c2207d-8522-4d59-b2a1-24a89ffad91a not found {{(pid=123539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:40:47.187111 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-88246195-d5f0-4264-a6b9-7569161c4519 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] HTTP exception thrown: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:47.187111 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-832e716d-da00-4093-9bd9-f1b06444bcfc'] Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-88246195-d5f0-4264-a6b9-7569161c4519 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Request method failure captured: Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/os-security-groups/b6c2207d-8522-4d59-b2a1-24a89ffad91a HTTP/1.1 Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJoj5Co0k63X7911hCPGILvFaEcALGX3U5nnNcrAw6SQrdvM0tEtxyVw1eD-oG8LrEEcPsAootimejAT_rkU6efWU-bjthk6QKv7Zze2RliUvqHOC_LSJUie5bJpGqlcec4P2dopUyLBEuuuWU1w7dh-Bk-tcEqLZk62p3D8YKqRh04 Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dddbee054f49f3ac862994488fc147", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dddbee054f49f3ac862994488fc147"}]}] Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 65eee15492da4c449b3238e50e987bd5 Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: exception: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-832e716d-da00-4093-9bd9-f1b06444bcfc'] Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'b6c2207d-8522-4d59-b2a1-24a89ffad91a'} Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:40:47.191669 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-832e716d-da00-4093-9bd9-f1b06444bcfc'] Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-832e716d-da00-4093-9bd9-f1b06444bcfc'] Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-832e716d-da00-4093-9bd9-f1b06444bcfc'] Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-832e716d-da00-4093-9bd9-f1b06444bcfc'] Oct 04 20:40:47.200013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.210519 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-88246195-d5f0-4264-a6b9-7569161c4519 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Returning 404 to user: Security group b6c2207d-8522-4d59-b2a1-24a89ffad91a does not exist Oct 04 20:40:47.210519 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-832e716d-da00-4093-9bd9-f1b06444bcfc'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:47.212014 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-88246195-d5f0-4264-a6b9-7569161c4519 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/b6c2207d-8522-4d59-b2a1-24a89ffad91a" status: 404 len: 194 microversion: 2.1 time: 0.296794 Oct 04 20:40:47.213513 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 597/1215] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:46 2022] DELETE /compute/v2.1/os-security-groups/b6c2207d-8522-4d59-b2a1-24a89ffad91a => generated 194 bytes in 304 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:47.228829 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-93c05b57-1ff0-4efe-9ccd-0778b2d80836 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77eeebaca0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:47.309859 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-93c05b57-1ff0-4efe-9ccd-0778b2d80836 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:40:47.312140 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.security_group_api [None req-93c05b57-1ff0-4efe-9ccd-0778b2d80836 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Neutron security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 not found {{(pid=123539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:40:47.313504 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-93c05b57-1ff0-4efe-9ccd-0778b2d80836 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] HTTP exception thrown: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:47.313504 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-6454914b-5964-4d30-99a0-77bf4da314e2'] Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-93c05b57-1ff0-4efe-9ccd-0778b2d80836 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Request method failure captured: Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/os-security-groups/90959bc5-99a2-4f29-9158-c9fd3f00e774 HTTP/1.1 Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJoj5Co0k63X7911hCPGILvFaEcALGX3U5nnNcrAw6SQrdvM0tEtxyVw1eD-oG8LrEEcPsAootimejAT_rkU6efWU-bjthk6QKv7Zze2RliUvqHOC_LSJUie5bJpGqlcec4P2dopUyLBEuuuWU1w7dh-Bk-tcEqLZk62p3D8YKqRh04 Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dddbee054f49f3ac862994488fc147", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dddbee054f49f3ac862994488fc147"}]}] Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 65eee15492da4c449b3238e50e987bd5 Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: exception: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-6454914b-5964-4d30-99a0-77bf4da314e2'] Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '90959bc5-99a2-4f29-9158-c9fd3f00e774'} Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:40:47.318655 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6454914b-5964-4d30-99a0-77bf4da314e2'] Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6454914b-5964-4d30-99a0-77bf4da314e2'] Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6454914b-5964-4d30-99a0-77bf4da314e2'] Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6454914b-5964-4d30-99a0-77bf4da314e2'] Oct 04 20:40:47.328402 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.338577 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-93c05b57-1ff0-4efe-9ccd-0778b2d80836 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Returning 404 to user: Security group 90959bc5-99a2-4f29-9158-c9fd3f00e774 does not exist Oct 04 20:40:47.338577 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-6454914b-5964-4d30-99a0-77bf4da314e2'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:47.340584 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-93c05b57-1ff0-4efe-9ccd-0778b2d80836 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/90959bc5-99a2-4f29-9158-c9fd3f00e774" status: 404 len: 194 microversion: 2.1 time: 0.119493 Oct 04 20:40:47.342100 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 598/1216] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:47 2022] DELETE /compute/v2.1/os-security-groups/90959bc5-99a2-4f29-9158-c9fd3f00e774 => generated 194 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:47.359381 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-24e408ff-494c-4639-bae1-99ad3d1c0676 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77eeebaa60>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:47.622380 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-24e408ff-494c-4639-bae1-99ad3d1c0676 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:40:47.623629 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.security_group_api [None req-24e408ff-494c-4639-bae1-99ad3d1c0676 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Neutron security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 not found {{(pid=123539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:40:47.624948 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-24e408ff-494c-4639-bae1-99ad3d1c0676 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] HTTP exception thrown: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:47.624948 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-2be3e53e-a978-47f1-ba41-7d8aea532419'] Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-24e408ff-494c-4639-bae1-99ad3d1c0676 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Request method failure captured: Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/os-security-groups/02d0c889-14e7-4e0a-b5ea-08df472b3e01 HTTP/1.1 Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJoj5Co0k63X7911hCPGILvFaEcALGX3U5nnNcrAw6SQrdvM0tEtxyVw1eD-oG8LrEEcPsAootimejAT_rkU6efWU-bjthk6QKv7Zze2RliUvqHOC_LSJUie5bJpGqlcec4P2dopUyLBEuuuWU1w7dh-Bk-tcEqLZk62p3D8YKqRh04 Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dddbee054f49f3ac862994488fc147", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dddbee054f49f3ac862994488fc147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dddbee054f49f3ac862994488fc147"}]}] Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 44dddbee054f49f3ac862994488fc147 Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1787400370 Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 65eee15492da4c449b3238e50e987bd5 Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupsTestJSON-1787400370-project Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: exception: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-2be3e53e-a978-47f1-ba41-7d8aea532419'] Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '02d0c889-14e7-4e0a-b5ea-08df472b3e01'} Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:40:47.629868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2be3e53e-a978-47f1-ba41-7d8aea532419'] Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2be3e53e-a978-47f1-ba41-7d8aea532419'] Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2be3e53e-a978-47f1-ba41-7d8aea532419'] Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2be3e53e-a978-47f1-ba41-7d8aea532419'] Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-24e408ff-494c-4639-bae1-99ad3d1c0676 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Returning 404 to user: Security group 02d0c889-14e7-4e0a-b5ea-08df472b3e01 does not exist Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-2be3e53e-a978-47f1-ba41-7d8aea532419'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:47.648565 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-24e408ff-494c-4639-bae1-99ad3d1c0676 tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/02d0c889-14e7-4e0a-b5ea-08df472b3e01" status: 404 len: 194 microversion: 2.1 time: 0.288446 Oct 04 20:40:47.662502 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 599/1217] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:47 2022] DELETE /compute/v2.1/os-security-groups/02d0c889-14e7-4e0a-b5ea-08df472b3e01 => generated 194 bytes in 302 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:47.672745 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-22731048-296c-4926-ad2e-e219bd834593 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:47.676703 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-22731048-296c-4926-ad2e-e219bd834593 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:47.708252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-22731048-296c-4926-ad2e-e219bd834593 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.709284 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-22731048-296c-4926-ad2e-e219bd834593 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.710139 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-22731048-296c-4926-ad2e-e219bd834593 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:47.712704 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-22731048-296c-4926-ad2e-e219bd834593 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.717752 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-22731048-296c-4926-ad2e-e219bd834593 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.718853 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-22731048-296c-4926-ad2e-e219bd834593 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:47.904429 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-09eb7f77-de1a-40a9-bdd5-5693166f4980 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "POST /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209/action" status: 202 len: 0 microversion: 2.1 time: 1.148348 Oct 04 20:40:47.918653 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 619/1218] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:40:46 2022] POST /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209/action => generated 0 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:40:47.936409 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-dea0878d-051e-4483-903b-7a233e6f97ff req-08627558-5a01-43be-b34f-889a3c6306ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd64c084-10af-4b12-bdd9-ef53866be364", "name": "network-vif-unplugged", "status": "completed", "tag": "a55c4fe7-8c63-4a39-819e-95561de2446e"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:47.959446 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-dea0878d-051e-4483-903b-7a233e6f97ff req-08627558-5a01-43be-b34f-889a3c6306ef service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.960951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-dea0878d-051e-4483-903b-7a233e6f97ff req-08627558-5a01-43be-b34f-889a3c6306ef service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.962927 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-dea0878d-051e-4483-903b-7a233e6f97ff req-08627558-5a01-43be-b34f-889a3c6306ef service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.022534 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-dea0878d-051e-4483-903b-7a233e6f97ff req-08627558-5a01-43be-b34f-889a3c6306ef service nova] Creating event network-vif-unplugged:a55c4fe7-8c63-4a39-819e-95561de2446e for instance bd64c084-10af-4b12-bdd9-ef53866be364 on n-h1-852085-12 Oct 04 20:40:48.044868 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-dea0878d-051e-4483-903b-7a233e6f97ff req-08627558-5a01-43be-b34f-889a3c6306ef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118304 Oct 04 20:40:48.049651 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 620/1219] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:48.064261 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-489d4256-8f4d-4455-949d-0a9b307ad99e tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77ef290940>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:48.134300 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-22731048-296c-4926-ad2e-e219bd834593 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:48.186481 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-22731048-296c-4926-ad2e-e219bd834593 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1272 microversion: 2.1 time: 0.532088 Oct 04 20:40:48.222811 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 600/1220] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:47 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1272 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:48.251592 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e3b50c57-3918-43cf-9832-6ee5a5586073 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eeebae50>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:48.464708 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e3b50c57-3918-43cf-9832-6ee5a5586073 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 200 len: 1454 microversion: 2.1 time: 0.239542 Oct 04 20:40:48.469307 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 601/1221] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:48 2022] GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 1454 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:48.503117 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f4b0dba4-70c6-4adc-83c0-0ce603a3cf50 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:48.512495 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f4b0dba4-70c6-4adc-83c0-0ce603a3cf50 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:48.534371 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:48.557627 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f4b0dba4-70c6-4adc-83c0-0ce603a3cf50 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.575301 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f4b0dba4-70c6-4adc-83c0-0ce603a3cf50 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.576793 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f4b0dba4-70c6-4adc-83c0-0ce603a3cf50 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.581874 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f4b0dba4-70c6-4adc-83c0-0ce603a3cf50 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.583766 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f4b0dba4-70c6-4adc-83c0-0ce603a3cf50 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.587989 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f4b0dba4-70c6-4adc-83c0-0ce603a3cf50 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.917818 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f4b0dba4-70c6-4adc-83c0-0ce603a3cf50 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:48.944483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f4b0dba4-70c6-4adc-83c0-0ce603a3cf50 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:48.956894 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f4b0dba4-70c6-4adc-83c0-0ce603a3cf50 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:48.970168 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f4b0dba4-70c6-4adc-83c0-0ce603a3cf50 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1537 microversion: 2.91 time: 0.497183 Oct 04 20:40:48.972097 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 602/1222] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:48 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1537 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:49.246796 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-412ce25f-5b1c-46ec-8787-b75c2059fa97 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:49.250843 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-412ce25f-5b1c-46ec-8787-b75c2059fa97 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:49.287121 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-412ce25f-5b1c-46ec-8787-b75c2059fa97 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:49.289308 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-412ce25f-5b1c-46ec-8787-b75c2059fa97 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:49.295856 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-412ce25f-5b1c-46ec-8787-b75c2059fa97 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:49.298397 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-412ce25f-5b1c-46ec-8787-b75c2059fa97 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:49.300642 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-412ce25f-5b1c-46ec-8787-b75c2059fa97 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:49.301574 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-412ce25f-5b1c-46ec-8787-b75c2059fa97 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:49.719588 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-489d4256-8f4d-4455-949d-0a9b307ad99e tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/a8f58956-236a-4aef-b869-be3ff3f82808" status: 202 len: 0 microversion: 2.1 time: 1.670419 Oct 04 20:40:49.726410 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 621/1223] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:48 2022] DELETE /compute/v2.1/os-security-groups/a8f58956-236a-4aef-b869-be3ff3f82808 => generated 0 bytes in 1679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:49.747922 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-acae6ad0-036f-45e3-9968-34e0000491e5 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2d6430>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:49.868972 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-412ce25f-5b1c-46ec-8787-b75c2059fa97 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:49.871414 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-acae6ad0-036f-45e3-9968-34e0000491e5 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 200 len: 1454 microversion: 2.1 time: 0.139395 Oct 04 20:40:49.873444 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 622/1224] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:49 2022] GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 1454 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:49.885475 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-412ce25f-5b1c-46ec-8787-b75c2059fa97 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1314 microversion: 2.1 time: 0.657489 Oct 04 20:40:49.899196 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 603/1225] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:49 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:49.911729 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-be3c30a0-4fc1-4a0d-8be7-ab6c3351a21d tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] Calling method '.version_select at 0x7f77ef28c670>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:50.035567 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7edb132a-8f68-4494-ad81-d806e3a69d85 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:50.037962 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7edb132a-8f68-4494-ad81-d806e3a69d85 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:50.075179 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7edb132a-8f68-4494-ad81-d806e3a69d85 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:50.076817 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7edb132a-8f68-4494-ad81-d806e3a69d85 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:50.077857 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7edb132a-8f68-4494-ad81-d806e3a69d85 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:50.094910 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7edb132a-8f68-4494-ad81-d806e3a69d85 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:50.101887 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7edb132a-8f68-4494-ad81-d806e3a69d85 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:50.103111 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7edb132a-8f68-4494-ad81-d806e3a69d85 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:50.333001 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7edb132a-8f68-4494-ad81-d806e3a69d85 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:50.337263 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=100 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:50.344935 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7edb132a-8f68-4494-ad81-d806e3a69d85 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:50.350031 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7edb132a-8f68-4494-ad81-d806e3a69d85 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:50.357369 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7edb132a-8f68-4494-ad81-d806e3a69d85 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1558 microversion: 2.91 time: 0.334588 Oct 04 20:40:50.360345 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 604/1226] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:50 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1558 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:40:50.840433 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-be3c30a0-4fc1-4a0d-8be7-ab6c3351a21d tempest-SecurityGroupsTestJSON-1787400370 tempest-SecurityGroupsTestJSON-1787400370-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/b9862f64-7fc5-451b-ae13-f80e63e47324" status: 202 len: 0 microversion: 2.1 time: 0.964910 Oct 04 20:40:50.842162 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 623/1227] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:49 2022] DELETE /compute/v2.1/os-security-groups/b9862f64-7fc5-451b-ae13-f80e63e47324 => generated 0 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:50.895735 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cf461747-d5f3-4da3-9281-a55e8cf93ff9 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eeed1ee0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:50.928209 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-52857659-173c-4afc-8169-d6167999a74a tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:50.928966 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-52857659-173c-4afc-8169-d6167999a74a tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:50.949489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-52857659-173c-4afc-8169-d6167999a74a tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:50.951814 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-52857659-173c-4afc-8169-d6167999a74a tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:50.952305 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-52857659-173c-4afc-8169-d6167999a74a tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:50.953097 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-52857659-173c-4afc-8169-d6167999a74a tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:50.953593 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-52857659-173c-4afc-8169-d6167999a74a tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:50.953993 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-52857659-173c-4afc-8169-d6167999a74a tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:51.064000 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cf461747-d5f3-4da3-9281-a55e8cf93ff9 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 200 len: 1454 microversion: 2.1 time: 0.168980 Oct 04 20:40:51.080690 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 605/1228] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:50 2022] GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 1454 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:51.389434 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=11 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:51.413643 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6099a6fe-fa9b-45d8-9829-cbcd270e8daf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:51.416171 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6099a6fe-fa9b-45d8-9829-cbcd270e8daf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:51.441393 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=28 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:51.454747 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6099a6fe-fa9b-45d8-9829-cbcd270e8daf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:51.459583 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6099a6fe-fa9b-45d8-9829-cbcd270e8daf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:51.463385 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6099a6fe-fa9b-45d8-9829-cbcd270e8daf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:51.469830 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6099a6fe-fa9b-45d8-9829-cbcd270e8daf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:51.472814 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6099a6fe-fa9b-45d8-9829-cbcd270e8daf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:51.475752 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6099a6fe-fa9b-45d8-9829-cbcd270e8daf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.238414 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6099a6fe-fa9b-45d8-9829-cbcd270e8daf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:52.264838 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6099a6fe-fa9b-45d8-9829-cbcd270e8daf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:52.272021 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6099a6fe-fa9b-45d8-9829-cbcd270e8daf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:52.295038 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6099a6fe-fa9b-45d8-9829-cbcd270e8daf tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1558 microversion: 2.91 time: 0.906646 Oct 04 20:40:52.302326 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 606/1229] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:51 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1558 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:52.315713 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-55128d37-71a2-448c-85c3-672607ac7823 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eef1ee50>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.498478 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-55128d37-71a2-448c-85c3-672607ac7823 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 200 len: 1454 microversion: 2.1 time: 0.186864 Oct 04 20:40:52.501172 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 607/1230] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:52 2022] GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 1454 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:52.561037 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-52857659-173c-4afc-8169-d6167999a74a tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:52.578928 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-52857659-173c-4afc-8169-d6167999a74a tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1314 microversion: 2.1 time: 1.654257 Oct 04 20:40:52.581288 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 624/1231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:50 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1314 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:53.424244 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8bcadb09-205f-4349-968c-3f2339465b49 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:53.436025 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8bcadb09-205f-4349-968c-3f2339465b49 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:53.475034 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8bcadb09-205f-4349-968c-3f2339465b49 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.476458 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8bcadb09-205f-4349-968c-3f2339465b49 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.478675 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8bcadb09-205f-4349-968c-3f2339465b49 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.483681 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8bcadb09-205f-4349-968c-3f2339465b49 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.486766 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8bcadb09-205f-4349-968c-3f2339465b49 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.489271 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8bcadb09-205f-4349-968c-3f2339465b49 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.544118 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3058d922-663b-4bfa-bedf-b826f39d01d9 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef290670>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:53.756728 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3058d922-663b-4bfa-bedf-b826f39d01d9 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 200 len: 1454 microversion: 2.1 time: 0.234662 Oct 04 20:40:53.760030 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 625/1232] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:53 2022] GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 1454 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:53.789849 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d6d0f056-ea6d-4614-b7fb-555212cbf8e8 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:53.791777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d6d0f056-ea6d-4614-b7fb-555212cbf8e8 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:53.820545 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:53.833525 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d6d0f056-ea6d-4614-b7fb-555212cbf8e8 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.833525 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d6d0f056-ea6d-4614-b7fb-555212cbf8e8 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.833525 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d6d0f056-ea6d-4614-b7fb-555212cbf8e8 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.833525 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d6d0f056-ea6d-4614-b7fb-555212cbf8e8 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.833525 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d6d0f056-ea6d-4614-b7fb-555212cbf8e8 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.833525 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d6d0f056-ea6d-4614-b7fb-555212cbf8e8 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.702293 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8bcadb09-205f-4349-968c-3f2339465b49 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:54.726799 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8bcadb09-205f-4349-968c-3f2339465b49 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:54.728879 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8bcadb09-205f-4349-968c-3f2339465b49 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:54.746023 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8bcadb09-205f-4349-968c-3f2339465b49 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1553 microversion: 2.91 time: 1.381039 Oct 04 20:40:54.747872 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 608/1233] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:53 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1553 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:54.786503 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-06c5a4c0-eeef-4499-8e17-1455785bf1ee tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eeeb5310>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:54.963692 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-06c5a4c0-eeef-4499-8e17-1455785bf1ee tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 200 len: 1454 microversion: 2.1 time: 0.185170 Oct 04 20:40:54.985891 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 609/1234] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:54 2022] GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 1454 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:55.663368 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-d6d0f056-ea6d-4614-b7fb-555212cbf8e8 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:55.692760 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d6d0f056-ea6d-4614-b7fb-555212cbf8e8 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1314 microversion: 2.1 time: 1.918347 Oct 04 20:40:55.727067 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 626/1235] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:53 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1314 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:55.815872 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9d52a42f-97ac-4312-a6f8-a9e75777e4c9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:55.817295 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9d52a42f-97ac-4312-a6f8-a9e75777e4c9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:55.841636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d52a42f-97ac-4312-a6f8-a9e75777e4c9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:55.842173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d52a42f-97ac-4312-a6f8-a9e75777e4c9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:55.849423 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d52a42f-97ac-4312-a6f8-a9e75777e4c9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.853627 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d52a42f-97ac-4312-a6f8-a9e75777e4c9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:55.855105 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d52a42f-97ac-4312-a6f8-a9e75777e4c9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:55.868335 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d52a42f-97ac-4312-a6f8-a9e75777e4c9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.014810 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1cacbd4d-ee3c-49d2-a9e6-78eeb22a4882 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2d6a60>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:56.240524 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9d52a42f-97ac-4312-a6f8-a9e75777e4c9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:56.247846 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1cacbd4d-ee3c-49d2-a9e6-78eeb22a4882 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 200 len: 1454 microversion: 2.1 time: 0.243222 Oct 04 20:40:56.265074 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 627/1236] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:55 2022] GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 1454 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:56.273490 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9d52a42f-97ac-4312-a6f8-a9e75777e4c9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:56.293319 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9d52a42f-97ac-4312-a6f8-a9e75777e4c9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:56.317879 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9d52a42f-97ac-4312-a6f8-a9e75777e4c9 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1553 microversion: 2.91 time: 0.508003 Oct 04 20:40:56.322580 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 610/1237] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:55 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1553 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:56.741788 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3fb54034-86f8-4c37-b302-ab7eecc70a77 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:56.749518 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3fb54034-86f8-4c37-b302-ab7eecc70a77 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:56.774591 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3fb54034-86f8-4c37-b302-ab7eecc70a77 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.779930 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3fb54034-86f8-4c37-b302-ab7eecc70a77 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.781119 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3fb54034-86f8-4c37-b302-ab7eecc70a77 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.783823 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3fb54034-86f8-4c37-b302-ab7eecc70a77 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.784723 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3fb54034-86f8-4c37-b302-ab7eecc70a77 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.785373 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3fb54034-86f8-4c37-b302-ab7eecc70a77 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:57.284064 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7559b77f-b69c-4952-b48c-21af00712ea7 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eef635e0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:57.624869 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3fb54034-86f8-4c37-b302-ab7eecc70a77 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:57.677425 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3fb54034-86f8-4c37-b302-ab7eecc70a77 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1314 microversion: 2.1 time: 0.940609 Oct 04 20:40:57.680425 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 628/1238] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:56 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:57.722389 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a553f24f-c127-4a31-bb10-67fb0bc8e1db tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:57.725156 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a553f24f-c127-4a31-bb10-67fb0bc8e1db tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:57.786302 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a553f24f-c127-4a31-bb10-67fb0bc8e1db tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:57.788581 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a553f24f-c127-4a31-bb10-67fb0bc8e1db tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:57.789603 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a553f24f-c127-4a31-bb10-67fb0bc8e1db tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:57.794269 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a553f24f-c127-4a31-bb10-67fb0bc8e1db tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:57.801572 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a553f24f-c127-4a31-bb10-67fb0bc8e1db tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:57.803195 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a553f24f-c127-4a31-bb10-67fb0bc8e1db tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:57.913426 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7559b77f-b69c-4952-b48c-21af00712ea7 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 200 len: 1454 microversion: 2.1 time: 0.624182 Oct 04 20:40:57.923827 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 611/1239] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:57 2022] GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 1454 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:58.480904 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a553f24f-c127-4a31-bb10-67fb0bc8e1db tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:58.504546 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a553f24f-c127-4a31-bb10-67fb0bc8e1db tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:58.509873 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a553f24f-c127-4a31-bb10-67fb0bc8e1db tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:58.528215 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a553f24f-c127-4a31-bb10-67fb0bc8e1db tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1553 microversion: 2.91 time: 0.844496 Oct 04 20:40:58.530927 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 629/1240] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:57 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1553 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:58.664651 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-88637d6f-738d-463c-90b6-0badbf9e8905 req-0e03c13a-388f-49dd-93e4-3dc01adcac01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1caeb3c7-b999-4f0c-bee2-f072b9c00336", "tag": "e70b26ac-8828-4e78-8df7-85f383b35ac8"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:58.725953 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-88637d6f-738d-463c-90b6-0badbf9e8905 req-0e03c13a-388f-49dd-93e4-3dc01adcac01 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:58.728682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-88637d6f-738d-463c-90b6-0badbf9e8905 req-0e03c13a-388f-49dd-93e4-3dc01adcac01 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:58.728875 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-88637d6f-738d-463c-90b6-0badbf9e8905 req-0e03c13a-388f-49dd-93e4-3dc01adcac01 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:58.744923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2bd678ba-f793-4875-8c17-34f6f020146b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:58.746436 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2bd678ba-f793-4875-8c17-34f6f020146b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:58.786913 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2bd678ba-f793-4875-8c17-34f6f020146b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:58.791973 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2bd678ba-f793-4875-8c17-34f6f020146b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:58.792284 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-88637d6f-738d-463c-90b6-0badbf9e8905 req-0e03c13a-388f-49dd-93e4-3dc01adcac01 service nova] Creating event network-changed:e70b26ac-8828-4e78-8df7-85f383b35ac8 for instance 1caeb3c7-b999-4f0c-bee2-f072b9c00336 on n-h2-852085-12 Oct 04 20:40:58.795620 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2bd678ba-f793-4875-8c17-34f6f020146b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:58.799101 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2bd678ba-f793-4875-8c17-34f6f020146b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:58.807182 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2bd678ba-f793-4875-8c17-34f6f020146b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:58.810626 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-88637d6f-738d-463c-90b6-0badbf9e8905 req-0e03c13a-388f-49dd-93e4-3dc01adcac01 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164538 Oct 04 20:40:58.811683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2bd678ba-f793-4875-8c17-34f6f020146b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:58.816646 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 612/1241] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:40:58.937626 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-36a1484c-0cd3-4997-9792-f7a4fb3fdda3 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eeeb5430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:59.980914 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-2bd678ba-f793-4875-8c17-34f6f020146b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:00.035336 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2bd678ba-f793-4875-8c17-34f6f020146b tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1314 microversion: 2.1 time: 1.308059 Oct 04 20:41:00.055391 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 630/1242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:58 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1314 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:00.082869 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7af8f7f1-f150-45f2-99df-ecf11f071d67 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:00.085926 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7af8f7f1-f150-45f2-99df-ecf11f071d67 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:00.141261 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7af8f7f1-f150-45f2-99df-ecf11f071d67 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:00.143591 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7af8f7f1-f150-45f2-99df-ecf11f071d67 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:00.144768 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7af8f7f1-f150-45f2-99df-ecf11f071d67 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:00.147973 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7af8f7f1-f150-45f2-99df-ecf11f071d67 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:00.154251 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7af8f7f1-f150-45f2-99df-ecf11f071d67 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:00.159654 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7af8f7f1-f150-45f2-99df-ecf11f071d67 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:00.648269 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7af8f7f1-f150-45f2-99df-ecf11f071d67 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:00.711302 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7af8f7f1-f150-45f2-99df-ecf11f071d67 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:00.713693 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7af8f7f1-f150-45f2-99df-ecf11f071d67 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:00.761014 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7af8f7f1-f150-45f2-99df-ecf11f071d67 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1553 microversion: 2.91 time: 0.699074 Oct 04 20:41:00.792482 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 631/1243] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:00 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1553 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:01.084275 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0e3ad85c-f781-404e-9a77-2cc76a2a73a0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:01.089665 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0e3ad85c-f781-404e-9a77-2cc76a2a73a0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:01.137528 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e3ad85c-f781-404e-9a77-2cc76a2a73a0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:01.141514 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e3ad85c-f781-404e-9a77-2cc76a2a73a0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:01.142284 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e3ad85c-f781-404e-9a77-2cc76a2a73a0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:01.152417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e3ad85c-f781-404e-9a77-2cc76a2a73a0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:01.153260 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e3ad85c-f781-404e-9a77-2cc76a2a73a0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:01.154183 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0e3ad85c-f781-404e-9a77-2cc76a2a73a0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:02.661520 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0e3ad85c-f781-404e-9a77-2cc76a2a73a0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:02.734095 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0e3ad85c-f781-404e-9a77-2cc76a2a73a0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1314 microversion: 2.1 time: 1.656914 Oct 04 20:41:02.747890 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 632/1244] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:01 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1314 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:41:02.780277 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-13510500-151b-43c5-99a5-bcf2e766bde5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:02.786945 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-13510500-151b-43c5-99a5-bcf2e766bde5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:02.817695 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-13510500-151b-43c5-99a5-bcf2e766bde5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:02.828719 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-13510500-151b-43c5-99a5-bcf2e766bde5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:02.832202 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-13510500-151b-43c5-99a5-bcf2e766bde5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:02.836040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-13510500-151b-43c5-99a5-bcf2e766bde5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:02.839344 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-13510500-151b-43c5-99a5-bcf2e766bde5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:02.846402 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-13510500-151b-43c5-99a5-bcf2e766bde5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:03.812135 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-13510500-151b-43c5-99a5-bcf2e766bde5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:03.838552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-13510500-151b-43c5-99a5-bcf2e766bde5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:03.862276 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-13510500-151b-43c5-99a5-bcf2e766bde5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:03.899383 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-13510500-151b-43c5-99a5-bcf2e766bde5 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1553 microversion: 2.91 time: 1.143543 Oct 04 20:41:03.910633 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 633/1245] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:02 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1553 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:04.467717 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5fd03a1a-cfad-45ab-95e9-3419b5ef6e9a tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-999166489", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:08.724014 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=22 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:08.744291 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=20 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:13.820075 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:14.543975 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=41 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:33.455745 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-5fd03a1a-cfad-45ab-95e9-3419b5ef6e9a tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] validate_networks() for [('0caecb22-40fe-43f0-8d1f-cae8a80416fd', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:33.459044 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-36a1484c-0cd3-4997-9792-f7a4fb3fdda3 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 200 len: 1454 microversion: 2.1 time: 34.527119 Oct 04 20:41:33.462874 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 613/1246] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:58 2022] GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 1454 bytes in 34534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:33.482730 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bec29895-13b8-451e-8445-842fb9fe7aca tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:33.508391 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-bec29895-13b8-451e-8445-842fb9fe7aca tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:33.526087 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bec29895-13b8-451e-8445-842fb9fe7aca tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:33.527727 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bec29895-13b8-451e-8445-842fb9fe7aca tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:33.528831 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bec29895-13b8-451e-8445-842fb9fe7aca tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:33.534176 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bec29895-13b8-451e-8445-842fb9fe7aca tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:33.534176 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bec29895-13b8-451e-8445-842fb9fe7aca tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:33.534176 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bec29895-13b8-451e-8445-842fb9fe7aca tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:34.871070 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bec29895-13b8-451e-8445-842fb9fe7aca tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:34.922763 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bec29895-13b8-451e-8445-842fb9fe7aca tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1314 microversion: 2.1 time: 1.456969 Oct 04 20:41:34.932332 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 614/1247] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:33 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1314 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:34.996151 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-7216045a-76de-40dc-896c-747ee3a46733 req-1c249c09-1f11-441e-92a4-7bbe4ce8a40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d42994f-e35e-413c-a0a3-14bb3878e209", "name": "network-vif-plugged", "status": "completed", "tag": "2a1a7e79-2aa6-49de-b62c-90d4d8aa18d1"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-5fd03a1a-cfad-45ab-95e9-3419b5ef6e9a tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8d82fe51-d1fb-4212-bade-d8441335a274) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:35.082996 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8d82fe51-d1fb-4212-bade-d8441335a274) Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-5fd03a1a-cfad-45ab-95e9-3419b5ef6e9a tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:35.096462 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:35.099615 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-7216045a-76de-40dc-896c-747ee3a46733 req-1c249c09-1f11-441e-92a4-7bbe4ce8a40e service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:35.104358 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-7216045a-76de-40dc-896c-747ee3a46733 req-1c249c09-1f11-441e-92a4-7bbe4ce8a40e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:35.106515 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-7216045a-76de-40dc-896c-747ee3a46733 req-1c249c09-1f11-441e-92a4-7bbe4ce8a40e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5fd03a1a-cfad-45ab-95e9-3419b5ef6e9a tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Request method failure captured: Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 206 Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJpeu0zoMvJAVRMePw38HrVNaz-I7rVaAHwwNBq1sVefQY-L4g8HJG02SsF32LOH9zFGULwXW-9hnTe3sUrVRVEwXxHbSp0VCUDdP-SR2Yq2jb-0iTK3y0_KT_UQFR0jEd-Qkg0zE9WL41iimjkIGkjBI1Me5AoQqYFNCvaX1IJTme0 Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b0dba749bcef41eabaa078e2e36d0f97", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b0dba749bcef41eabaa078e2e36d0f97"}]}] Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 11b6296bc2fb4ca6b2f02bf06c3f6602 Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-DeleteServersTestJSON-server-999166489", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-999166489', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '0caecb22-40fe-43f0-8d1f-cae8a80416fd'}]}}} Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:35.110457 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8d82fe51-d1fb-4212-bade-d8441335a274) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:35.132300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5fd03a1a-cfad-45ab-95e9-3419b5ef6e9a tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5fd03a1a-cfad-45ab-95e9-3419b5ef6e9a tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 31.205064 Oct 04 20:41:35.150550 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 634/1248] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:03 2022] POST /compute/v2.1/servers => generated 214 bytes in 31218 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:35.223314 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-7216045a-76de-40dc-896c-747ee3a46733 req-1c249c09-1f11-441e-92a4-7bbe4ce8a40e service nova] Creating event network-vif-plugged:2a1a7e79-2aa6-49de-b62c-90d4d8aa18d1 for instance 9d42994f-e35e-413c-a0a3-14bb3878e209 on n-h2-852085-12 Oct 04 20:41:35.263712 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-7216045a-76de-40dc-896c-747ee3a46733 req-1c249c09-1f11-441e-92a4-7bbe4ce8a40e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.321806 Oct 04 20:41:35.266368 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 615/1249] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:35.319339 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-25c66313-ae05-4903-9753-15f3a45d0025 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:35.342900 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-25c66313-ae05-4903-9753-15f3a45d0025 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:35.392187 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25c66313-ae05-4903-9753-15f3a45d0025 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:35.395480 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25c66313-ae05-4903-9753-15f3a45d0025 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:35.399930 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25c66313-ae05-4903-9753-15f3a45d0025 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:35.400723 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25c66313-ae05-4903-9753-15f3a45d0025 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:35.402385 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25c66313-ae05-4903-9753-15f3a45d0025 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:35.405601 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-25c66313-ae05-4903-9753-15f3a45d0025 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:35.655755 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1112525801", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:35.985848 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:36.068864 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-25c66313-ae05-4903-9753-15f3a45d0025 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:36.102014 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-25c66313-ae05-4903-9753-15f3a45d0025 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:36.124282 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-25c66313-ae05-4903-9753-15f3a45d0025 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:36.144219 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-25c66313-ae05-4903-9753-15f3a45d0025 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1535 microversion: 2.91 time: 0.863044 Oct 04 20:41:36.172064 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 616/1250] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:35 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1535 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:36.752630 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5145486c-704c-4484-a91e-2ccb85f0170f tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-811485394", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:36.925305 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:41:36.927980 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:41:36.929405 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:41:36.930552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:41:36.934618 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:41:36.995195 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.004617 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.006213 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:37.008498 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.012001 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.018279 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:37.064407 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-5145486c-704c-4484-a91e-2ccb85f0170f tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] validate_networks() for [('bd3e9948-df1a-401b-b922-c0d656845500', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:37.125415 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Getting quotas for project e9fae788056d4b8e9d45e8988fc6920f. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:41:37.163607 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Getting quotas for user edcdbeebe55e41cb9072a7561e0988f8 and project e9fae788056d4b8e9d45e8988fc6920f. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:41:37.229077 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Going to run 1 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:41:37.242166 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:41:37.627703 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4d228bb3-1ee7-4798-b1d7-c5ca9d49d2b8 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.485540 Oct 04 20:41:37.660287 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 635/1251] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:41:37.718461 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ccf729cc-38f7-4df9-b5d3-0a95fa89ad8d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef272dc0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-5145486c-704c-4484-a91e-2ccb85f0170f tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-303a2c09-7103-49d6-a17c-53cf1c91cffe) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:38.331479 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-303a2c09-7103-49d6-a17c-53cf1c91cffe) Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-5145486c-704c-4484-a91e-2ccb85f0170f tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:38.339868 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5145486c-704c-4484-a91e-2ccb85f0170f tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Request method failure captured: Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 184 Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJpliQrZvocPZVIkUnmvJ-y5Q6dGllu5MKyDSYahHA0VPDVxohsUPEFk9jtqQKs6cXGrIVmNI3X8G4iqRNTL8l-4NANPIuqDD4U1lTf87IR8hG0A4n9_ZC2JH_7SQLcQ7f8ik7Buj4fJ9HZEy9t-A4L48vTfBLQVyKmwDvIn_nLtXiE Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74d829c1899f478e9a95a0402c0dc87e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74d829c1899f478e9a95a0402c0dc87e"}]}] Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersTestJSON-1826046113 Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersTestJSON-1826046113-project Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b0933e4def614f928c0415b7de888e24 Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersTestJSON-1826046113-project Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-\u20a1-811485394", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-₡-811485394', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'bd3e9948-df1a-401b-b922-c0d656845500'}]}}} Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:38.352257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-303a2c09-7103-49d6-a17c-53cf1c91cffe) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:38.364044 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5145486c-704c-4484-a91e-2ccb85f0170f tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:38.377059 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5145486c-704c-4484-a91e-2ccb85f0170f tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.180098 Oct 04 20:41:38.402373 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 617/1252] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 2223 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:38.451046 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cd905481-052c-4f59-aa00-a6d15d27f457 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-106689609", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:39.321564 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ccf729cc-38f7-4df9-b5d3-0a95fa89ad8d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 200 len: 1454 microversion: 2.1 time: 1.658023 Oct 04 20:41:39.327813 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 636/1253] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:41:37 2022] GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 1454 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:39.357219 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-27652cf9-d683-4ecf-8cfd-fb616a7f23e0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:39.366139 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-27652cf9-d683-4ecf-8cfd-fb616a7f23e0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:39.413875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-27652cf9-d683-4ecf-8cfd-fb616a7f23e0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:39.417121 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-27652cf9-d683-4ecf-8cfd-fb616a7f23e0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:39.422727 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-27652cf9-d683-4ecf-8cfd-fb616a7f23e0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:39.426622 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-27652cf9-d683-4ecf-8cfd-fb616a7f23e0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:39.430763 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-27652cf9-d683-4ecf-8cfd-fb616a7f23e0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:39.432943 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-27652cf9-d683-4ecf-8cfd-fb616a7f23e0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:39.531400 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-cd905481-052c-4f59-aa00-a6d15d27f457 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] validate_networks() for [('0caecb22-40fe-43f0-8d1f-cae8a80416fd', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:40.101352 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-27652cf9-d683-4ecf-8cfd-fb616a7f23e0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:40.134827 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-27652cf9-d683-4ecf-8cfd-fb616a7f23e0 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1314 microversion: 2.1 time: 0.799068 Oct 04 20:41:40.139190 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 637/1254] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:39 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:40.164924 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8f9f9405-5a8e-4d01-a284-324c0314abeb tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:40.171248 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8f9f9405-5a8e-4d01-a284-324c0314abeb tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:40.214125 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8f9f9405-5a8e-4d01-a284-324c0314abeb tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:40.217920 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8f9f9405-5a8e-4d01-a284-324c0314abeb tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:40.220116 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8f9f9405-5a8e-4d01-a284-324c0314abeb tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:40.222756 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8f9f9405-5a8e-4d01-a284-324c0314abeb tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:40.226095 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8f9f9405-5a8e-4d01-a284-324c0314abeb tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:40.228229 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8f9f9405-5a8e-4d01-a284-324c0314abeb tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-cd905481-052c-4f59-aa00-a6d15d27f457 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-638d7238-e4bd-42e3-88a6-77c1d5ed523e) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:40.287841 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-638d7238-e4bd-42e3-88a6-77c1d5ed523e) Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-cd905481-052c-4f59-aa00-a6d15d27f457 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cd905481-052c-4f59-aa00-a6d15d27f457 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Request method failure captured: Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 206 Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJpeu0zoMvJAVRMePw38HrVNaz-I7rVaAHwwNBq1sVefQY-L4g8HJG02SsF32LOH9zFGULwXW-9hnTe3sUrVRVEwXxHbSp0VCUDdP-SR2Yq2jb-0iTK3y0_KT_UQFR0jEd-Qkg0zE9WL41iimjkIGkjBI1Me5AoQqYFNCvaX1IJTme0 Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b0dba749bcef41eabaa078e2e36d0f97", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b0dba749bcef41eabaa078e2e36d0f97"}]}] Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 11b6296bc2fb4ca6b2f02bf06c3f6602 Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-DeleteServersTestJSON-server-106689609", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-106689609', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '0caecb22-40fe-43f0-8d1f-cae8a80416fd'}]}}} Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:40.298813 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:40.319498 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-638d7238-e4bd-42e3-88a6-77c1d5ed523e) Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cd905481-052c-4f59-aa00-a6d15d27f457 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cd905481-052c-4f59-aa00-a6d15d27f457 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.893498 Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 618/1255] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:38 2022] POST /compute/v2.1/servers => generated 214 bytes in 1902 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:40.336017 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-399497259", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:40.436900 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8f9f9405-5a8e-4d01-a284-324c0314abeb tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:40.457012 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8f9f9405-5a8e-4d01-a284-324c0314abeb tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:40.461332 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8f9f9405-5a8e-4d01-a284-324c0314abeb tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990d76e7b941ee9dcedb1cb7974d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a53e4fead4141a343b3e54bb09eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:40.475040 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8f9f9405-5a8e-4d01-a284-324c0314abeb tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 200 len: 1478 microversion: 2.91 time: 0.329454 Oct 04 20:41:40.480620 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 638/1256] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:40 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 1478 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:40.487568 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-5e5c9fb4-7038-42fc-8ff7-529b1f37779f req-e3c1986d-557f-4d63-982c-8d01c4b7eb22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1caeb3c7-b999-4f0c-bee2-f072b9c00336", "name": "network-vif-plugged", "status": "completed", "tag": "e70b26ac-8828-4e78-8df7-85f383b35ac8"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:40.509217 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-5e5c9fb4-7038-42fc-8ff7-529b1f37779f req-e3c1986d-557f-4d63-982c-8d01c4b7eb22 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:40.510777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-5e5c9fb4-7038-42fc-8ff7-529b1f37779f req-e3c1986d-557f-4d63-982c-8d01c4b7eb22 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:40.512234 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-5e5c9fb4-7038-42fc-8ff7-529b1f37779f req-e3c1986d-557f-4d63-982c-8d01c4b7eb22 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:40.573183 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-5e5c9fb4-7038-42fc-8ff7-529b1f37779f req-e3c1986d-557f-4d63-982c-8d01c4b7eb22 service nova] Creating event network-vif-plugged:e70b26ac-8828-4e78-8df7-85f383b35ac8 for instance 1caeb3c7-b999-4f0c-bee2-f072b9c00336 on n-h2-852085-12 Oct 04 20:41:40.597624 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:40.607308 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-5e5c9fb4-7038-42fc-8ff7-529b1f37779f req-e3c1986d-557f-4d63-982c-8d01c4b7eb22 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123495 Oct 04 20:41:40.617201 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 639/1257] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:40.627129 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6b8f1130-cb71-409a-8d02-af34042a36c1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-102933289", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:40.801552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-6b8f1130-cb71-409a-8d02-af34042a36c1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] validate_networks() for [('bd3e9948-df1a-401b-b922-c0d656845500', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:41.386195 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:41:41.387425 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:41:41.388750 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:41:41.389838 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:41:41.392190 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:41:41.446749 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:41.446749 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:41.446749 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:41.446749 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:41.446749 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:41.446749 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:41.549955 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Getting quotas for project e9fae788056d4b8e9d45e8988fc6920f. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:41:41.572623 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Getting quotas for user edcdbeebe55e41cb9072a7561e0988f8 and project e9fae788056d4b8e9d45e8988fc6920f. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:41:41.630121 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:41:41.642340 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-6b8f1130-cb71-409a-8d02-af34042a36c1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b79a616d-4988-4b03-8163-ac08d3c39576) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:41.655038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b79a616d-4988-4b03-8163-ac08d3c39576) Oct 04 20:41:41.661009 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:41.664737 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-6b8f1130-cb71-409a-8d02-af34042a36c1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:41.664737 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6b8f1130-cb71-409a-8d02-af34042a36c1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Request method failure captured: Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 229 Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJpliQrZvocPZVIkUnmvJ-y5Q6dGllu5MKyDSYahHA0VPDVxohsUPEFk9jtqQKs6cXGrIVmNI3X8G4iqRNTL8l-4NANPIuqDD4U1lTf87IR8hG0A4n9_ZC2JH_7SQLcQ7f8ik7Buj4fJ9HZEy9t-A4L48vTfBLQVyKmwDvIn_nLtXiE Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74d829c1899f478e9a95a0402c0dc87e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74d829c1899f478e9a95a0402c0dc87e"}]}] Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersTestJSON-1826046113 Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersTestJSON-1826046113-project Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: b0933e4def614f928c0415b7de888e24 Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersTestJSON-1826046113-project Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServersTestJSON-server-102933289", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "testpassword", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-102933289', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'testpassword', 'networks': [{'uuid': 'bd3e9948-df1a-401b-b922-c0d656845500'}]}}} Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:41.668542 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b79a616d-4988-4b03-8163-ac08d3c39576) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:41.673222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:41.678921 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:41.694757 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6b8f1130-cb71-409a-8d02-af34042a36c1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:41.694757 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:41.694757 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6b8f1130-cb71-409a-8d02-af34042a36c1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.076188 Oct 04 20:41:41.694757 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 640/1258] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:40 2022] POST /compute/v2.1/servers => generated 214 bytes in 1079 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:41.700278 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6868c939-81ee-4e5e-9513-63e813e7eec3 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2fe9d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:41.838387 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6868c939-81ee-4e5e-9513-63e813e7eec3 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 200 len: 1463 microversion: 2.1 time: 0.143554 Oct 04 20:41:41.838387 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 641/1259] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:41:41 2022] GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 1463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:41.847732 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-852085-12"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:41.853621 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:41.869782 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:41.873136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:41.874924 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:41.876611 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:41.877513 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:41.878735 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b0771230-adaf-4d96-bec0-573b289d23ef) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:42.062262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b0771230-adaf-4d96-bec0-573b289d23ef) Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Request method failure captured: Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8/action HTTP/1.1 Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 40 Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJoiwcP5a5rUbCPPnPQXIu9XqwmPWjUrxA2fN5v14jzch-eWGibPLMpvhQJLV0BIgqCKv4ueAIJE1RSbSF3r44XZ6tzGYNMc4VJr3ShEq3-WKtTW63K_YS1CRgd_heCxqoFC2wy3tnO51mqDp97sKGYNVjCxpUakeao4jD5ATy5fPiM Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 0105ef8ad80b42049b4f3cf0f9428a8d Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-264577944 Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0105ef8ad80b42049b4f3cf0f9428a8d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0105ef8ad80b42049b4f3cf0f9428a8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0105ef8ad80b42049b4f3cf0f9428a8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0105ef8ad80b42049b4f3cf0f9428a8d"}]}] Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-264577944 Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 0105ef8ad80b42049b4f3cf0f9428a8d Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-264577944 Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-UnshelveToHostMultiNodesTest-264577944-project-admin Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: c1045a518d614edc8b50d1d9db769d45 Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-264577944-project-admin Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: {"unshelve": {"host": "n-h1-852085-12"}} Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '6d44adbe-9208-452a-a8f7-8802ac29dfb8', 'body': {'unshelve': {'host': 'n-h1-852085-12'}}} Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:42.074238 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:42.086938 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b0771230-adaf-4d96-bec0-573b289d23ef) Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:42.097534 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:42.103484 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-917c32b5-6f25-4d1c-9d70-b39dd0c42b67 tempest-UnshelveToHostMultiNodesTest-264577944 tempest-UnshelveToHostMultiNodesTest-264577944-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8/action" status: 500 len: 214 microversion: 2.91 time: 0.262094 Oct 04 20:41:42.107340 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d4f771f8-b43d-42be-b280-ec6b7e6da2bf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.803081 Oct 04 20:41:42.112416 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 642/1260] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 4 20:41:41 2022] POST /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8/action => generated 214 bytes in 271 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 04 20:41:42.123303 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 619/1261] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:41:42.131560 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-596dd839-0e5e-4de4-810f-1d08e170f3f2 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-399485045", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:42.144240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-05bbd802-1f9e-4eb9-9129-09a38c1e6ee7 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:42.145443 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-05bbd802-1f9e-4eb9-9129-09a38c1e6ee7 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:42.175400 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-05bbd802-1f9e-4eb9-9129-09a38c1e6ee7 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:42.176368 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-05bbd802-1f9e-4eb9-9129-09a38c1e6ee7 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:42.177211 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-05bbd802-1f9e-4eb9-9129-09a38c1e6ee7 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:42.183278 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-05bbd802-1f9e-4eb9-9129-09a38c1e6ee7 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:42.184169 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-05bbd802-1f9e-4eb9-9129-09a38c1e6ee7 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:42.184959 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-05bbd802-1f9e-4eb9-9129-09a38c1e6ee7 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:42.361893 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-596dd839-0e5e-4de4-810f-1d08e170f3f2 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] validate_networks() for [('0caecb22-40fe-43f0-8d1f-cae8a80416fd', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:42.825852 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-05bbd802-1f9e-4eb9-9129-09a38c1e6ee7 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:42.923951 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-05bbd802-1f9e-4eb9-9129-09a38c1e6ee7 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1314 microversion: 2.1 time: 0.741344 Oct 04 20:41:42.923951 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 620/1262] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:42 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1314 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:42.923951 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b9453bf8-f04a-4510-a83e-a6b1802a9016 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee76dc0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-596dd839-0e5e-4de4-810f-1d08e170f3f2 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a4ac18a9-a3cf-4418-a530-a11a12ac58c1) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:43.022654 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a4ac18a9-a3cf-4418-a530-a11a12ac58c1) Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-596dd839-0e5e-4de4-810f-1d08e170f3f2 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-596dd839-0e5e-4de4-810f-1d08e170f3f2 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Request method failure captured: Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 206 Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJpeu0zoMvJAVRMePw38HrVNaz-I7rVaAHwwNBq1sVefQY-L4g8HJG02SsF32LOH9zFGULwXW-9hnTe3sUrVRVEwXxHbSp0VCUDdP-SR2Yq2jb-0iTK3y0_KT_UQFR0jEd-Qkg0zE9WL41iimjkIGkjBI1Me5AoQqYFNCvaX1IJTme0 Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b0dba749bcef41eabaa078e2e36d0f97", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b0dba749bcef41eabaa078e2e36d0f97"}]}] Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 11b6296bc2fb4ca6b2f02bf06c3f6602 Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-DeleteServersTestJSON-server-399485045", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-399485045', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '0caecb22-40fe-43f0-8d1f-cae8a80416fd'}]}}} Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:43.033505 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:43.040813 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a4ac18a9-a3cf-4418-a530-a11a12ac58c1) Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-596dd839-0e5e-4de4-810f-1d08e170f3f2 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:43.049284 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-596dd839-0e5e-4de4-810f-1d08e170f3f2 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.923354 Oct 04 20:41:43.067189 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 643/1263] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:42 2022] POST /compute/v2.1/servers => generated 214 bytes in 951 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:43.082408 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b9453bf8-f04a-4510-a83e-a6b1802a9016 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 200 len: 1463 microversion: 2.1 time: 0.205414 Oct 04 20:41:43.086136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e3507bf7-209d-49ac-ab43-302f379b64fe tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1887397646", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:43.111255 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 621/1264] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:41:42 2022] GET /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 1463 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:43.136427 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-847c1024-c53b-446f-956d-a4544c72dc87 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:43.166270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-847c1024-c53b-446f-956d-a4544c72dc87 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:43.325880 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-e3507bf7-209d-49ac-ab43-302f379b64fe tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] validate_networks() for [('bd3e9948-df1a-401b-b922-c0d656845500', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:43.445401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-847c1024-c53b-446f-956d-a4544c72dc87 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:43.478859 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-847c1024-c53b-446f-956d-a4544c72dc87 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1213 microversion: 2.1 time: 0.355371 Oct 04 20:41:43.480741 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 622/1265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:43 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1213 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:43.520298 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:43.522332 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:43.554173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:43.556801 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:43.563581 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:43.614247 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:43.624375 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:43.626498 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:43.748168 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:41:43.786270 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.compute.api [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Working on deleting snapshot 3991ec33-e728-4b46-a980-d0bc139e7462 from shelved instance... Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-e3507bf7-209d-49ac-ab43-302f379b64fe tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-27f000dd-3a21-4542-8af9-4fca4c4a7501) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:44.148285 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-27f000dd-3a21-4542-8af9-4fca4c4a7501) Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-e3507bf7-209d-49ac-ab43-302f379b64fe tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:44.157030 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e3507bf7-209d-49ac-ab43-302f379b64fe tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Request method failure captured: Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 231 Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJpliQrZvocPZVIkUnmvJ-y5Q6dGllu5MKyDSYahHA0VPDVxohsUPEFk9jtqQKs6cXGrIVmNI3X8G4iqRNTL8l-4NANPIuqDD4U1lTf87IR8hG0A4n9_ZC2JH_7SQLcQ7f8ik7Buj4fJ9HZEy9t-A4L48vTfBLQVyKmwDvIn_nLtXiE Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74d829c1899f478e9a95a0402c0dc87e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74d829c1899f478e9a95a0402c0dc87e"}]}] Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersTestJSON-1826046113 Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersTestJSON-1826046113-project Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: b0933e4def614f928c0415b7de888e24 Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersTestJSON-1826046113-project Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServersTestJSON-server-1887397646", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1887397646', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'bd3e9948-df1a-401b-b922-c0d656845500'}]}}} Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:44.178415 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-27f000dd-3a21-4542-8af9-4fca4c4a7501) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:44.187991 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e3507bf7-209d-49ac-ab43-302f379b64fe tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e3507bf7-209d-49ac-ab43-302f379b64fe tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.110388 Oct 04 20:41:44.199539 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 644/1266] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:43 2022] POST /compute/v2.1/servers => generated 214 bytes in 1134 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:44.330003 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6db6a356-d780-413e-82c6-7d0d1ed9bd83 tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] Action: 'create', calling method: .version_select at 0x7f77ef2fe310>, body: {"keypair": {"name": "tempest-keypair-838947080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYfh5H5cYETeodvWsyUxETsZzHLYxZtt1ljgERtCQNwaRJYatNw3GUMdXS9+YqxA6VxXyd27eaQc69XGZZdAXRo79xbcSP0zmgTPpMCoAUIXSNVmk0ZmehbUTPF6NY/DA=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:44.368842 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-6db6a356-d780-413e-82c6-7d0d1ed9bd83 tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] Getting quotas for project f8f49cc17cdd45cc8278f8d5cf1e7490. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:41:44.381470 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-6db6a356-d780-413e-82c6-7d0d1ed9bd83 tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] Getting quotas for user 935f44986e194a1882d095a9b136c6bc and project f8f49cc17cdd45cc8278f8d5cf1e7490. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:41:44.611401 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6db6a356-d780-413e-82c6-7d0d1ed9bd83 tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.413290 Oct 04 20:41:44.613369 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 645/1267] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:41:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:44.629510 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e2997f61-3b2b-4338-a36f-bd4d6f6da13b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:44.633620 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e2997f61-3b2b-4338-a36f-bd4d6f6da13b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:44.653995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2997f61-3b2b-4338-a36f-bd4d6f6da13b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:44.653995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2997f61-3b2b-4338-a36f-bd4d6f6da13b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:44.653995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2997f61-3b2b-4338-a36f-bd4d6f6da13b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:44.660874 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2997f61-3b2b-4338-a36f-bd4d6f6da13b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:44.660874 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2997f61-3b2b-4338-a36f-bd4d6f6da13b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:44.661316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e2997f61-3b2b-4338-a36f-bd4d6f6da13b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:45.060031 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e2997f61-3b2b-4338-a36f-bd4d6f6da13b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:45.079168 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e2997f61-3b2b-4338-a36f-bd4d6f6da13b tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1468 microversion: 2.1 time: 0.462188 Oct 04 20:41:45.080892 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 646/1268] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:44 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1468 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:45.098901 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3706eca2-2b2e-4f87-9049-b51089d53f0d tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-625972377", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:46.872088 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-3706eca2-2b2e-4f87-9049-b51089d53f0d tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] validate_networks() for [('0caecb22-40fe-43f0-8d1f-cae8a80416fd', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:47.002076 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Doing local delete in cell 8c6f5a8f-3e7f-4559-98c8-58d2585358de(cell1) {{(pid=123539) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 20:41:47.004429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:47.005922 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:47.006993 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:47.008181 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.compute.api [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 20:41:47.020556 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] deallocate_for_instance() {{(pid=123539) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 20:41:47.062922 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:47.099512 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Instance cache missing network info. {{(pid=123539) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3300}} Oct 04 20:41:47.133733 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Updating instance_info_cache with network_info: [] {{(pid=123539) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-3706eca2-2b2e-4f87-9049-b51089d53f0d tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-312ae002-22d7-424c-8680-c4758bc2b256) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:47.785388 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-312ae002-22d7-424c-8680-c4758bc2b256) Oct 04 20:41:47.793436 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:47.804373 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-3706eca2-2b2e-4f87-9049-b51089d53f0d tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:47.804373 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3706eca2-2b2e-4f87-9049-b51089d53f0d tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Request method failure captured: Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 206 Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJpeu0zoMvJAVRMePw38HrVNaz-I7rVaAHwwNBq1sVefQY-L4g8HJG02SsF32LOH9zFGULwXW-9hnTe3sUrVRVEwXxHbSp0VCUDdP-SR2Yq2jb-0iTK3y0_KT_UQFR0jEd-Qkg0zE9WL41iimjkIGkjBI1Me5AoQqYFNCvaX1IJTme0 Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b0dba749bcef41eabaa078e2e36d0f97", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b0dba749bcef41eabaa078e2e36d0f97"}]}] Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 11b6296bc2fb4ca6b2f02bf06c3f6602 Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-DeleteServersTestJSON-server-625972377", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-625972377', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '0caecb22-40fe-43f0-8d1f-cae8a80416fd'}]}}} Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:47.809811 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-312ae002-22d7-424c-8680-c4758bc2b256) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:47.818674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3706eca2-2b2e-4f87-9049-b51089d53f0d tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:47.832599 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3706eca2-2b2e-4f87-9049-b51089d53f0d tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.740026 Oct 04 20:41:47.836657 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 647/1269] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:45 2022] POST /compute/v2.1/servers => generated 214 bytes in 2755 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:47.886429 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-92a1aaec-128d-469b-914c-2403745e4278 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:47.897434 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-92a1aaec-128d-469b-914c-2403745e4278 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:47.937566 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92a1aaec-128d-469b-914c-2403745e4278 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:47.940684 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92a1aaec-128d-469b-914c-2403745e4278 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:47.946401 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92a1aaec-128d-469b-914c-2403745e4278 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:47.948409 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92a1aaec-128d-469b-914c-2403745e4278 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:47.954611 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92a1aaec-128d-469b-914c-2403745e4278 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:47.957447 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-92a1aaec-128d-469b-914c-2403745e4278 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:48.625404 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-92a1aaec-128d-469b-914c-2403745e4278 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:48.656122 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-92a1aaec-128d-469b-914c-2403745e4278 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1463 microversion: 2.1 time: 0.816437 Oct 04 20:41:48.657571 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 648/1270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:47 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1463 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:48.668777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-ee362528-c220-49ba-9d3e-aa958ff92d6c req-51cf961e-a74b-4089-9639-7f520ed87f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d42994f-e35e-413c-a0a3-14bb3878e209", "name": "network-vif-unplugged", "status": "completed", "tag": "2a1a7e79-2aa6-49de-b62c-90d4d8aa18d1"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:48.702424 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-ee362528-c220-49ba-9d3e-aa958ff92d6c req-51cf961e-a74b-4089-9639-7f520ed87f1d service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:48.705109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-ee362528-c220-49ba-9d3e-aa958ff92d6c req-51cf961e-a74b-4089-9639-7f520ed87f1d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:48.706529 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-ee362528-c220-49ba-9d3e-aa958ff92d6c req-51cf961e-a74b-4089-9639-7f520ed87f1d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:48.746046 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-ee362528-c220-49ba-9d3e-aa958ff92d6c req-51cf961e-a74b-4089-9639-7f520ed87f1d service nova] Creating event network-vif-unplugged:2a1a7e79-2aa6-49de-b62c-90d4d8aa18d1 for instance 9d42994f-e35e-413c-a0a3-14bb3878e209 on n-h2-852085-12 Oct 04 20:41:48.758908 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-ee362528-c220-49ba-9d3e-aa958ff92d6c req-51cf961e-a74b-4089-9639-7f520ed87f1d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098996 Oct 04 20:41:48.760641 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 649/1271] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:48.769768 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3a80c99f-17ba-4f91-9d0c-45d9eff8ef9e tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Action: 'create', calling method: .version_select at 0x7f77ef2fe3a0>, body: {"keypair": {"name": "tempest-key-1204018855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkz4ou3+GuNOf41Nu/YavNrYPB1CCdEfgN6khQBcV/n878D3dHxmTN3LMOY3VHISbJW/3YzarJVdDyfAY221GGu6p3SP1fOq6q/wAlddMYQjSn5J1Q0nL4aUYUXLOSYSA=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:48.802783 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-3a80c99f-17ba-4f91-9d0c-45d9eff8ef9e tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Getting quotas for project 74d829c1899f478e9a95a0402c0dc87e. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:41:48.809943 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-3a80c99f-17ba-4f91-9d0c-45d9eff8ef9e tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Getting quotas for user b0933e4def614f928c0415b7de888e24 and project 74d829c1899f478e9a95a0402c0dc87e. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:41:49.479979 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-af6aa368-4c58-4c8f-b049-0d53ae1e6ffd tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 204 len: 0 microversion: 2.91 time: 5.996385 Oct 04 20:41:49.486943 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 623/1272] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:41:43 2022] DELETE /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 0 bytes in 6000 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:41:49.492966 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-076a5cf8-b0b9-4bc2-bf26-0e55004443d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:49.494155 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-076a5cf8-b0b9-4bc2-bf26-0e55004443d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:49.506440 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-076a5cf8-b0b9-4bc2-bf26-0e55004443d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:49.507903 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-076a5cf8-b0b9-4bc2-bf26-0e55004443d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:49.509093 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-076a5cf8-b0b9-4bc2-bf26-0e55004443d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:49.510768 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-076a5cf8-b0b9-4bc2-bf26-0e55004443d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:49.511995 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-076a5cf8-b0b9-4bc2-bf26-0e55004443d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:49.513119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-076a5cf8-b0b9-4bc2-bf26-0e55004443d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:49.675103 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-076a5cf8-b0b9-4bc2-bf26-0e55004443d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:49.676478 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3a80c99f-17ba-4f91-9d0c-45d9eff8ef9e tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.913075 Oct 04 20:41:49.678500 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 650/1273] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:41:48 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:49.715747 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4c4d5b46-e18d-4b7d-b975-1ff09d1c0f96 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-819474584"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:49.721283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4c4d5b46-e18d-4b7d-b975-1ff09d1c0f96 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:49.727298 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-076a5cf8-b0b9-4bc2-bf26-0e55004443d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1271 microversion: 2.1 time: 0.241291 Oct 04 20:41:49.742534 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 624/1274] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:49 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:49.742772 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4c4d5b46-e18d-4b7d-b975-1ff09d1c0f96 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:49.742772 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4c4d5b46-e18d-4b7d-b975-1ff09d1c0f96 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:49.742772 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4c4d5b46-e18d-4b7d-b975-1ff09d1c0f96 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:49.743548 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4c4d5b46-e18d-4b7d-b975-1ff09d1c0f96 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:49.744282 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4c4d5b46-e18d-4b7d-b975-1ff09d1c0f96 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:49.747267 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4c4d5b46-e18d-4b7d-b975-1ff09d1c0f96 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:49.779950 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-389a39f3-6e2a-418b-8784-17420e3e3dc3 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1702631106", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:50.120089 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-389a39f3-6e2a-418b-8784-17420e3e3dc3 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] validate_networks() for [('0caecb22-40fe-43f0-8d1f-cae8a80416fd', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:51.212327 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4c4d5b46-e18d-4b7d-b975-1ff09d1c0f96 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "POST /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364/action" status: 202 len: 0 microversion: 2.1 time: 1.512262 Oct 04 20:41:51.218369 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 651/1275] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:49 2022] POST /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364/action => generated 0 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-389a39f3-6e2a-418b-8784-17420e3e3dc3 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a60a56ff-2d6f-4aa4-a0fd-9d8af1993d0f) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:51.471339 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a60a56ff-2d6f-4aa4-a0fd-9d8af1993d0f) Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-389a39f3-6e2a-418b-8784-17420e3e3dc3 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-389a39f3-6e2a-418b-8784-17420e3e3dc3 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Request method failure captured: Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 207 Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJpeu0zoMvJAVRMePw38HrVNaz-I7rVaAHwwNBq1sVefQY-L4g8HJG02SsF32LOH9zFGULwXW-9hnTe3sUrVRVEwXxHbSp0VCUDdP-SR2Yq2jb-0iTK3y0_KT_UQFR0jEd-Qkg0zE9WL41iimjkIGkjBI1Me5AoQqYFNCvaX1IJTme0 Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b0dba749bcef41eabaa078e2e36d0f97", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b0dba749bcef41eabaa078e2e36d0f97"}]}] Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 11b6296bc2fb4ca6b2f02bf06c3f6602 Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1702631106", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1702631106', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '0caecb22-40fe-43f0-8d1f-cae8a80416fd'}]}}} Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:51.484695 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:51.496771 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a60a56ff-2d6f-4aa4-a0fd-9d8af1993d0f) Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-389a39f3-6e2a-418b-8784-17420e3e3dc3 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:51.512378 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-389a39f3-6e2a-418b-8784-17420e3e3dc3 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.717783 Oct 04 20:41:51.525369 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 625/1276] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:49 2022] POST /compute/v2.1/servers => generated 214 bytes in 1788 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:51.551027 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f5da484c-1d96-41df-a0ff-ad2290fea262 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:51.556431 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f5da484c-1d96-41df-a0ff-ad2290fea262 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] [instance: 6d44adbe-9208-452a-a8f7-8802ac29dfb8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:51.563341 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:51.618406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f5da484c-1d96-41df-a0ff-ad2290fea262 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:51.625740 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f5da484c-1d96-41df-a0ff-ad2290fea262 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:51.628193 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f5da484c-1d96-41df-a0ff-ad2290fea262 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:51.637014 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f5da484c-1d96-41df-a0ff-ad2290fea262 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:51.640916 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f5da484c-1d96-41df-a0ff-ad2290fea262 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:51.643936 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f5da484c-1d96-41df-a0ff-ad2290fea262 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:51.754034 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-f5da484c-1d96-41df-a0ff-ad2290fea262 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] HTTP exception thrown: Instance 6d44adbe-9208-452a-a8f7-8802ac29dfb8 could not be found. Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f5da484c-1d96-41df-a0ff-ad2290fea262 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Request method failure captured: Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 HTTP/1.1 Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJof68D5__7G1a0afQTaEOpD44AK6ykNRH9F0lAbHLcuwyITlbxdeNPl25MZJPG6Cp2sjAtEJ7GzRsqNCe5hCFi4yOfsRVT7bqRz_AvfojJusG0Q5-l6LOYZCFugq9USjQWGAkg9JFsFBPIN01TCCQN8eg1in_2Jij-NeauWGXufFvM Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 060a53e4fead4141a343b3e54bb09eff Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1701435296 Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_060a53e4fead4141a343b3e54bb09eff", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/060a53e4fead4141a343b3e54bb09eff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/060a53e4fead4141a343b3e54bb09eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/060a53e4fead4141a343b3e54bb09eff"}]}] Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1701435296 Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 060a53e4fead4141a343b3e54bb09eff Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1701435296 Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-UnshelveToHostMultiNodesTest-1701435296-project Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: a9990d76e7b941ee9dcedb1cb7974d3e Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1701435296-project Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 6d44adbe-9208-452a-a8f7-8802ac29dfb8 could not be found. Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '6d44adbe-9208-452a-a8f7-8802ac29dfb8'} Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d44adbe-9208-452a-a8f7-8802ac29dfb8 could not be found. Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d44adbe-9208-452a-a8f7-8802ac29dfb8 could not be found. Oct 04 20:41:51.772269 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.785085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:51.785085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.785085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:51.785085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:51.785085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:51.785085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:51.785085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:51.785085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d44adbe-9208-452a-a8f7-8802ac29dfb8 could not be found. Oct 04 20:41:51.785085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:51.785085 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f5da484c-1d96-41df-a0ff-ad2290fea262 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] Returning 404 to user: Instance 6d44adbe-9208-452a-a8f7-8802ac29dfb8 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:51.785085 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f5da484c-1d96-41df-a0ff-ad2290fea262 tempest-UnshelveToHostMultiNodesTest-1701435296 tempest-UnshelveToHostMultiNodesTest-1701435296-project] 10.222.0.78 "GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8" status: 404 len: 111 microversion: 2.91 time: 0.256184 Oct 04 20:41:51.787900 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 626/1277] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:51 2022] GET /compute/v2.1/servers/6d44adbe-9208-452a-a8f7-8802ac29dfb8 => generated 111 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:41:51.811562 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b948185b-95db-4a38-9a00-14b0e16f0e44 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Calling method '.version_select at 0x7f77eee76c10>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:51.850624 n-d-852085-12 devstack@n-api.service[123539]: WARNING oslo_db.sqlalchemy.utils [None req-b948185b-95db-4a38-9a00-14b0e16f0e44 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:41:51.878316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-18b876ac-6702-445e-96d4-2855ce9ccd26 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Calling method '.version_select at 0x7f77ef290820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:51.898445 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b948185b-95db-4a38-9a00-14b0e16f0e44 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.101364 Oct 04 20:41:51.901942 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 627/1278] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:41:51 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:51.939396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8a3b5936-86e7-4fd3-a736-b6b03e49bae6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:51.941069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8a3b5936-86e7-4fd3-a736-b6b03e49bae6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:51.958240 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-18b876ac-6702-445e-96d4-2855ce9ccd26 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:51.962777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-18b876ac-6702-445e-96d4-2855ce9ccd26 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:51.965085 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-18b876ac-6702-445e-96d4-2855ce9ccd26 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:51.980554 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8a3b5936-86e7-4fd3-a736-b6b03e49bae6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:51.982079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8a3b5936-86e7-4fd3-a736-b6b03e49bae6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:51.984292 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8a3b5936-86e7-4fd3-a736-b6b03e49bae6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:51.986448 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8a3b5936-86e7-4fd3-a736-b6b03e49bae6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:51.988121 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8a3b5936-86e7-4fd3-a736-b6b03e49bae6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:51.995761 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8a3b5936-86e7-4fd3-a736-b6b03e49bae6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:52.083196 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-18b876ac-6702-445e-96d4-2855ce9ccd26 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:52.093573 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-18b876ac-6702-445e-96d4-2855ce9ccd26 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:52.096580 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-18b876ac-6702-445e-96d4-2855ce9ccd26 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:52.180097 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-18b876ac-6702-445e-96d4-2855ce9ccd26 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/f4fa3c2885ec48db880029d93907789d?start=2022-10-03T20%3A41%3A48.696509&end=2022-10-05T20%3A41%3A48.696509" status: 200 len: 692 microversion: 2.1 time: 0.940889 Oct 04 20:41:52.185006 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 652/1279] 10.222.0.78 () {58 vars in 1412 bytes} [Tue Oct 4 20:41:51 2022] GET /compute/v2.1/os-simple-tenant-usage/f4fa3c2885ec48db880029d93907789d?start=2022-10-03T20%3A41%3A48.696509&end=2022-10-05T20%3A41%3A48.696509 => generated 692 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:52.209029 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7342a071-74d0-4fb2-8120-f466cbf3d612 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28c3a0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:52.382915 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7342a071-74d0-4fb2-8120-f466cbf3d612 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.191363 Oct 04 20:41:52.384073 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 653/1280] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:41:52 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:52.416544 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7d9ce206-0014-4345-9d62-354ed9db31c7 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-320838082", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:52.542588 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-7d9ce206-0014-4345-9d62-354ed9db31c7 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] validate_networks() for [('0caecb22-40fe-43f0-8d1f-cae8a80416fd', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:53.338330 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8a3b5936-86e7-4fd3-a736-b6b03e49bae6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:53.395585 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8a3b5936-86e7-4fd3-a736-b6b03e49bae6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1313 microversion: 2.1 time: 1.490431 Oct 04 20:41:53.403511 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 628/1281] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:51 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1313 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:53.430093 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2b04632e-b77c-459b-9bc6-ba38ac254c84 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1109379233", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-key-1204018855", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:53.456383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=8 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:53.637659 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-2b04632e-b77c-459b-9bc6-ba38ac254c84 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] validate_networks() for [('bd3e9948-df1a-401b-b922-c0d656845500', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-7d9ce206-0014-4345-9d62-354ed9db31c7 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-85c9d529-e39d-4bc1-a9b4-03fac5faa37f) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:53.796707 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-85c9d529-e39d-4bc1-a9b4-03fac5faa37f) Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-7d9ce206-0014-4345-9d62-354ed9db31c7 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:53.811032 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7d9ce206-0014-4345-9d62-354ed9db31c7 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Request method failure captured: Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 206 Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJpeu0zoMvJAVRMePw38HrVNaz-I7rVaAHwwNBq1sVefQY-L4g8HJG02SsF32LOH9zFGULwXW-9hnTe3sUrVRVEwXxHbSp0VCUDdP-SR2Yq2jb-0iTK3y0_KT_UQFR0jEd-Qkg0zE9WL41iimjkIGkjBI1Me5AoQqYFNCvaX1IJTme0 Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b0dba749bcef41eabaa078e2e36d0f97", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b0dba749bcef41eabaa078e2e36d0f97"}]}] Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 11b6296bc2fb4ca6b2f02bf06c3f6602 Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-DeleteServersTestJSON-server-320838082", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-320838082', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '0caecb22-40fe-43f0-8d1f-cae8a80416fd'}]}}} Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:53.824220 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-85c9d529-e39d-4bc1-a9b4-03fac5faa37f) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:53.833743 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7d9ce206-0014-4345-9d62-354ed9db31c7 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:53.846012 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7d9ce206-0014-4345-9d62-354ed9db31c7 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.447256 Oct 04 20:41:53.859381 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 654/1282] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:52 2022] POST /compute/v2.1/servers => generated 214 bytes in 1463 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:53.872879 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ff7cd01a-b2e4-4481-ab41-03159cb76cb1 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '.version_select at 0x7f77efab1820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:53.915676 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ff7cd01a-b2e4-4481-ab41-03159cb76cb1 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:53.916719 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ff7cd01a-b2e4-4481-ab41-03159cb76cb1 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:53.917674 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ff7cd01a-b2e4-4481-ab41-03159cb76cb1 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:53.941938 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ff7cd01a-b2e4-4481-ab41-03159cb76cb1 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:53.942841 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ff7cd01a-b2e4-4481-ab41-03159cb76cb1 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:53.943554 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ff7cd01a-b2e4-4481-ab41-03159cb76cb1 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:53.997976 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ff7cd01a-b2e4-4481-ab41-03159cb76cb1 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/f4fa3c2885ec48db880029d93907789d?start=2022-10-03T20%3A41%3A48.696509&end=2022-10-05T20%3A41%3A48.696509" status: 200 len: 696 microversion: 2.1 time: 0.146306 Oct 04 20:41:53.999494 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 655/1283] 10.222.0.78 () {58 vars in 1412 bytes} [Tue Oct 4 20:41:53 2022] GET /compute/v2.1/os-simple-tenant-usage/f4fa3c2885ec48db880029d93907789d?start=2022-10-03T20%3A41%3A48.696509&end=2022-10-05T20%3A41%3A48.696509 => generated 696 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:54.044730 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2da092d9-4c33-4ae5-8cf1-6f036170afa1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28c790>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:54.264410 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2da092d9-4c33-4ae5-8cf1-6f036170afa1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.261240 Oct 04 20:41:54.323826 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 656/1284] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:41:53 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:54.349899 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5c48616c-e196-4aba-abe9-8f7a7674c02a tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "8fe50bd2-6799-4976-8c6e-7d5e4830c6ba"}], "security_groups": [{"name": "tempest-securitygroup--2144302945"}], "key_name": "tempest-keypair-838947080", "user_data": "}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:55.138384 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-5c48616c-e196-4aba-abe9-8f7a7674c02a tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] validate_networks() for [('8fe50bd2-6799-4976-8c6e-7d5e4830c6ba', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-2b04632e-b77c-459b-9bc6-ba38ac254c84 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6af1b1b3-5871-4d49-8fae-d494e926f912) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:55.723874 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6af1b1b3-5871-4d49-8fae-d494e926f912) Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-2b04632e-b77c-459b-9bc6-ba38ac254c84 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2b04632e-b77c-459b-9bc6-ba38ac254c84 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Request method failure captured: Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 239 Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJpliQrZvocPZVIkUnmvJ-y5Q6dGllu5MKyDSYahHA0VPDVxohsUPEFk9jtqQKs6cXGrIVmNI3X8G4iqRNTL8l-4NANPIuqDD4U1lTf87IR8hG0A4n9_ZC2JH_7SQLcQ7f8ik7Buj4fJ9HZEy9t-A4L48vTfBLQVyKmwDvIn_nLtXiE Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74d829c1899f478e9a95a0402c0dc87e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74d829c1899f478e9a95a0402c0dc87e"}]}] Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersTestJSON-1826046113 Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersTestJSON-1826046113-project Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b0933e4def614f928c0415b7de888e24 Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersTestJSON-1826046113-project Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServersTestJSON-server-1109379233", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-key-1204018855", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1109379233', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'key_name': 'tempest-key-1204018855', 'networks': [{'uuid': 'bd3e9948-df1a-401b-b922-c0d656845500'}]}}} Oct 04 20:41:55.735821 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:55.754141 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6af1b1b3-5871-4d49-8fae-d494e926f912) Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2b04632e-b77c-459b-9bc6-ba38ac254c84 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2b04632e-b77c-459b-9bc6-ba38ac254c84 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.329749 Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 629/1285] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:53 2022] POST /compute/v2.1/servers => generated 214 bytes in 2338 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:55.771255 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7ec99d85-f84a-43b8-aa9a-aad281c9b646 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Calling method '.version_select at 0x7f77eee130d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:55.790789 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ec99d85-f84a-43b8-aa9a-aad281c9b646 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:55.791850 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ec99d85-f84a-43b8-aa9a-aad281c9b646 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:55.792864 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ec99d85-f84a-43b8-aa9a-aad281c9b646 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:55.836004 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ec99d85-f84a-43b8-aa9a-aad281c9b646 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:55.837055 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ec99d85-f84a-43b8-aa9a-aad281c9b646 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:55.837928 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ec99d85-f84a-43b8-aa9a-aad281c9b646 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:55.970887 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7ec99d85-f84a-43b8-aa9a-aad281c9b646 tempest-TenantUsagesTestJSON-1772687217 tempest-TenantUsagesTestJSON-1772687217-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A41%3A48.696509&end=2022-10-05T20%3A41%3A48.696509&detailed=1" status: 200 len: 13040 microversion: 2.1 time: 0.225934 Oct 04 20:41:55.972063 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 630/1286] 10.222.0.78 () {58 vars in 1335 bytes} [Tue Oct 4 20:41:55 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A41%3A48.696509&end=2022-10-05T20%3A41%3A48.696509&detailed=1 => generated 13040 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:41:55.980668 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0ef62aa7-6f4e-4b13-9a11-590898e22791 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-826430458", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:56.094673 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-0ef62aa7-6f4e-4b13-9a11-590898e22791 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] validate_networks() for [('0caecb22-40fe-43f0-8d1f-cae8a80416fd', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-5c48616c-e196-4aba-abe9-8f7a7674c02a tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-274dac59-9051-4940-bbe5-5b872d25dfeb) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:56.438474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-274dac59-9051-4940-bbe5-5b872d25dfeb) Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-5c48616c-e196-4aba-abe9-8f7a7674c02a tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5c48616c-e196-4aba-abe9-8f7a7674c02a tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] Request method failure captured: Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 498 Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJqFFc01bAY4Jy-LsppXtKEy1CTebFnkidzs6YhR5CoBYGqZTeeJ27h_d01vCi4z2AEE15awpVOQWHmmqmv8AwJl8HE2NGLeURn3d8pbajLtBTCVAyf4WgZzJP_oYTU5rJkz3UYt0UtUxjwHIOgLQyQ79p2U5DhphXSKSt2p0cO71MM Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: f8f49cc17cdd45cc8278f8d5cf1e7490 Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersTestFqdnHostnames-736087331 Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f8f49cc17cdd45cc8278f8d5cf1e7490", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f8f49cc17cdd45cc8278f8d5cf1e7490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f8f49cc17cdd45cc8278f8d5cf1e7490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f8f49cc17cdd45cc8278f8d5cf1e7490"}]}] Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersTestFqdnHostnames-736087331 Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: f8f49cc17cdd45cc8278f8d5cf1e7490 Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-736087331 Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersTestFqdnHostnames-736087331-project Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 935f44986e194a1882d095a9b136c6bc Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersTestFqdnHostnames-736087331-project Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "I8~jmEFnhKTpwiY", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "8fe50bd2-6799-4976-8c6e-7d5e4830c6ba"}], "security_groups": [{"name": "tempest-securitygroup--2144302945"}], "key_name": "tempest-keypair-838947080", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:56.448846 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'guest-instance-1.domain.com', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'I8~jmEFnhKTpwiY', 'networks': [{'uuid': '8fe50bd2-6799-4976-8c6e-7d5e4830c6ba'}], 'security_groups': [{'name': 'tempest-securitygroup--2144302945'}], 'key_name': 'tempest-keypair-838947080', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:56.463995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-274dac59-9051-4940-bbe5-5b872d25dfeb) Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5c48616c-e196-4aba-abe9-8f7a7674c02a tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5c48616c-e196-4aba-abe9-8f7a7674c02a tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.145197 Oct 04 20:41:56.480987 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 657/1287] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:54 2022] POST /compute/v2.1/servers => generated 214 bytes in 2161 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:56.499270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8d3d27e9-c0e6-4f2d-b1dd-605d97597d4c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:56.499270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8d3d27e9-c0e6-4f2d-b1dd-605d97597d4c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:56.511271 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8d3d27e9-c0e6-4f2d-b1dd-605d97597d4c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:56.515422 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8d3d27e9-c0e6-4f2d-b1dd-605d97597d4c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:56.516454 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8d3d27e9-c0e6-4f2d-b1dd-605d97597d4c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:56.520828 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8d3d27e9-c0e6-4f2d-b1dd-605d97597d4c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:56.521783 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8d3d27e9-c0e6-4f2d-b1dd-605d97597d4c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:56.522673 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8d3d27e9-c0e6-4f2d-b1dd-605d97597d4c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:57.224750 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8d3d27e9-c0e6-4f2d-b1dd-605d97597d4c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:57.243496 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8d3d27e9-c0e6-4f2d-b1dd-605d97597d4c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1313 microversion: 2.1 time: 0.780341 Oct 04 20:41:57.245789 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 658/1288] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:56 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:57.256918 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a62e60c5-d029-4b1d-82ba-9f4b889e3c80 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2909d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-0ef62aa7-6f4e-4b13-9a11-590898e22791 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-aabde010-63ac-4d51-9698-4fb06a272b98) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:57.351107 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-aabde010-63ac-4d51-9698-4fb06a272b98) Oct 04 20:41:57.359675 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:57.363499 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-0ef62aa7-6f4e-4b13-9a11-590898e22791 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:57.363499 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:57.365840 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a62e60c5-d029-4b1d-82ba-9f4b889e3c80 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.117043 Oct 04 20:41:57.381728 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 659/1289] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:41:57 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0ef62aa7-6f4e-4b13-9a11-590898e22791 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Request method failure captured: Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 206 Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJpeu0zoMvJAVRMePw38HrVNaz-I7rVaAHwwNBq1sVefQY-L4g8HJG02SsF32LOH9zFGULwXW-9hnTe3sUrVRVEwXxHbSp0VCUDdP-SR2Yq2jb-0iTK3y0_KT_UQFR0jEd-Qkg0zE9WL41iimjkIGkjBI1Me5AoQqYFNCvaX1IJTme0 Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b0dba749bcef41eabaa078e2e36d0f97", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0dba749bcef41eabaa078e2e36d0f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b0dba749bcef41eabaa078e2e36d0f97"}]}] Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: b0dba749bcef41eabaa078e2e36d0f97 Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-DeleteServersTestJSON-765273597 Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 11b6296bc2fb4ca6b2f02bf06c3f6602 Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-DeleteServersTestJSON-765273597-project Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-DeleteServersTestJSON-server-826430458", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0caecb22-40fe-43f0-8d1f-cae8a80416fd"}]}} Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-826430458', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '0caecb22-40fe-43f0-8d1f-cae8a80416fd'}]}}} Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:57.390157 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-aabde010-63ac-4d51-9698-4fb06a272b98) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:57.406040 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0ef62aa7-6f4e-4b13-9a11-590898e22791 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0ef62aa7-6f4e-4b13-9a11-590898e22791 tempest-DeleteServersTestJSON-765273597 tempest-DeleteServersTestJSON-765273597-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.396806 Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 631/1290] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:55 2022] POST /compute/v2.1/servers => generated 214 bytes in 1399 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:57.413996 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-150f2a6f-2ad3-4cf2-9fc7-02dbcae16a0b tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Calling method '.version_select at 0x7f77eee133a0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:57.557612 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-150f2a6f-2ad3-4cf2-9fc7-02dbcae16a0b tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-key-1204018855" status: 202 len: 0 microversion: 2.1 time: 0.182226 Oct 04 20:41:57.560310 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 632/1291] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 4 20:41:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1204018855 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:57.593206 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ca629f8f-f0fa-4aff-8c9f-c0b23328930f tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:57.602088 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ca629f8f-f0fa-4aff-8c9f-c0b23328930f tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:57.634199 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ca629f8f-f0fa-4aff-8c9f-c0b23328930f tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:57.636439 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ca629f8f-f0fa-4aff-8c9f-c0b23328930f tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:57.648326 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ca629f8f-f0fa-4aff-8c9f-c0b23328930f tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:57.650624 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ca629f8f-f0fa-4aff-8c9f-c0b23328930f tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:57.652105 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ca629f8f-f0fa-4aff-8c9f-c0b23328930f tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:57.653429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ca629f8f-f0fa-4aff-8c9f-c0b23328930f tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:57.732782 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ca629f8f-f0fa-4aff-8c9f-c0b23328930f tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:41:57.895895 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-a7d70396-827f-4e54-bc14-2c44900cb05d req-cba4b732-ab4f-4853-9cbc-243b462c83c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df857cc-3e6c-4b0b-910e-dd62869d64d1", "tag": "54432a46-1686-4c52-94a1-47829a97e1e1"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:57.937084 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-a7d70396-827f-4e54-bc14-2c44900cb05d req-cba4b732-ab4f-4853-9cbc-243b462c83c1 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:57.939205 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-a7d70396-827f-4e54-bc14-2c44900cb05d req-cba4b732-ab4f-4853-9cbc-243b462c83c1 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:57.941152 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-a7d70396-827f-4e54-bc14-2c44900cb05d req-cba4b732-ab4f-4853-9cbc-243b462c83c1 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:57.975302 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-a7d70396-827f-4e54-bc14-2c44900cb05d req-cba4b732-ab4f-4853-9cbc-243b462c83c1 service nova] Creating event network-changed:54432a46-1686-4c52-94a1-47829a97e1e1 for instance 7df857cc-3e6c-4b0b-910e-dd62869d64d1 on n-h1-852085-12 Oct 04 20:41:57.987372 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-a7d70396-827f-4e54-bc14-2c44900cb05d req-cba4b732-ab4f-4853-9cbc-243b462c83c1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.617969 Oct 04 20:41:57.989297 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 660/1292] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:58.115791 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-5058ee24-83e6-4ca8-9746-551008933907 req-6dbb703e-0feb-47fd-b4ef-da7c8e84b811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3b28cc-8307-4f7a-889b-ab08d068ec0e", "tag": "e7face03-f5ca-470d-ba1f-9b74713e1d67"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:58.131580 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-5058ee24-83e6-4ca8-9746-551008933907 req-6dbb703e-0feb-47fd-b4ef-da7c8e84b811 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:58.132782 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-5058ee24-83e6-4ca8-9746-551008933907 req-6dbb703e-0feb-47fd-b4ef-da7c8e84b811 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:58.133933 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-5058ee24-83e6-4ca8-9746-551008933907 req-6dbb703e-0feb-47fd-b4ef-da7c8e84b811 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:58.165420 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-5058ee24-83e6-4ca8-9746-551008933907 req-6dbb703e-0feb-47fd-b4ef-da7c8e84b811 service nova] Creating event network-changed:e7face03-f5ca-470d-ba1f-9b74713e1d67 for instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e on n-h1-852085-12 Oct 04 20:41:58.191578 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-5058ee24-83e6-4ca8-9746-551008933907 req-6dbb703e-0feb-47fd-b4ef-da7c8e84b811 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199256 Oct 04 20:41:58.192526 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 661/1293] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:58.203031 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4b6baeb6-227b-4e5d-8701-2ade80495c0f tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] Calling method '.version_select at 0x7f77ef2901f0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:58.300776 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ca629f8f-f0fa-4aff-8c9f-c0b23328930f tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 204 len: 0 microversion: 2.1 time: 0.736169 Oct 04 20:41:58.301894 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 633/1294] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:41:57 2022] DELETE /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:41:58.313707 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0b8ff47f-18c4-4916-9b35-51e02f942f6b tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1068465930", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:58.352838 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4b6baeb6-227b-4e5d-8701-2ade80495c0f tempest-ServersTestFqdnHostnames-736087331 tempest-ServersTestFqdnHostnames-736087331-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838947080" status: 202 len: 0 microversion: 2.1 time: 0.158042 Oct 04 20:41:58.362426 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 662/1295] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 4 20:41:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838947080 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:58.372940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e6569377-51d3-4d1f-8708-55629eb41b83 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:58.375033 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e6569377-51d3-4d1f-8708-55629eb41b83 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:58.395980 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e6569377-51d3-4d1f-8708-55629eb41b83 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:58.396924 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e6569377-51d3-4d1f-8708-55629eb41b83 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:58.397867 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e6569377-51d3-4d1f-8708-55629eb41b83 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:58.399502 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e6569377-51d3-4d1f-8708-55629eb41b83 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:58.400792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e6569377-51d3-4d1f-8708-55629eb41b83 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:58.401998 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e6569377-51d3-4d1f-8708-55629eb41b83 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:58.470074 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-0b8ff47f-18c4-4916-9b35-51e02f942f6b tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] validate_networks() for [('bd3e9948-df1a-401b-b922-c0d656845500', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:58.825818 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=14 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:59.227217 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e6569377-51d3-4d1f-8708-55629eb41b83 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:59.251599 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e6569377-51d3-4d1f-8708-55629eb41b83 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1313 microversion: 2.1 time: 0.886384 Oct 04 20:41:59.253650 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 663/1296] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:58 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1313 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:59.266205 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-78fb3458-b242-4112-8ef6-71be23d7f2eb tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:59.267850 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-78fb3458-b242-4112-8ef6-71be23d7f2eb tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:59.288714 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78fb3458-b242-4112-8ef6-71be23d7f2eb tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:59.290292 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78fb3458-b242-4112-8ef6-71be23d7f2eb tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:59.291884 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78fb3458-b242-4112-8ef6-71be23d7f2eb tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:59.293650 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78fb3458-b242-4112-8ef6-71be23d7f2eb tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:59.294478 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78fb3458-b242-4112-8ef6-71be23d7f2eb tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:59.296007 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78fb3458-b242-4112-8ef6-71be23d7f2eb tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-0b8ff47f-18c4-4916-9b35-51e02f942f6b tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-73ba7518-24e4-4d49-b826-720171467119) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:59.472186 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-73ba7518-24e4-4d49-b826-720171467119) Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-0b8ff47f-18c4-4916-9b35-51e02f942f6b tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0b8ff47f-18c4-4916-9b35-51e02f942f6b tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Request method failure captured: Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 201 Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJpliQrZvocPZVIkUnmvJ-y5Q6dGllu5MKyDSYahHA0VPDVxohsUPEFk9jtqQKs6cXGrIVmNI3X8G4iqRNTL8l-4NANPIuqDD4U1lTf87IR8hG0A4n9_ZC2JH_7SQLcQ7f8ik7Buj4fJ9HZEy9t-A4L48vTfBLQVyKmwDvIn_nLtXiE Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74d829c1899f478e9a95a0402c0dc87e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74d829c1899f478e9a95a0402c0dc87e"}]}] Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersTestJSON-1826046113 Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersTestJSON-1826046113-project Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b0933e4def614f928c0415b7de888e24 Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersTestJSON-1826046113-project Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServersTestJSON-server-1068465930", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1068465930', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'bd3e9948-df1a-401b-b922-c0d656845500'}]}}} Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:59.484183 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:41:59.496234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-73ba7518-24e4-4d49-b826-720171467119) Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0b8ff47f-18c4-4916-9b35-51e02f942f6b tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0b8ff47f-18c4-4916-9b35-51e02f942f6b tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.178001 Oct 04 20:41:59.510370 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 634/1297] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:58 2022] POST /compute/v2.1/servers => generated 214 bytes in 1182 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:41:59.519507 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cc417c59-fe82-4751-822e-a67f4366a410 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee13ca0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:59.634449 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cc417c59-fe82-4751-822e-a67f4366a410 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.124706 Oct 04 20:41:59.646661 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 635/1298] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:41:59 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:59.808595 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dc0a72b9-dabd-4a19-8108-a60f7a776ab1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1474831419", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:59.848609 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:59.928672 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-78fb3458-b242-4112-8ef6-71be23d7f2eb tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:59.972537 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-78fb3458-b242-4112-8ef6-71be23d7f2eb tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1469 microversion: 2.1 time: 0.716046 Oct 04 20:41:59.973713 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 664/1299] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:59 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1469 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:59.985010 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-dc0a72b9-dabd-4a19-8108-a60f7a776ab1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] validate_networks() for [('bd3e9948-df1a-401b-b922-c0d656845500', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:00.298603 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bf25881f-c133-41e4-97ad-9368b599a03e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:00.299717 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-bf25881f-c133-41e4-97ad-9368b599a03e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:00.316854 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bf25881f-c133-41e4-97ad-9368b599a03e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:00.317745 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bf25881f-c133-41e4-97ad-9368b599a03e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:00.318424 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bf25881f-c133-41e4-97ad-9368b599a03e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:00.319543 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bf25881f-c133-41e4-97ad-9368b599a03e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:00.320217 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bf25881f-c133-41e4-97ad-9368b599a03e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:00.320809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bf25881f-c133-41e4-97ad-9368b599a03e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-dc0a72b9-dabd-4a19-8108-a60f7a776ab1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-879f353d-a97f-443c-9f4b-e10cb8d3c834) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:42:00.846916 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-879f353d-a97f-443c-9f4b-e10cb8d3c834) Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-dc0a72b9-dabd-4a19-8108-a60f7a776ab1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dc0a72b9-dabd-4a19-8108-a60f7a776ab1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Request method failure captured: Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 201 Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJpliQrZvocPZVIkUnmvJ-y5Q6dGllu5MKyDSYahHA0VPDVxohsUPEFk9jtqQKs6cXGrIVmNI3X8G4iqRNTL8l-4NANPIuqDD4U1lTf87IR8hG0A4n9_ZC2JH_7SQLcQ7f8ik7Buj4fJ9HZEy9t-A4L48vTfBLQVyKmwDvIn_nLtXiE Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74d829c1899f478e9a95a0402c0dc87e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74d829c1899f478e9a95a0402c0dc87e"}]}] Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersTestJSON-1826046113 Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersTestJSON-1826046113-project Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b0933e4def614f928c0415b7de888e24 Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersTestJSON-1826046113-project Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServersTestJSON-server-1474831419", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1474831419', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'bd3e9948-df1a-401b-b922-c0d656845500'}]}}} Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:00.862503 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:42:00.881697 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-879f353d-a97f-443c-9f4b-e10cb8d3c834) Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dc0a72b9-dabd-4a19-8108-a60f7a776ab1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:00.899626 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-dc0a72b9-dabd-4a19-8108-a60f7a776ab1 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.053688 Oct 04 20:42:00.908553 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-bf25881f-c133-41e4-97ad-9368b599a03e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:00.909146 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 636/1300] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:59 2022] POST /compute/v2.1/servers => generated 214 bytes in 1065 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 20:42:00.909146 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0cd42f64-898c-4106-a610-38a77d8157c4 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee814c0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:00.933505 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bf25881f-c133-41e4-97ad-9368b599a03e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1313 microversion: 2.1 time: 0.640996 Oct 04 20:42:00.943653 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 665/1301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:00 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1313 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:01.025455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-132f6241-3f60-4eeb-bd85-ef34c298dd08 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:01.025455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-132f6241-3f60-4eeb-bd85-ef34c298dd08 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:01.065775 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-132f6241-3f60-4eeb-bd85-ef34c298dd08 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:01.066702 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-132f6241-3f60-4eeb-bd85-ef34c298dd08 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:01.067544 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-132f6241-3f60-4eeb-bd85-ef34c298dd08 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:01.068918 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-132f6241-3f60-4eeb-bd85-ef34c298dd08 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:01.069777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-132f6241-3f60-4eeb-bd85-ef34c298dd08 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:01.070570 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-132f6241-3f60-4eeb-bd85-ef34c298dd08 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:01.070899 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0cd42f64-898c-4106-a610-38a77d8157c4 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.202995 Oct 04 20:42:01.072915 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 637/1302] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:00 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:01.094388 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-63bcf069-6a11-48a5-ac8d-1173fa0444d4 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-130204983", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:01.291527 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-63bcf069-6a11-48a5-ac8d-1173fa0444d4 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] validate_networks() for [('bd3e9948-df1a-401b-b922-c0d656845500', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:01.707086 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-132f6241-3f60-4eeb-bd85-ef34c298dd08 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:01.737589 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-132f6241-3f60-4eeb-bd85-ef34c298dd08 tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1469 microversion: 2.1 time: 0.721039 Oct 04 20:42:01.751839 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 666/1303] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:01 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1469 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-63bcf069-6a11-48a5-ac8d-1173fa0444d4 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e45a72d4-d527-444d-94a0-f5c7e921c5fe) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:42:02.066702 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e45a72d4-d527-444d-94a0-f5c7e921c5fe) Oct 04 20:42:02.074593 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:02.088793 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-63bcf069-6a11-48a5-ac8d-1173fa0444d4 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:42:02.088793 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-63bcf069-6a11-48a5-ac8d-1173fa0444d4 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Request method failure captured: Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 200 Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJpliQrZvocPZVIkUnmvJ-y5Q6dGllu5MKyDSYahHA0VPDVxohsUPEFk9jtqQKs6cXGrIVmNI3X8G4iqRNTL8l-4NANPIuqDD4U1lTf87IR8hG0A4n9_ZC2JH_7SQLcQ7f8ik7Buj4fJ9HZEy9t-A4L48vTfBLQVyKmwDvIn_nLtXiE Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74d829c1899f478e9a95a0402c0dc87e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74d829c1899f478e9a95a0402c0dc87e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74d829c1899f478e9a95a0402c0dc87e"}]}] Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersTestJSON-1826046113 Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 74d829c1899f478e9a95a0402c0dc87e Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersTestJSON-1826046113 Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersTestJSON-1826046113-project Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b0933e4def614f928c0415b7de888e24 Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersTestJSON-1826046113-project Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServersTestJSON-server-130204983", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "bd3e9948-df1a-401b-b922-c0d656845500"}]}} Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-130204983', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'bd3e9948-df1a-401b-b922-c0d656845500'}]}}} Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:42:02.093252 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e45a72d4-d527-444d-94a0-f5c7e921c5fe) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:42:02.101787 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-63bcf069-6a11-48a5-ac8d-1173fa0444d4 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-63bcf069-6a11-48a5-ac8d-1173fa0444d4 tempest-ServersTestJSON-1826046113 tempest-ServersTestJSON-1826046113-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.041802 Oct 04 20:42:02.121749 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 638/1304] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:42:01 2022] POST /compute/v2.1/servers => generated 214 bytes in 1047 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:42:02.162321 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-10a13671-a341-4a47-98a1-f90c98c1ff91 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:02.167976 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-10a13671-a341-4a47-98a1-f90c98c1ff91 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:02.226357 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-5c153b8b-c514-4f3f-884d-8ac006cf3c17 req-7959f665-5ddf-4303-9c44-dda08c5fc1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd64c084-10af-4b12-bdd9-ef53866be364", "name": "network-vif-plugged", "status": "completed", "tag": "a55c4fe7-8c63-4a39-819e-95561de2446e"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:02.228642 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-10a13671-a341-4a47-98a1-f90c98c1ff91 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:02.235389 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-10a13671-a341-4a47-98a1-f90c98c1ff91 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:02.236809 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-10a13671-a341-4a47-98a1-f90c98c1ff91 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:02.238898 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-10a13671-a341-4a47-98a1-f90c98c1ff91 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:02.244145 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-10a13671-a341-4a47-98a1-f90c98c1ff91 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:02.250466 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-10a13671-a341-4a47-98a1-f90c98c1ff91 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:02.271204 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:02.274946 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-5c153b8b-c514-4f3f-884d-8ac006cf3c17 req-7959f665-5ddf-4303-9c44-dda08c5fc1bb service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:02.280734 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-5c153b8b-c514-4f3f-884d-8ac006cf3c17 req-7959f665-5ddf-4303-9c44-dda08c5fc1bb service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:02.284499 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-5c153b8b-c514-4f3f-884d-8ac006cf3c17 req-7959f665-5ddf-4303-9c44-dda08c5fc1bb service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:02.344052 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-5c153b8b-c514-4f3f-884d-8ac006cf3c17 req-7959f665-5ddf-4303-9c44-dda08c5fc1bb service nova] Creating event network-vif-plugged:a55c4fe7-8c63-4a39-819e-95561de2446e for instance bd64c084-10af-4b12-bdd9-ef53866be364 on n-h1-852085-12 Oct 04 20:42:02.374314 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-5c153b8b-c514-4f3f-884d-8ac006cf3c17 req-7959f665-5ddf-4303-9c44-dda08c5fc1bb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.604831 Oct 04 20:42:02.392500 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 667/1305] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:02.432941 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4b0c9870-c9de-4f7b-bfb5-e999de96e3bd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28cee0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:02.642960 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4b0c9870-c9de-4f7b-bfb5-e999de96e3bd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.244614 Oct 04 20:42:02.665763 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 668/1306] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:02 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:02.791100 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-88de0273-b36b-48a2-bc3f-f747b2a10ade tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:02.792596 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-88de0273-b36b-48a2-bc3f-f747b2a10ade tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:02.822515 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88de0273-b36b-48a2-bc3f-f747b2a10ade tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:02.823500 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88de0273-b36b-48a2-bc3f-f747b2a10ade tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:02.824645 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88de0273-b36b-48a2-bc3f-f747b2a10ade tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:02.829987 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88de0273-b36b-48a2-bc3f-f747b2a10ade tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:02.832411 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88de0273-b36b-48a2-bc3f-f747b2a10ade tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:02.835955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-88de0273-b36b-48a2-bc3f-f747b2a10ade tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:03.006209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-10a13671-a341-4a47-98a1-f90c98c1ff91 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:03.041467 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-10a13671-a341-4a47-98a1-f90c98c1ff91 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1313 microversion: 2.1 time: 0.908690 Oct 04 20:42:03.041467 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 639/1307] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:02 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1313 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:03.393273 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-88de0273-b36b-48a2-bc3f-f747b2a10ade tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:03.417856 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-88de0273-b36b-48a2-bc3f-f747b2a10ade tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1469 microversion: 2.1 time: 0.634940 Oct 04 20:42:03.418916 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 669/1308] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:02 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1469 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:03.676560 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0b7e0374-3fe4-4f68-aecc-902e42dad426 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee139d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:03.822754 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0b7e0374-3fe4-4f68-aecc-902e42dad426 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.155384 Oct 04 20:42:03.830247 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 640/1309] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:03 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:04.076925 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f8c3a0e5-24c7-4dad-9948-c177c97a5f1b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:04.088198 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f8c3a0e5-24c7-4dad-9948-c177c97a5f1b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:04.103864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:04.106760 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:04.110153 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8c3a0e5-24c7-4dad-9948-c177c97a5f1b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:04.119981 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8c3a0e5-24c7-4dad-9948-c177c97a5f1b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:04.130475 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8c3a0e5-24c7-4dad-9948-c177c97a5f1b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:04.133802 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8c3a0e5-24c7-4dad-9948-c177c97a5f1b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:04.136093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8c3a0e5-24c7-4dad-9948-c177c97a5f1b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:04.141707 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8c3a0e5-24c7-4dad-9948-c177c97a5f1b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:04.317762 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:04.380004 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-d04de314-ed6d-4faa-baf9-2fa43cf301f4 req-d736f629-efa9-4d55-8ea3-942de2a88e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1caeb3c7-b999-4f0c-bee2-f072b9c00336", "name": "network-vif-deleted", "tag": "e70b26ac-8828-4e78-8df7-85f383b35ac8"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:04.464481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-d04de314-ed6d-4faa-baf9-2fa43cf301f4 req-d736f629-efa9-4d55-8ea3-942de2a88e6e service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:04.468804 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-d04de314-ed6d-4faa-baf9-2fa43cf301f4 req-d736f629-efa9-4d55-8ea3-942de2a88e6e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:04.476280 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-d04de314-ed6d-4faa-baf9-2fa43cf301f4 req-d736f629-efa9-4d55-8ea3-942de2a88e6e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:04.556628 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-d04de314-ed6d-4faa-baf9-2fa43cf301f4 req-d736f629-efa9-4d55-8ea3-942de2a88e6e service nova] Creating event network-vif-deleted:e70b26ac-8828-4e78-8df7-85f383b35ac8 for instance 1caeb3c7-b999-4f0c-bee2-f072b9c00336 on n-h2-852085-12 Oct 04 20:42:04.590446 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-d04de314-ed6d-4faa-baf9-2fa43cf301f4 req-d736f629-efa9-4d55-8ea3-942de2a88e6e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224685 Oct 04 20:42:04.620095 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 641/1310] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:04.664136 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c543cfe9-b10e-4d2e-948b-5b8ff1b6bcba tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:04.677514 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c543cfe9-b10e-4d2e-948b-5b8ff1b6bcba tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:04.724686 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c543cfe9-b10e-4d2e-948b-5b8ff1b6bcba tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:04.725997 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c543cfe9-b10e-4d2e-948b-5b8ff1b6bcba tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:04.729001 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c543cfe9-b10e-4d2e-948b-5b8ff1b6bcba tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:04.739727 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c543cfe9-b10e-4d2e-948b-5b8ff1b6bcba tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:04.743018 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c543cfe9-b10e-4d2e-948b-5b8ff1b6bcba tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:04.745038 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c543cfe9-b10e-4d2e-948b-5b8ff1b6bcba tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:05.815102 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:05.974898 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c543cfe9-b10e-4d2e-948b-5b8ff1b6bcba tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca528ff45435455aa4fce16549993ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fa3c2885ec48db880029d93907789d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:06.009652 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c543cfe9-b10e-4d2e-948b-5b8ff1b6bcba tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 200 len: 1299 microversion: 2.1 time: 1.373890 Oct 04 20:42:06.012502 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 642/1311] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:04 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 1299 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:06.035428 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ee611a65-e452-498f-83e8-ee68393578e1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee13670>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:06.463331 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ee611a65-e452-498f-83e8-ee68393578e1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.428846 Oct 04 20:42:06.472599 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 643/1312] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:06 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:07.060558 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a0f26951-2839-4481-81c6-5e563bb876fd tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.064538 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a0f26951-2839-4481-81c6-5e563bb876fd tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] [instance: 1caeb3c7-b999-4f0c-bee2-f072b9c00336] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:07.101791 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a0f26951-2839-4481-81c6-5e563bb876fd tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:07.102781 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a0f26951-2839-4481-81c6-5e563bb876fd tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:07.103618 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a0f26951-2839-4481-81c6-5e563bb876fd tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:07.113774 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a0f26951-2839-4481-81c6-5e563bb876fd tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:07.115614 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a0f26951-2839-4481-81c6-5e563bb876fd tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:07.119932 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a0f26951-2839-4481-81c6-5e563bb876fd tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:07.201160 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-a0f26951-2839-4481-81c6-5e563bb876fd tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] HTTP exception thrown: Instance 1caeb3c7-b999-4f0c-bee2-f072b9c00336 could not be found. Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a0f26951-2839-4481-81c6-5e563bb876fd tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Request method failure captured: Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 HTTP/1.1 Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJo5O3WkZuyhdS0kaB9e8AJ3iyGQpHk2KKV1VlZhLpeAczAnhWRZVGp9rRv7k63E5VszMuMnZNnp1slZzbMZhwocfSdJUsGe1SKhO40t6HQjIV2uYoCMaHsLXzjsNr5AGMCh7m6jcdO617MxY-EqZ8y-k-RQIiJrjv9nAmn1N9fzCe8 Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: f4fa3c2885ec48db880029d93907789d Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TenantUsagesTestJSON-1771867330 Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4fa3c2885ec48db880029d93907789d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4fa3c2885ec48db880029d93907789d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4fa3c2885ec48db880029d93907789d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4fa3c2885ec48db880029d93907789d"}]}] Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TenantUsagesTestJSON-1771867330 Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: f4fa3c2885ec48db880029d93907789d Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1771867330 Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TenantUsagesTestJSON-1771867330-project Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: ca528ff45435455aa4fce16549993ab5 Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TenantUsagesTestJSON-1771867330-project Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 1caeb3c7-b999-4f0c-bee2-f072b9c00336 could not be found. Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '1caeb3c7-b999-4f0c-bee2-f072b9c00336'} Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1caeb3c7-b999-4f0c-bee2-f072b9c00336 could not be found. Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1caeb3c7-b999-4f0c-bee2-f072b9c00336 could not be found. Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:07.211963 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:07.221819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:07.221819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:07.221819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:07.221819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:07.221819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:07.221819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1caeb3c7-b999-4f0c-bee2-f072b9c00336 could not be found. Oct 04 20:42:07.221819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:42:07.235456 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a0f26951-2839-4481-81c6-5e563bb876fd tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] Returning 404 to user: Instance 1caeb3c7-b999-4f0c-bee2-f072b9c00336 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:07.239984 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a0f26951-2839-4481-81c6-5e563bb876fd tempest-TenantUsagesTestJSON-1771867330 tempest-TenantUsagesTestJSON-1771867330-project] 10.222.0.78 "GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336" status: 404 len: 111 microversion: 2.1 time: 0.183640 Oct 04 20:42:07.242528 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 644/1313] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/servers/1caeb3c7-b999-4f0c-bee2-f072b9c00336 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:42:07.480814 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f8c3a0e5-24c7-4dad-9948-c177c97a5f1b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:07.520844 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f8c3a0e5-24c7-4dad-9948-c177c97a5f1b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1313 microversion: 2.1 time: 3.451272 Oct 04 20:42:07.568637 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 670/1314] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:04 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1313 bytes in 3498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:07.617759 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-48bb005e-0ee1-47ee-bc24-9fa2bcfd6f16 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef209790>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.984221 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c6faad00-7bcd-44ed-8fea-5f1acdba110c tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.997573 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c6faad00-7bcd-44ed-8fea-5f1acdba110c tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:07.998442 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c6faad00-7bcd-44ed-8fea-5f1acdba110c tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:07.999246 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c6faad00-7bcd-44ed-8fea-5f1acdba110c tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.000938 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c6faad00-7bcd-44ed-8fea-5f1acdba110c tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.002092 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c6faad00-7bcd-44ed-8fea-5f1acdba110c tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.003180 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c6faad00-7bcd-44ed-8fea-5f1acdba110c tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.055522 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c6faad00-7bcd-44ed-8fea-5f1acdba110c tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.727337 Oct 04 20:42:08.070495 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 645/1315] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/os-services => generated 949 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:08.086352 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-093ef45c-0be4-4485-b61f-b0d9d772fbfb tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:08.122816 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-093ef45c-0be4-4485-b61f-b0d9d772fbfb tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.124223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-093ef45c-0be4-4485-b61f-b0d9d772fbfb tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.131546 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-093ef45c-0be4-4485-b61f-b0d9d772fbfb tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.136277 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-093ef45c-0be4-4485-b61f-b0d9d772fbfb tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.148545 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-093ef45c-0be4-4485-b61f-b0d9d772fbfb tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.150735 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-093ef45c-0be4-4485-b61f-b0d9d772fbfb tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.282475 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-093ef45c-0be4-4485-b61f-b0d9d772fbfb tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=n-d-852085-12" status: 200 len: 581 microversion: 2.1 time: 0.201533 Oct 04 20:42:08.292802 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 646/1316] 10.222.0.78 () {58 vars in 1174 bytes} [Tue Oct 4 20:42:08 2022] GET /compute/v2.1/os-services?host=n-d-852085-12 => generated 581 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:08.322199 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e8e2f455-26e0-401b-b1c7-c9447b09722d tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:08.333209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8e2f455-26e0-401b-b1c7-c9447b09722d tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.334174 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8e2f455-26e0-401b-b1c7-c9447b09722d tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.335182 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8e2f455-26e0-401b-b1c7-c9447b09722d tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.337988 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8e2f455-26e0-401b-b1c7-c9447b09722d tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.341252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8e2f455-26e0-401b-b1c7-c9447b09722d tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.342717 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8e2f455-26e0-401b-b1c7-c9447b09722d tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.464562 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e8e2f455-26e0-401b-b1c7-c9447b09722d tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.149097 Oct 04 20:42:08.486221 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 647/1317] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 4 20:42:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:42:08.508441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-28f322b3-e554-458a-afe4-206cfad4bc48 tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:08.514674 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-28f322b3-e554-458a-afe4-206cfad4bc48 tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.515773 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-28f322b3-e554-458a-afe4-206cfad4bc48 tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.516570 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-28f322b3-e554-458a-afe4-206cfad4bc48 tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.518804 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-28f322b3-e554-458a-afe4-206cfad4bc48 tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.519689 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-28f322b3-e554-458a-afe4-206cfad4bc48 tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.520448 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-28f322b3-e554-458a-afe4-206cfad4bc48 tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.621921 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-28f322b3-e554-458a-afe4-206cfad4bc48 tempest-ServicesAdminTestJSON-1394772237 tempest-ServicesAdminTestJSON-1394772237-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.130685 Oct 04 20:42:08.640386 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 648/1318] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:08 2022] GET /compute/v2.1/os-services => generated 949 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:42:08.667221 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-136679ba-8a23-4df9-8eb5-b24711f53f9c req-5f2df8dd-a16b-45c8-80b6-640c246e063b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df857cc-3e6c-4b0b-910e-dd62869d64d1", "name": "network-vif-plugged", "status": "completed", "tag": "54432a46-1686-4c52-94a1-47829a97e1e1"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:08.702897 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-136679ba-8a23-4df9-8eb5-b24711f53f9c req-5f2df8dd-a16b-45c8-80b6-640c246e063b service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.704055 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-136679ba-8a23-4df9-8eb5-b24711f53f9c req-5f2df8dd-a16b-45c8-80b6-640c246e063b service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.705052 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-136679ba-8a23-4df9-8eb5-b24711f53f9c req-5f2df8dd-a16b-45c8-80b6-640c246e063b service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.732002 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-136679ba-8a23-4df9-8eb5-b24711f53f9c req-5f2df8dd-a16b-45c8-80b6-640c246e063b service nova] Creating event network-vif-plugged:54432a46-1686-4c52-94a1-47829a97e1e1 for instance 7df857cc-3e6c-4b0b-910e-dd62869d64d1 on n-h1-852085-12 Oct 04 20:42:08.744118 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-136679ba-8a23-4df9-8eb5-b24711f53f9c req-5f2df8dd-a16b-45c8-80b6-640c246e063b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099932 Oct 04 20:42:08.746154 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 649/1319] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:08.760931 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7ecef4e3-3e6f-4a05-a48b-20e91a36f998 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:08.763099 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7ecef4e3-3e6f-4a05-a48b-20e91a36f998 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:08.779087 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ecef4e3-3e6f-4a05-a48b-20e91a36f998 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.780825 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ecef4e3-3e6f-4a05-a48b-20e91a36f998 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.789885 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ecef4e3-3e6f-4a05-a48b-20e91a36f998 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.799419 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ecef4e3-3e6f-4a05-a48b-20e91a36f998 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.800500 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ecef4e3-3e6f-4a05-a48b-20e91a36f998 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.801311 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7ecef4e3-3e6f-4a05-a48b-20e91a36f998 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:09.820319 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7ecef4e3-3e6f-4a05-a48b-20e91a36f998 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:09.858948 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7ecef4e3-3e6f-4a05-a48b-20e91a36f998 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1313 microversion: 2.1 time: 1.110346 Oct 04 20:42:09.869849 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 650/1320] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:08 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1313 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:10.792291 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-d6874b6f-5a4f-47d5-be6e-9a2288931dc1 req-d8561422-f154-4357-b689-07e72ee97fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3b28cc-8307-4f7a-889b-ab08d068ec0e", "name": "network-vif-plugged", "status": "completed", "tag": "e7face03-f5ca-470d-ba1f-9b74713e1d67"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:10.827838 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-d6874b6f-5a4f-47d5-be6e-9a2288931dc1 req-d8561422-f154-4357-b689-07e72ee97fdb service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:10.840449 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-d6874b6f-5a4f-47d5-be6e-9a2288931dc1 req-d8561422-f154-4357-b689-07e72ee97fdb service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:10.842689 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-d6874b6f-5a4f-47d5-be6e-9a2288931dc1 req-d8561422-f154-4357-b689-07e72ee97fdb service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:10.878842 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-d6874b6f-5a4f-47d5-be6e-9a2288931dc1 req-d8561422-f154-4357-b689-07e72ee97fdb service nova] Creating event network-vif-plugged:e7face03-f5ca-470d-ba1f-9b74713e1d67 for instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e on n-h1-852085-12 Oct 04 20:42:10.897995 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-d6874b6f-5a4f-47d5-be6e-9a2288931dc1 req-d8561422-f154-4357-b689-07e72ee97fdb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112679 Oct 04 20:42:10.906757 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 651/1321] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:42:10.933572 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-002495cc-2d75-4b7e-9f7d-882a49319c02 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:10.936067 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-002495cc-2d75-4b7e-9f7d-882a49319c02 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:10.949634 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-002495cc-2d75-4b7e-9f7d-882a49319c02 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:10.960393 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-002495cc-2d75-4b7e-9f7d-882a49319c02 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:10.961645 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-002495cc-2d75-4b7e-9f7d-882a49319c02 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:10.963354 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-002495cc-2d75-4b7e-9f7d-882a49319c02 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:10.976602 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-002495cc-2d75-4b7e-9f7d-882a49319c02 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:10.977966 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-002495cc-2d75-4b7e-9f7d-882a49319c02 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:11.636187 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-002495cc-2d75-4b7e-9f7d-882a49319c02 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:11.698490 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-002495cc-2d75-4b7e-9f7d-882a49319c02 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1313 microversion: 2.1 time: 0.784536 Oct 04 20:42:11.711486 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 652/1322] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:10 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1313 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:12.752747 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d0fbadf0-895a-4c8b-aa86-16dbfc6601e2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:12.760884 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d0fbadf0-895a-4c8b-aa86-16dbfc6601e2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:12.794370 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0fbadf0-895a-4c8b-aa86-16dbfc6601e2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:12.803737 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0fbadf0-895a-4c8b-aa86-16dbfc6601e2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:12.808649 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0fbadf0-895a-4c8b-aa86-16dbfc6601e2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:12.813964 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0fbadf0-895a-4c8b-aa86-16dbfc6601e2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:12.818725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0fbadf0-895a-4c8b-aa86-16dbfc6601e2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:12.824873 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d0fbadf0-895a-4c8b-aa86-16dbfc6601e2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:14.198639 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-48bb005e-0ee1-47ee-bc24-9fa2bcfd6f16 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 6.625416 Oct 04 20:42:14.252678 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 671/1323] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 6685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:14.966604 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d0fbadf0-895a-4c8b-aa86-16dbfc6601e2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:15.004163 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d0fbadf0-895a-4c8b-aa86-16dbfc6601e2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1463 microversion: 2.1 time: 2.264441 Oct 04 20:42:15.018523 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 653/1324] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:12 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1463 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:15.078433 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4d0a0445-4deb-47a2-b261-ef5bfd24e10f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:15.086603 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4d0a0445-4deb-47a2-b261-ef5bfd24e10f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:15.140681 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4d0a0445-4deb-47a2-b261-ef5bfd24e10f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:15.143995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4d0a0445-4deb-47a2-b261-ef5bfd24e10f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:15.147592 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4d0a0445-4deb-47a2-b261-ef5bfd24e10f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:15.152772 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4d0a0445-4deb-47a2-b261-ef5bfd24e10f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:15.155854 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4d0a0445-4deb-47a2-b261-ef5bfd24e10f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:15.172155 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4d0a0445-4deb-47a2-b261-ef5bfd24e10f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:15.243914 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-64775ca2-a97c-408e-b27a-99b0b0ff2492 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee13af0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:15.482382 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-64775ca2-a97c-408e-b27a-99b0b0ff2492 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.260432 Oct 04 20:42:15.484429 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 654/1325] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:15 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:16.363558 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4d0a0445-4deb-47a2-b261-ef5bfd24e10f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:16.413321 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4d0a0445-4deb-47a2-b261-ef5bfd24e10f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1463 microversion: 2.1 time: 1.360206 Oct 04 20:42:16.418734 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 672/1326] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:15 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1463 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:16.518114 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c5adec4d-d687-4783-8140-6ca2a2df3576 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee2b8b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:16.724698 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c5adec4d-d687-4783-8140-6ca2a2df3576 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.214217 Oct 04 20:42:16.726555 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 655/1327] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:16 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:17.508139 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1601839193", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ad3b28cc-8307-4f7a-889b-ab08d068ec0e"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:17.753858 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cd58077f-3a65-4eb3-9164-870148044c6a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee76ca0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:17.778730 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:17.995930 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cd58077f-3a65-4eb3-9164-870148044c6a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.245492 Oct 04 20:42:18.009318 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 656/1328] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:17 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:19.032638 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=8 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:19.052032 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d8628e40-b947-4ade-9c89-f6e2e112afff tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee33af0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:19.239369 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d8628e40-b947-4ade-9c89-f6e2e112afff tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.206882 Oct 04 20:42:19.251387 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:42:19.253063 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:42:19.254966 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:42:19.256302 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:42:19.257524 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 657/1329] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:19 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:19.262954 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:42:19.296110 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:19.308737 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:19.310240 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:19.312239 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:19.317648 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:19.318652 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:19.400861 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Getting quotas for project e9fae788056d4b8e9d45e8988fc6920f. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:19.420908 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Getting quotas for user edcdbeebe55e41cb9072a7561e0988f8 and project e9fae788056d4b8e9d45e8988fc6920f. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:19.498096 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Going to run 1 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:42:19.498096 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:42:19.807852 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a4148b23-d05b-4b4a-b566-d51362f75a8c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.325320 Oct 04 20:42:19.809491 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 673/1330] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:42:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:42:19.837507 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-73383d64-8cac-4d1b-aa48-738dc8d6e1d6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:19.840657 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-73383d64-8cac-4d1b-aa48-738dc8d6e1d6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:20.267433 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-73383d64-8cac-4d1b-aa48-738dc8d6e1d6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:20.274509 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3361548b-8f7a-43e3-bb75-0c0433907383 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28ca60>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:20.313984 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-73383d64-8cac-4d1b-aa48-738dc8d6e1d6 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1214 microversion: 2.1 time: 0.489314 Oct 04 20:42:20.328535 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 658/1331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:19 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1214 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:20.579611 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3361548b-8f7a-43e3-bb75-0c0433907383 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.319072 Oct 04 20:42:20.621256 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 674/1332] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:20 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:21.366032 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1aa49c4e-1fe8-4b5e-83a9-976b43478e27 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:21.387559 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-1aa49c4e-1fe8-4b5e-83a9-976b43478e27 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:21.666478 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0ee373fb-b78c-478f-9688-56823cf27e85 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77efa6aca0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:21.763973 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-1aa49c4e-1fe8-4b5e-83a9-976b43478e27 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:21.802132 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1aa49c4e-1fe8-4b5e-83a9-976b43478e27 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1214 microversion: 2.1 time: 0.452952 Oct 04 20:42:21.832457 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 659/1333] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:21 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1214 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:21.869343 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0ee373fb-b78c-478f-9688-56823cf27e85 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.251726 Oct 04 20:42:21.877290 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 675/1334] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:21 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:22.880694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d9201fea-74af-417c-b773-4c31f88fb47e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:22.881804 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d9201fea-74af-417c-b773-4c31f88fb47e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:22.898897 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4109a849-286d-4db2-a2c8-53d3a1191b6c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef290af0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:23.156535 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4109a849-286d-4db2-a2c8-53d3a1191b6c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.242583 Oct 04 20:42:23.161226 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 676/1335] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:22 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:23.530579 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d9201fea-74af-417c-b773-4c31f88fb47e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:23.593399 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d9201fea-74af-417c-b773-4c31f88fb47e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1214 microversion: 2.1 time: 0.722162 Oct 04 20:42:23.597117 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 660/1336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:22 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1214 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:24.191830 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c0cc2a8a-2cd0-4777-b738-e1d06d472405 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee33940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:24.399487 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c0cc2a8a-2cd0-4777-b738-e1d06d472405 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.217309 Oct 04 20:42:24.400549 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 661/1337] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:24 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:24.664386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9475093a-12df-40df-80f5-933c9651044a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:24.667953 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9475093a-12df-40df-80f5-933c9651044a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:24.706831 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-141ab6d0-c26d-4873-9878-9ffea91848d5 tempest-FlavorsV2NegativeTest-1927967268 tempest-FlavorsV2NegativeTest-1927967268-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:24.712773 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9475093a-12df-40df-80f5-933c9651044a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:24.721617 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9475093a-12df-40df-80f5-933c9651044a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:24.723345 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9475093a-12df-40df-80f5-933c9651044a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:24.728108 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9475093a-12df-40df-80f5-933c9651044a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:24.728802 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9475093a-12df-40df-80f5-933c9651044a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:24.734940 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9475093a-12df-40df-80f5-933c9651044a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:24.833287 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-141ab6d0-c26d-4873-9878-9ffea91848d5 tempest-FlavorsV2NegativeTest-1927967268 tempest-FlavorsV2NegativeTest-1927967268-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.649234 Oct 04 20:42:24.833287 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 677/1338] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:24.999412 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9475093a-12df-40df-80f5-933c9651044a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:25.016276 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9475093a-12df-40df-80f5-933c9651044a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1210 microversion: 2.1 time: 0.378468 Oct 04 20:42:25.019245 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 662/1339] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:24 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1210 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:25.472904 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-80d6834c-6988-415b-8e38-b8d03f237329 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2fef70>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:26.072914 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bb38fd9c-fb63-4c07-9615-cedc72f23225 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:26.074033 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-bb38fd9c-fb63-4c07-9615-cedc72f23225 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:26.102011 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bb38fd9c-fb63-4c07-9615-cedc72f23225 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:26.102822 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bb38fd9c-fb63-4c07-9615-cedc72f23225 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:26.116491 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bb38fd9c-fb63-4c07-9615-cedc72f23225 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:26.117979 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bb38fd9c-fb63-4c07-9615-cedc72f23225 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:26.119292 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bb38fd9c-fb63-4c07-9615-cedc72f23225 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:26.120406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bb38fd9c-fb63-4c07-9615-cedc72f23225 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:26.357808 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bb38fd9c-fb63-4c07-9615-cedc72f23225 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:26.397351 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bb38fd9c-fb63-4c07-9615-cedc72f23225 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1266 microversion: 2.1 time: 0.333595 Oct 04 20:42:26.403098 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 663/1340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:26 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:27.459839 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-58c1ba36-fb11-4546-bfa6-1798f82a6633 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:27.464630 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-58c1ba36-fb11-4546-bfa6-1798f82a6633 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:27.497792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-58c1ba36-fb11-4546-bfa6-1798f82a6633 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:27.497792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-58c1ba36-fb11-4546-bfa6-1798f82a6633 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:27.497792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-58c1ba36-fb11-4546-bfa6-1798f82a6633 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:27.497792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-58c1ba36-fb11-4546-bfa6-1798f82a6633 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:27.497792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-58c1ba36-fb11-4546-bfa6-1798f82a6633 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:27.497792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-58c1ba36-fb11-4546-bfa6-1798f82a6633 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:28.333577 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-80d6834c-6988-415b-8e38-b8d03f237329 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 2.909751 Oct 04 20:42:28.342137 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 678/1341] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:25 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 2924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:28.618128 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-302f9f8c-ded7-4861-884c-f5a341fc1814 tempest-FlavorsV2NegativeTest-1927967268 tempest-FlavorsV2NegativeTest-1927967268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1418519954", "imageRef": "28587185-de65-4304-b05a-781c0cd91ba7", "flavorRef": "452"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:28.809304 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-302f9f8c-ded7-4861-884c-f5a341fc1814 tempest-FlavorsV2NegativeTest-1927967268 tempest-FlavorsV2NegativeTest-1927967268-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:28.906813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-58c1ba36-fb11-4546-bfa6-1798f82a6633 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:28.956564 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-58c1ba36-fb11-4546-bfa6-1798f82a6633 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1274 microversion: 2.1 time: 1.520743 Oct 04 20:42:28.972844 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 664/1342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:27 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1274 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:29.368994 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:29.373110 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=13 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:29.388752 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-549b7f97-bfa5-4077-9f98-67bce75a762d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef028670>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:29.449475 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:29.585133 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-549b7f97-bfa5-4077-9f98-67bce75a762d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.227257 Oct 04 20:42:29.595458 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 665/1343] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:29 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:30.007876 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-344899aa-c4fc-4e04-8d46-75e652a721d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:30.009565 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-344899aa-c4fc-4e04-8d46-75e652a721d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:30.061483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-344899aa-c4fc-4e04-8d46-75e652a721d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:30.063024 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-344899aa-c4fc-4e04-8d46-75e652a721d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:30.064059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-344899aa-c4fc-4e04-8d46-75e652a721d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:30.070989 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-344899aa-c4fc-4e04-8d46-75e652a721d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:30.081547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-344899aa-c4fc-4e04-8d46-75e652a721d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:30.082403 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-344899aa-c4fc-4e04-8d46-75e652a721d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:30.670203 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-344899aa-c4fc-4e04-8d46-75e652a721d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:30.727816 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-344899aa-c4fc-4e04-8d46-75e652a721d1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1272 microversion: 2.1 time: 0.723004 Oct 04 20:42:30.735838 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 666/1344] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:29 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1272 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:30.763349 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5c510bc5-c634-497b-b537-c111351125ce tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef028940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:31.035408 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5c510bc5-c634-497b-b537-c111351125ce tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.288418 Oct 04 20:42:31.051227 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 667/1345] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:30 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:31.224204 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-302f9f8c-ded7-4861-884c-f5a341fc1814 tempest-FlavorsV2NegativeTest-1927967268 tempest-FlavorsV2NegativeTest-1927967268-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-302f9f8c-ded7-4861-884c-f5a341fc1814 tempest-FlavorsV2NegativeTest-1927967268 tempest-FlavorsV2NegativeTest-1927967268-project] Request method failure captured: Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 143 Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJquzQAc3bouxXwES2PYNRPR4kqGc0BiCqr-U6j-vDqPwgvAy3hdYOoS9Li6afkoywGHXI2bpWWT6Mp4anDqlejNd61UuAEw2jtsbURy8jVJO-FVs_QjwoQqZG-MImqCe35PElsbPPJmFNUdhI5KxmwQZPz28yQGL_bNCu5y7PyaFdA Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: ba3c3dc4e3f14807b3aad28237f03a4e Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-FlavorsV2NegativeTest-1927967268 Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ba3c3dc4e3f14807b3aad28237f03a4e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba3c3dc4e3f14807b3aad28237f03a4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba3c3dc4e3f14807b3aad28237f03a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ba3c3dc4e3f14807b3aad28237f03a4e"}]}] Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-FlavorsV2NegativeTest-1927967268 Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: ba3c3dc4e3f14807b3aad28237f03a4e Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1927967268 Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-FlavorsV2NegativeTest-1927967268-project Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: abc7cb2544cb41e7b900d5f23e4de0ec Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-FlavorsV2NegativeTest-1927967268-project Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1418519954", "imageRef": "28587185-de65-4304-b05a-781c0cd91ba7", "flavorRef": "452"}} Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: exception: Flavor's memory is too small for requested image. Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1418519954', 'imageRef': '28587185-de65-4304-b05a-781c0cd91ba7', 'flavorRef': '452'}}} Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:31.228569 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:42:31.247194 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-302f9f8c-ded7-4861-884c-f5a341fc1814 tempest-FlavorsV2NegativeTest-1927967268 tempest-FlavorsV2NegativeTest-1927967268-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:31.252955 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-302f9f8c-ded7-4861-884c-f5a341fc1814 tempest-FlavorsV2NegativeTest-1927967268 tempest-FlavorsV2NegativeTest-1927967268-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 2.621286 Oct 04 20:42:31.252955 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 679/1346] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:42:28 2022] POST /compute/v2.1/servers => generated 93 bytes in 2641 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 20:42:31.777597 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f2ff2426-3c6e-4d5f-a1d8-6ef5506bf904 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:31.779330 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f2ff2426-3c6e-4d5f-a1d8-6ef5506bf904 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:31.815327 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=58 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:31.822804 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f2ff2426-3c6e-4d5f-a1d8-6ef5506bf904 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:31.825183 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f2ff2426-3c6e-4d5f-a1d8-6ef5506bf904 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:31.826041 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f2ff2426-3c6e-4d5f-a1d8-6ef5506bf904 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:31.830991 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f2ff2426-3c6e-4d5f-a1d8-6ef5506bf904 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:31.835787 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f2ff2426-3c6e-4d5f-a1d8-6ef5506bf904 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:31.839675 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f2ff2426-3c6e-4d5f-a1d8-6ef5506bf904 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:32.067079 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-647e81aa-4f09-4c8f-999d-fca19190eb69 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28c790>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:32.874804 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f2ff2426-3c6e-4d5f-a1d8-6ef5506bf904 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:32.924167 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-647e81aa-4f09-4c8f-999d-fca19190eb69 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.862628 Oct 04 20:42:32.927560 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f2ff2426-3c6e-4d5f-a1d8-6ef5506bf904 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1272 microversion: 2.1 time: 1.157647 Oct 04 20:42:32.946041 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 680/1347] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:32 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:32.960985 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 668/1348] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:31 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1272 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:33.962432 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-92280038-283b-4c68-a219-a1738f18939f tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2909d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:33.995107 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9d2751f8-0098-4521-bfe6-ab782e03036d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:33.996066 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9d2751f8-0098-4521-bfe6-ab782e03036d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:34.037266 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=6 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:34.081311 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d2751f8-0098-4521-bfe6-ab782e03036d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:34.086616 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d2751f8-0098-4521-bfe6-ab782e03036d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:34.090356 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d2751f8-0098-4521-bfe6-ab782e03036d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:34.094638 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d2751f8-0098-4521-bfe6-ab782e03036d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:34.106190 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d2751f8-0098-4521-bfe6-ab782e03036d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:34.112567 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d2751f8-0098-4521-bfe6-ab782e03036d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:34.134401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=76 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:34.339370 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-92280038-283b-4c68-a219-a1738f18939f tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.379996 Oct 04 20:42:34.343540 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 681/1349] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:33 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:35.412114 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-eb1cda18-7363-491a-868f-60b966fcd0b8 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2905e0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:35.729880 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-eb1cda18-7363-491a-868f-60b966fcd0b8 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.360693 Oct 04 20:42:35.764142 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 682/1350] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:35 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:36.492484 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9d2751f8-0098-4521-bfe6-ab782e03036d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:36.554182 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9d2751f8-0098-4521-bfe6-ab782e03036d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 2.556450 Oct 04 20:42:36.558824 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 669/1351] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:33 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 2577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:36.781704 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-368c3087-4742-404a-a917-4525a0481019 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef28c3a0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:36.978895 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-368c3087-4742-404a-a917-4525a0481019 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.219115 Oct 04 20:42:37.012196 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 683/1352] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:36 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:37.624730 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-35ecb351-7319-458d-ba25-36c34b8389bd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:37.633776 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-35ecb351-7319-458d-ba25-36c34b8389bd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:37.675516 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-35ecb351-7319-458d-ba25-36c34b8389bd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:37.703973 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-35ecb351-7319-458d-ba25-36c34b8389bd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:37.705492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-35ecb351-7319-458d-ba25-36c34b8389bd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:37.707907 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-35ecb351-7319-458d-ba25-36c34b8389bd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:37.709258 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-35ecb351-7319-458d-ba25-36c34b8389bd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:37.710480 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-35ecb351-7319-458d-ba25-36c34b8389bd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:38.037518 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a5c24f1b-f2c1-4803-b031-6f22671e3983 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef209550>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:38.474512 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a5c24f1b-f2c1-4803-b031-6f22671e3983 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.454080 Oct 04 20:42:38.498709 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 684/1353] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:38 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:39.535472 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-632063b9-4b1f-45c9-be7a-f74f4bace803 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2fe550>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:39.579064 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:39.772600 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-632063b9-4b1f-45c9-be7a-f74f4bace803 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.243258 Oct 04 20:42:39.780942 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 685/1354] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:39 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:40.719750 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-35ecb351-7319-458d-ba25-36c34b8389bd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:40.744464 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-35ecb351-7319-458d-ba25-36c34b8389bd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 3.142206 Oct 04 20:42:40.749160 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 670/1355] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:37 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 3148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:40.808546 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-288503cb-5616-4825-b3e1-6e73b1600c7a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef209c10>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:40.964104 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-288503cb-5616-4825-b3e1-6e73b1600c7a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.164462 Oct 04 20:42:40.979301 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 686/1356] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:40 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:41.806787 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2f6189ec-8358-4c44-9c2c-7886bd832c51 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:41.808466 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2f6189ec-8358-4c44-9c2c-7886bd832c51 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:41.832772 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2f6189ec-8358-4c44-9c2c-7886bd832c51 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:41.834963 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2f6189ec-8358-4c44-9c2c-7886bd832c51 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:41.839951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2f6189ec-8358-4c44-9c2c-7886bd832c51 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:41.842402 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2f6189ec-8358-4c44-9c2c-7886bd832c51 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:41.852738 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2f6189ec-8358-4c44-9c2c-7886bd832c51 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:41.853722 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2f6189ec-8358-4c44-9c2c-7886bd832c51 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:42.975274 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c0727d9e-ca9f-41fe-b7af-40f9c1d1da69 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Action: 'create', calling method: .version_select at 0x7f77eedad430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-960399026", "metadata": {"Type": "work"}}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:43.654270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-2f6189ec-8358-4c44-9c2c-7886bd832c51 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:43.705901 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2f6189ec-8358-4c44-9c2c-7886bd832c51 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 1.918241 Oct 04 20:42:43.714758 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 687/1357] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:41 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:43.735998 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9320f49f-dc8e-4963-a66d-5f01d63c71d8 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef209790>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:44.032823 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9320f49f-dc8e-4963-a66d-5f01d63c71d8 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.311314 Oct 04 20:42:44.047024 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 688/1358] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:43 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:44.792115 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-44d2d117-a91d-4590-b8c2-49e6c22bef1a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:44.807596 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-44d2d117-a91d-4590-b8c2-49e6c22bef1a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:44.865558 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-44d2d117-a91d-4590-b8c2-49e6c22bef1a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:44.870068 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-44d2d117-a91d-4590-b8c2-49e6c22bef1a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:44.871639 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-44d2d117-a91d-4590-b8c2-49e6c22bef1a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:44.873467 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-44d2d117-a91d-4590-b8c2-49e6c22bef1a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:44.877616 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-44d2d117-a91d-4590-b8c2-49e6c22bef1a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:44.886696 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-44d2d117-a91d-4590-b8c2-49e6c22bef1a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:46.511273 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c0727d9e-ca9f-41fe-b7af-40f9c1d1da69 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 5.252687 Oct 04 20:42:46.515520 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 671/1359] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 4 20:42:41 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 5258 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 20:42:46.533115 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-63576440-f1b7-4b23-a112-fd8debcebb47 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee33af0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:46.808038 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-63576440-f1b7-4b23-a112-fd8debcebb47 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.285957 Oct 04 20:42:46.810842 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 672/1360] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:46 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:46.879187 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dbe3fc3a-5cfe-4e88-bff1-8249963c3242 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77eed98e50>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:47.004260 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-dbe3fc3a-5cfe-4e88-bff1-8249963c3242 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 200 len: 352 microversion: 2.1 time: 0.179564 Oct 04 20:42:47.006218 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 673/1361] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:42:46 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 352 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:47.328400 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-e965c883-c9d4-4aba-a8f1-02a56bedd1e4 req-b2c42af1-8478-4cc9-aa11-0fc077c2e71d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d", "tag": "ecc4bf5f-7d12-4714-83d5-e6b2d3d3cbb3"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:47.516675 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-e965c883-c9d4-4aba-a8f1-02a56bedd1e4 req-b2c42af1-8478-4cc9-aa11-0fc077c2e71d service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:47.528275 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-e965c883-c9d4-4aba-a8f1-02a56bedd1e4 req-b2c42af1-8478-4cc9-aa11-0fc077c2e71d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:47.533087 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-e965c883-c9d4-4aba-a8f1-02a56bedd1e4 req-b2c42af1-8478-4cc9-aa11-0fc077c2e71d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:47.590863 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-e965c883-c9d4-4aba-a8f1-02a56bedd1e4 req-b2c42af1-8478-4cc9-aa11-0fc077c2e71d service nova] Creating event network-changed:ecc4bf5f-7d12-4714-83d5-e6b2d3d3cbb3 for instance 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d on n-h1-852085-12 Oct 04 20:42:47.650601 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-e965c883-c9d4-4aba-a8f1-02a56bedd1e4 req-b2c42af1-8478-4cc9-aa11-0fc077c2e71d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.336285 Oct 04 20:42:47.661222 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 674/1362] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:47.858877 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ced91304-9cf4-4670-9cd8-9d98ad0bb1fa tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee8e8b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:48.066366 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ced91304-9cf4-4670-9cd8-9d98ad0bb1fa tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.226390 Oct 04 20:42:48.071347 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 675/1363] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:47 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:48.091296 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-44d2d117-a91d-4590-b8c2-49e6c22bef1a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:48.131904 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-44d2d117-a91d-4590-b8c2-49e6c22bef1a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 3.349313 Oct 04 20:42:48.162231 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 689/1364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:44 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 3385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:48.180045 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6e9a14c1-5138-4eb8-9b6b-7e1f2586d18a tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77efa6a940>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:48.776309 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6e9a14c1-5138-4eb8-9b6b-7e1f2586d18a tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 200 len: 352 microversion: 2.1 time: 0.612502 Oct 04 20:42:48.782214 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 690/1365] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:42:48 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 352 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:48.989450 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2138270217", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:49.103874 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-961e3277-dbc3-492d-891d-de7825ef280d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f7582430>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:49.353023 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:49.419176 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-961e3277-dbc3-492d-891d-de7825ef280d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.329227 Oct 04 20:42:49.420302 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 691/1366] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:49 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:49.453094 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4afa0681-3506-4c60-975e-a8be8d2fb621 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:49.454279 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4afa0681-3506-4c60-975e-a8be8d2fb621 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:49.512825 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4afa0681-3506-4c60-975e-a8be8d2fb621 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:49.513764 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4afa0681-3506-4c60-975e-a8be8d2fb621 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:49.514576 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4afa0681-3506-4c60-975e-a8be8d2fb621 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:49.523602 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4afa0681-3506-4c60-975e-a8be8d2fb621 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:49.529405 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4afa0681-3506-4c60-975e-a8be8d2fb621 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:49.533294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4afa0681-3506-4c60-975e-a8be8d2fb621 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:51.140834 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4afa0681-3506-4c60-975e-a8be8d2fb621 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:51.204347 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4afa0681-3506-4c60-975e-a8be8d2fb621 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 1.773402 Oct 04 20:42:51.209428 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 692/1367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:49 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:51.305089 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-58ff2e57-8d87-4fee-b152-b24d10b6f70a tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77f7583820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:51.454791 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:42:51.455780 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:42:51.456561 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:42:51.457703 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:42:51.463881 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:42:51.530658 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:51.531577 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:51.537821 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:51.537821 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:51.537821 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:51.552822 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:51.588150 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-58ff2e57-8d87-4fee-b152-b24d10b6f70a tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 200 len: 352 microversion: 2.1 time: 0.317305 Oct 04 20:42:51.604783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Getting quotas for project baa9bc0601f141e48e1b5f001769d221. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:51.608277 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 693/1368] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:42:51 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 352 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:51.625867 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4ae3f1b8-e533-4327-bf0c-e7d98d4c4810 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f7583ca0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:51.644667 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Getting quotas for user c7677d259d034a68aaba770506475f73 and project baa9bc0601f141e48e1b5f001769d221. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:51.796932 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:42:51.802207 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4ae3f1b8-e533-4327-bf0c-e7d98d4c4810 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.183066 Oct 04 20:42:51.803374 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 694/1369] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:51 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:51.837455 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:42:52.174590 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ec4458b3-9537-4e9b-a2f3-d6fc68418eb7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.100671 Oct 04 20:42:52.201423 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 676/1370] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:42:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:42:52.211755 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3f39abad-63a9-4b9e-982e-c2569ef33a86 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:52.216173 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3f39abad-63a9-4b9e-982e-c2569ef33a86 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:52.265455 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bf9c2df4-e927-4cbf-a4e0-8dcc9bb1e4ac tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:52.269864 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-bf9c2df4-e927-4cbf-a4e0-8dcc9bb1e4ac tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:52.295416 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bf9c2df4-e927-4cbf-a4e0-8dcc9bb1e4ac tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:52.296483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bf9c2df4-e927-4cbf-a4e0-8dcc9bb1e4ac tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:52.297240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bf9c2df4-e927-4cbf-a4e0-8dcc9bb1e4ac tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:52.298633 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bf9c2df4-e927-4cbf-a4e0-8dcc9bb1e4ac tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:52.299516 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bf9c2df4-e927-4cbf-a4e0-8dcc9bb1e4ac tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:52.300484 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bf9c2df4-e927-4cbf-a4e0-8dcc9bb1e4ac tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:52.642412 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3f39abad-63a9-4b9e-982e-c2569ef33a86 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:52.661865 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3f39abad-63a9-4b9e-982e-c2569ef33a86 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1217 microversion: 2.1 time: 0.464279 Oct 04 20:42:52.690692 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 695/1371] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:52 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1217 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:52.723940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-974d30e8-f913-4e84-8324-192ee4d36eaa tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77f7583d30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:53.010949 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-974d30e8-f913-4e84-8324-192ee4d36eaa tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 200 len: 353 microversion: 2.1 time: 0.311958 Oct 04 20:42:53.013335 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 696/1372] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:42:52 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 353 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:53.034419 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dea07882-5f23-4e57-9b0b-abbf72d56163 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f7583a60>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:53.091801 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bf9c2df4-e927-4cbf-a4e0-8dcc9bb1e4ac tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:53.124596 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bf9c2df4-e927-4cbf-a4e0-8dcc9bb1e4ac tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 0.866639 Oct 04 20:42:53.130493 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 677/1373] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:52 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:53.133820 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-dea07882-5f23-4e57-9b0b-abbf72d56163 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.118219 Oct 04 20:42:53.135432 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 697/1374] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:53 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:53.160548 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-78ced282-0c07-49e9-959d-664847188047 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77eee133a0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:53.297353 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-78ced282-0c07-49e9-959d-664847188047 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 200 len: 353 microversion: 2.1 time: 0.164203 Oct 04 20:42:53.298457 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 678/1375] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:42:53 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:53.334931 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bfc31941-7ac1-446d-9c27-f1371d650efd tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77f7583430>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:53.730262 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-69eb163b-6b3a-422c-8e9f-bd56489ec6ad tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:53.732888 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-69eb163b-6b3a-422c-8e9f-bd56489ec6ad tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:54.048240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-69eb163b-6b3a-422c-8e9f-bd56489ec6ad tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:54.102030 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-69eb163b-6b3a-422c-8e9f-bd56489ec6ad tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1217 microversion: 2.1 time: 0.388341 Oct 04 20:42:54.135321 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 679/1376] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:53 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1217 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:54.231250 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7a578cf4-fa70-4bb2-a7bb-58e6f712c669 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eed8e9d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:54.594528 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bfc31941-7ac1-446d-9c27-f1371d650efd tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 202 len: 0 microversion: 2.1 time: 1.273372 Oct 04 20:42:54.604113 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 698/1377] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:42:53 2022] DELETE /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 0 bytes in 1285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:42:54.628270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f4a02226-6c91-43c6-ba0d-547e06098123 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:54.629135 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7a578cf4-fa70-4bb2-a7bb-58e6f712c669 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.446298 Oct 04 20:42:54.647867 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f4a02226-6c91-43c6-ba0d-547e06098123 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:54.648450 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 680/1378] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:54 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:54.672783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5165a0fe-7b67-4b62-a8f9-c0aea5009910 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77eedf60d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:54.679663 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f4a02226-6c91-43c6-ba0d-547e06098123 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.774679 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f4a02226-6c91-43c6-ba0d-547e06098123 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.774679 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f4a02226-6c91-43c6-ba0d-547e06098123 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.774679 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f4a02226-6c91-43c6-ba0d-547e06098123 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.774679 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f4a02226-6c91-43c6-ba0d-547e06098123 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.774679 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f4a02226-6c91-43c6-ba0d-547e06098123 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.939708 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5165a0fe-7b67-4b62-a8f9-c0aea5009910 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 200 len: 352 microversion: 2.1 time: 0.288853 Oct 04 20:42:54.941441 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 681/1379] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:42:54 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 352 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:55.180684 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8d5827a0-ca3c-4f6a-9d31-d03d3d929ade tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:55.182281 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8d5827a0-ca3c-4f6a-9d31-d03d3d929ade tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:55.384647 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f4a02226-6c91-43c6-ba0d-547e06098123 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:55.425229 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f4a02226-6c91-43c6-ba0d-547e06098123 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 0.817384 Oct 04 20:42:55.444966 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 699/1380] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:54 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:55.446845 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8d5827a0-ca3c-4f6a-9d31-d03d3d929ade tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:55.468408 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8d5827a0-ca3c-4f6a-9d31-d03d3d929ade tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1217 microversion: 2.1 time: 0.304422 Oct 04 20:42:55.472361 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 682/1381] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:55 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1217 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:55.688866 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-adab3f63-9884-4562-93a3-1452333d563a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f7582d30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:55.951213 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-adab3f63-9884-4562-93a3-1452333d563a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.276325 Oct 04 20:42:55.952307 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 700/1382] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:55 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:55.969340 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-114075c1-4ab8-4e0b-a2b1-2b18da97fb1a tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77eed8e940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:56.247016 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-114075c1-4ab8-4e0b-a2b1-2b18da97fb1a tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 200 len: 352 microversion: 2.1 time: 0.285123 Oct 04 20:42:56.259727 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 683/1383] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:42:55 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 352 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:56.492450 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c5ff4b3f-fab7-4741-ac95-e556a8b9dfa4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:56.493203 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c5ff4b3f-fab7-4741-ac95-e556a8b9dfa4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:56.516981 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c03336bf-8681-415b-8d8e-67f102eca868 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:56.518326 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c03336bf-8681-415b-8d8e-67f102eca868 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:56.528837 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5ff4b3f-fab7-4741-ac95-e556a8b9dfa4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.531499 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5ff4b3f-fab7-4741-ac95-e556a8b9dfa4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.537395 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5ff4b3f-fab7-4741-ac95-e556a8b9dfa4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.541904 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5ff4b3f-fab7-4741-ac95-e556a8b9dfa4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.542527 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5ff4b3f-fab7-4741-ac95-e556a8b9dfa4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.544225 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5ff4b3f-fab7-4741-ac95-e556a8b9dfa4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.890919 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c03336bf-8681-415b-8d8e-67f102eca868 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:56.961886 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c03336bf-8681-415b-8d8e-67f102eca868 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1217 microversion: 2.1 time: 0.452595 Oct 04 20:42:56.993883 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 684/1384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:56 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1217 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:57.042642 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-34c381d9-0bb8-4c4e-84be-53a14a879799 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee13b80>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:57.227920 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c5ff4b3f-fab7-4741-ac95-e556a8b9dfa4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:57.248506 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-34c381d9-0bb8-4c4e-84be-53a14a879799 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.251945 Oct 04 20:42:57.256944 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 685/1385] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:56 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:57.259094 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c5ff4b3f-fab7-4741-ac95-e556a8b9dfa4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 0.775693 Oct 04 20:42:57.265648 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 701/1386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:56 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:57.290855 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c0e17346-2b72-40bc-84eb-a4a854e920cd tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77eed98670>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:57.476356 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c0e17346-2b72-40bc-84eb-a4a854e920cd tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 200 len: 352 microversion: 2.1 time: 0.205109 Oct 04 20:42:57.491002 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 686/1387] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:42:57 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 352 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:58.033664 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2dcf6581-fe1e-4498-ba0f-0b3d3341ca1e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:58.041540 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2dcf6581-fe1e-4498-ba0f-0b3d3341ca1e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:58.113258 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2dcf6581-fe1e-4498-ba0f-0b3d3341ca1e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:58.114243 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2dcf6581-fe1e-4498-ba0f-0b3d3341ca1e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:58.115094 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2dcf6581-fe1e-4498-ba0f-0b3d3341ca1e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:58.117695 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2dcf6581-fe1e-4498-ba0f-0b3d3341ca1e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:58.131216 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2dcf6581-fe1e-4498-ba0f-0b3d3341ca1e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:58.132577 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2dcf6581-fe1e-4498-ba0f-0b3d3341ca1e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:58.284161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0625a3e5-1f9b-4c62-a50b-e24d79ca0c20 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eed42ca0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:58.489483 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-2dcf6581-fe1e-4498-ba0f-0b3d3341ca1e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:58.524115 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0625a3e5-1f9b-4c62-a50b-e24d79ca0c20 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.253710 Oct 04 20:42:58.524115 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 687/1388] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:58 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:58.533411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d40b5fbb-0c6f-433e-9e4b-b557139df605 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:58.535199 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d40b5fbb-0c6f-433e-9e4b-b557139df605 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:58.536588 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2dcf6581-fe1e-4498-ba0f-0b3d3341ca1e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1213 microversion: 2.1 time: 0.485569 Oct 04 20:42:58.549561 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d40b5fbb-0c6f-433e-9e4b-b557139df605 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:58.551186 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d40b5fbb-0c6f-433e-9e4b-b557139df605 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:58.552650 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d40b5fbb-0c6f-433e-9e4b-b557139df605 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:58.554681 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d40b5fbb-0c6f-433e-9e4b-b557139df605 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:58.555549 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 702/1389] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:58 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1213 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:58.556642 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d40b5fbb-0c6f-433e-9e4b-b557139df605 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:58.557775 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d40b5fbb-0c6f-433e-9e4b-b557139df605 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:58.603430 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a438d819-3b99-4325-bb12-a5896a0ddc60 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77f7582af0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:58.920232 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a438d819-3b99-4325-bb12-a5896a0ddc60 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 200 len: 352 microversion: 2.1 time: 0.362307 Oct 04 20:42:58.921127 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 703/1390] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:42:58 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 352 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:59.115711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d40b5fbb-0c6f-433e-9e4b-b557139df605 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:59.156316 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d40b5fbb-0c6f-433e-9e4b-b557139df605 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 0.622349 Oct 04 20:42:59.158203 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 688/1391] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:58 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:59.551471 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-78a8fcb3-5153-4186-b675-edc1b4f6b809 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77ef2095e0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:59.617720 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-522d54bd-d990-4e16-bfdd-0ef8e59cff5b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:59.617720 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-522d54bd-d990-4e16-bfdd-0ef8e59cff5b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:59.660929 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-522d54bd-d990-4e16-bfdd-0ef8e59cff5b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:59.662247 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-522d54bd-d990-4e16-bfdd-0ef8e59cff5b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:59.665303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-522d54bd-d990-4e16-bfdd-0ef8e59cff5b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:59.684386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-522d54bd-d990-4e16-bfdd-0ef8e59cff5b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:59.686722 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-522d54bd-d990-4e16-bfdd-0ef8e59cff5b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:59.687569 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-522d54bd-d990-4e16-bfdd-0ef8e59cff5b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:59.836381 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-78a8fcb3-5153-4186-b675-edc1b4f6b809 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.293514 Oct 04 20:42:59.840282 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 704/1392] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:59 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:59.947524 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cc709e9b-0999-4ae8-9189-6028fc36b253 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77f7582670>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:00.032639 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-522d54bd-d990-4e16-bfdd-0ef8e59cff5b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:00.072150 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-522d54bd-d990-4e16-bfdd-0ef8e59cff5b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1269 microversion: 2.1 time: 0.486971 Oct 04 20:43:00.075697 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 689/1393] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:59 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1269 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:43:00.106484 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cc709e9b-0999-4ae8-9189-6028fc36b253 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 200 len: 352 microversion: 2.1 time: 0.166230 Oct 04 20:43:00.115186 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 705/1394] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:42:59 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 352 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:43:00.214344 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d13926f9-cb34-4dfc-a8e9-1eda943134c0 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:00.229007 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d13926f9-cb34-4dfc-a8e9-1eda943134c0 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:00.261571 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d13926f9-cb34-4dfc-a8e9-1eda943134c0 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.262961 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d13926f9-cb34-4dfc-a8e9-1eda943134c0 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.264326 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d13926f9-cb34-4dfc-a8e9-1eda943134c0 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.270937 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d13926f9-cb34-4dfc-a8e9-1eda943134c0 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.272398 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d13926f9-cb34-4dfc-a8e9-1eda943134c0 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.273652 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d13926f9-cb34-4dfc-a8e9-1eda943134c0 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.874496 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4008b6e3-5d0e-4958-a403-4b2f68b672a8 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f7582f70>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:00.908182 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d13926f9-cb34-4dfc-a8e9-1eda943134c0 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:00.961252 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d13926f9-cb34-4dfc-a8e9-1eda943134c0 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 0.751385 Oct 04 20:43:00.972433 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 690/1395] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:00 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:01.091193 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4008b6e3-5d0e-4958-a403-4b2f68b672a8 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1454 microversion: 2.1 time: 0.230026 Oct 04 20:43:01.116644 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 706/1396] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:43:00 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1454 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:01.127577 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0b95bcd8-571b-4a00-b703-e08011ee8c79 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:01.131514 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-0b95bcd8-571b-4a00-b703-e08011ee8c79 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:01.138477 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fbded3a1-82bf-4cb7-9989-74e9ae96a8d1 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77f7583f70>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:01.166553 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0b95bcd8-571b-4a00-b703-e08011ee8c79 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:01.171231 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0b95bcd8-571b-4a00-b703-e08011ee8c79 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:01.178120 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0b95bcd8-571b-4a00-b703-e08011ee8c79 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:01.186029 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0b95bcd8-571b-4a00-b703-e08011ee8c79 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:01.191124 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0b95bcd8-571b-4a00-b703-e08011ee8c79 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:01.199598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-0b95bcd8-571b-4a00-b703-e08011ee8c79 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:01.437188 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fbded3a1-82bf-4cb7-9989-74e9ae96a8d1 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 200 len: 352 microversion: 2.1 time: 0.305094 Oct 04 20:43:01.438182 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 707/1397] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:43:01 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 352 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:01.581760 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:01.812037 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-0b95bcd8-571b-4a00-b703-e08011ee8c79 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:01.838926 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0b95bcd8-571b-4a00-b703-e08011ee8c79 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1275 microversion: 2.1 time: 0.723229 Oct 04 20:43:01.844471 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 691/1398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:01 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1275 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:02.022696 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-71f4429d-6d0a-4818-8b32-812a544f30d2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:02.028065 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-71f4429d-6d0a-4818-8b32-812a544f30d2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:02.059675 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-71f4429d-6d0a-4818-8b32-812a544f30d2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.063486 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-71f4429d-6d0a-4818-8b32-812a544f30d2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.068380 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-71f4429d-6d0a-4818-8b32-812a544f30d2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.076355 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-71f4429d-6d0a-4818-8b32-812a544f30d2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.077373 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-71f4429d-6d0a-4818-8b32-812a544f30d2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.078198 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-71f4429d-6d0a-4818-8b32-812a544f30d2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.135015 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-91ccfaa1-c6d6-4d51-b354-1c3826ca6b64 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee33550>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:02.358097 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-91ccfaa1-c6d6-4d51-b354-1c3826ca6b64 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1463 microversion: 2.1 time: 0.232794 Oct 04 20:43:02.376421 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 692/1399] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:43:02 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1463 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:43:02.397296 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-35a5b41f-eef0-4f15-9a8a-d90a367a5070 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eed8e670>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:02.653759 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:02.665763 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-35a5b41f-eef0-4f15-9a8a-d90a367a5070 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 200 len: 1463 microversion: 2.1 time: 0.278636 Oct 04 20:43:02.692926 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 693/1400] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:43:02 2022] GET /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 1463 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:43:02.739551 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-be81fe97-ee77-48de-9f44-63d6884ad607 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77eedf64c0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:02.981092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-71f4429d-6d0a-4818-8b32-812a544f30d2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.002285 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-71f4429d-6d0a-4818-8b32-812a544f30d2 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 0.988246 Oct 04 20:43:03.005556 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 708/1401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:02 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:03.016259 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b57a4d0f-50f8-4f6f-8839-ec1f12f86432 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:03.017801 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b57a4d0f-50f8-4f6f-8839-ec1f12f86432 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:03.038345 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-be81fe97-ee77-48de-9f44-63d6884ad607 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 200 len: 352 microversion: 2.1 time: 0.343829 Oct 04 20:43:03.048853 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 694/1402] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:43:02 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 352 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:03.060047 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6db64cb7-9bcd-4b3e-8d94-e5de43bc4cd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:03.060858 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6db64cb7-9bcd-4b3e-8d94-e5de43bc4cd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:03.064373 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b57a4d0f-50f8-4f6f-8839-ec1f12f86432 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.065229 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b57a4d0f-50f8-4f6f-8839-ec1f12f86432 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.065436 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b57a4d0f-50f8-4f6f-8839-ec1f12f86432 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.066180 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b57a4d0f-50f8-4f6f-8839-ec1f12f86432 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.075112 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b57a4d0f-50f8-4f6f-8839-ec1f12f86432 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.076529 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b57a4d0f-50f8-4f6f-8839-ec1f12f86432 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.086469 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:03.094902 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6db64cb7-9bcd-4b3e-8d94-e5de43bc4cd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.098330 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6db64cb7-9bcd-4b3e-8d94-e5de43bc4cd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.109776 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6db64cb7-9bcd-4b3e-8d94-e5de43bc4cd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.119763 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6db64cb7-9bcd-4b3e-8d94-e5de43bc4cd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.133073 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6db64cb7-9bcd-4b3e-8d94-e5de43bc4cd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.134188 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6db64cb7-9bcd-4b3e-8d94-e5de43bc4cd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.636915 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6db64cb7-9bcd-4b3e-8d94-e5de43bc4cd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.674219 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6db64cb7-9bcd-4b3e-8d94-e5de43bc4cd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1275 microversion: 2.1 time: 0.623512 Oct 04 20:43:03.685988 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 695/1403] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:03 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1275 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:04.057518 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2b0b12ba-51e8-45d1-87a7-02c7fa95793a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:04.058670 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2b0b12ba-51e8-45d1-87a7-02c7fa95793a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:04.081112 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b0b12ba-51e8-45d1-87a7-02c7fa95793a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:04.108845 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b0b12ba-51e8-45d1-87a7-02c7fa95793a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:04.111195 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b0b12ba-51e8-45d1-87a7-02c7fa95793a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:04.113706 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b0b12ba-51e8-45d1-87a7-02c7fa95793a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:04.125787 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b0b12ba-51e8-45d1-87a7-02c7fa95793a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:04.127177 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b0b12ba-51e8-45d1-87a7-02c7fa95793a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:04.749780 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b57a4d0f-50f8-4f6f-8839-ec1f12f86432 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:04.834654 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b57a4d0f-50f8-4f6f-8839-ec1f12f86432 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364" status: 200 len: 1467 microversion: 2.1 time: 1.809480 Oct 04 20:43:04.839956 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 709/1404] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:03 2022] GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364 => generated 1467 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:04.875878 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8dd18df1-710b-40ec-b417-4c086e00aaa3 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Calling method '.version_select at 0x7f77f75823a0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:04.997911 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-8dd18df1-710b-40ec-b417-4c086e00aaa3 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] HTTP exception thrown: Volume d96366a8-dfec-41d0-b2b5-e96532fa4d80 could not be found. Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8dd18df1-710b-40ec-b417-4c086e00aaa3 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Request method failure captured: Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 HTTP/1.1 Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJrAi7sSaloNl3DgAQmNXEycHR211IXV0y9IHRIOZB5JPAFypxsEeE1pvk3bcKBY93EE0woq7cAQJdIFvezMcoxrNdU8tTtqWZ0-qyN8Ibltl5avWKwYhOKXsZHJwPK8lZH71tAp1N5HH5SJxEgwnPJMFf8omJXprRHIY5I_sZpMV5c Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 51999a9a01fa4849bcfa3dc9ba2eb870 Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-VolumesGetTestJSON-1838247746 Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_51999a9a01fa4849bcfa3dc9ba2eb870", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/51999a9a01fa4849bcfa3dc9ba2eb870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/51999a9a01fa4849bcfa3dc9ba2eb870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/51999a9a01fa4849bcfa3dc9ba2eb870"}]}] Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-VolumesGetTestJSON-1838247746 Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 51999a9a01fa4849bcfa3dc9ba2eb870 Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-VolumesGetTestJSON-1838247746 Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-VolumesGetTestJSON-1838247746-project Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: bbc4b124654544f1a4d06f26d291e5a8 Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-VolumesGetTestJSON-1838247746-project Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: exception: Volume d96366a8-dfec-41d0-b2b5-e96532fa4d80 could not be found. Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'd96366a8-dfec-41d0-b2b5-e96532fa4d80'} Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d96366a8-dfec-41d0-b2b5-e96532fa4d80 could not be found. (HTTP 404) (Request-ID: req-c9c05387-5609-4190-b86e-e9ac1daf6d13) Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:43:05.092191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d96366a8-dfec-41d0-b2b5-e96532fa4d80 could not be found. Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d96366a8-dfec-41d0-b2b5-e96532fa4d80 could not be found. Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d96366a8-dfec-41d0-b2b5-e96532fa4d80 could not be found. Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8dd18df1-710b-40ec-b417-4c086e00aaa3 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] Returning 404 to user: Volume d96366a8-dfec-41d0-b2b5-e96532fa4d80 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8dd18df1-710b-40ec-b417-4c086e00aaa3 tempest-VolumesGetTestJSON-1838247746 tempest-VolumesGetTestJSON-1838247746-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80" status: 404 len: 109 microversion: 2.1 time: 0.206815 Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 710/1405] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:43:04 2022] GET /compute/v2.1/os-volumes/d96366a8-dfec-41d0-b2b5-e96532fa4d80 => generated 109 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c5ef2f5f-6e06-4284-a45e-197daf1c293d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:05.116437 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c5ef2f5f-6e06-4284-a45e-197daf1c293d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:05.138789 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5ef2f5f-6e06-4284-a45e-197daf1c293d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.150215 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5ef2f5f-6e06-4284-a45e-197daf1c293d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.151601 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5ef2f5f-6e06-4284-a45e-197daf1c293d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.153542 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5ef2f5f-6e06-4284-a45e-197daf1c293d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.154418 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5ef2f5f-6e06-4284-a45e-197daf1c293d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.155286 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5ef2f5f-6e06-4284-a45e-197daf1c293d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.453222 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c5ef2f5f-6e06-4284-a45e-197daf1c293d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.535305 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c5ef2f5f-6e06-4284-a45e-197daf1c293d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1275 microversion: 2.1 time: 0.479544 Oct 04 20:43:05.559751 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 711/1406] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:05 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1275 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:05.894052 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2b0b12ba-51e8-45d1-87a7-02c7fa95793a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.902912 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=56 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:05.941570 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2b0b12ba-51e8-45d1-87a7-02c7fa95793a tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 1.893977 Oct 04 20:43:05.942898 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 696/1407] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:04 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:06.562982 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b233ec10-cc37-4a15-b96e-475d251dfe08 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f7582ee0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:06.585223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-800c77f8-f3d0-477e-a754-4673286cc9c8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:06.586462 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-800c77f8-f3d0-477e-a754-4673286cc9c8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:06.651199 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-800c77f8-f3d0-477e-a754-4673286cc9c8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:06.664859 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-800c77f8-f3d0-477e-a754-4673286cc9c8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:06.669685 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-800c77f8-f3d0-477e-a754-4673286cc9c8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:06.671213 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-800c77f8-f3d0-477e-a754-4673286cc9c8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:06.672101 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-800c77f8-f3d0-477e-a754-4673286cc9c8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:06.684329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-800c77f8-f3d0-477e-a754-4673286cc9c8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:06.956683 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b233ec10-cc37-4a15-b96e-475d251dfe08 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images?changes-since=2022-10-04T20%3A38%3A24Z" status: 200 len: 1900 microversion: 2.1 time: 1.395158 Oct 04 20:43:06.958826 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 712/1408] 10.222.0.78 () {58 vars in 1199 bytes} [Tue Oct 4 20:43:05 2022] GET /compute/v2.1/images?changes-since=2022-10-04T20%3A38%3A24Z => generated 1900 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:06.962226 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=12 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:07.006007 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-77abe88a-766e-4506-9d1e-1faf0ac68ff3 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f751d4c0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:07.189094 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-800c77f8-f3d0-477e-a754-4673286cc9c8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:07.251843 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-800c77f8-f3d0-477e-a754-4673286cc9c8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1275 microversion: 2.1 time: 0.665177 Oct 04 20:43:07.253178 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 697/1409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:06 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1275 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:07.276369 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c67b5f89-8cae-4cfa-b4fc-60ae3c2c8983 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:07.312049 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c67b5f89-8cae-4cfa-b4fc-60ae3c2c8983 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:07.350036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c67b5f89-8cae-4cfa-b4fc-60ae3c2c8983 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:07.350983 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c67b5f89-8cae-4cfa-b4fc-60ae3c2c8983 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:07.351880 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c67b5f89-8cae-4cfa-b4fc-60ae3c2c8983 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:07.359165 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c67b5f89-8cae-4cfa-b4fc-60ae3c2c8983 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:07.360811 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-77abe88a-766e-4506-9d1e-1faf0ac68ff3 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-955757493" status: 200 len: 484 microversion: 2.1 time: 0.376173 Oct 04 20:43:07.367224 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c67b5f89-8cae-4cfa-b4fc-60ae3c2c8983 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:07.368087 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 713/1410] 10.222.0.78 () {58 vars in 1229 bytes} [Tue Oct 4 20:43:06 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-955757493 => generated 484 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:07.369520 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c67b5f89-8cae-4cfa-b4fc-60ae3c2c8983 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:07.405469 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2201a455-4bef-47c1-a7da-1bb74b2d0185 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f751d9d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:07.935329 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2201a455-4bef-47c1-a7da-1bb74b2d0185 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images?server=bd64c084-10af-4b12-bdd9-ef53866be364" status: 200 len: 956 microversion: 2.1 time: 0.558051 Oct 04 20:43:07.939303 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 714/1411] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 4 20:43:07 2022] GET /compute/v2.1/images?server=bd64c084-10af-4b12-bdd9-ef53866be364 => generated 956 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:07.985537 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-36f24f0f-30b9-45af-a51e-4732ff659369 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f7582c10>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:08.181006 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-36f24f0f-30b9-45af-a51e-4732ff659369 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2F9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 484 microversion: 2.1 time: 0.222267 Oct 04 20:43:08.185096 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 715/1412] 10.222.0.78 () {58 vars in 1317 bytes} [Tue Oct 4 20:43:07 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2F9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 484 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:08.197523 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c67b5f89-8cae-4cfa-b4fc-60ae3c2c8983 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:08.220232 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-541a8062-d82e-434e-9496-8e2668ca2f58 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f753c670>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:08.234976 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c67b5f89-8cae-4cfa-b4fc-60ae3c2c8983 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 0.978945 Oct 04 20:43:08.236938 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 698/1413] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:07 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:08.292020 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-429cb025-139f-48fb-afda-45fc4fcacdf3 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:08.316521 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-429cb025-139f-48fb-afda-45fc4fcacdf3 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:08.347585 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-429cb025-139f-48fb-afda-45fc4fcacdf3 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:08.347797 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-429cb025-139f-48fb-afda-45fc4fcacdf3 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:08.348729 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-429cb025-139f-48fb-afda-45fc4fcacdf3 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:08.360179 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-429cb025-139f-48fb-afda-45fc4fcacdf3 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:08.368308 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-429cb025-139f-48fb-afda-45fc4fcacdf3 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:08.370145 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-429cb025-139f-48fb-afda-45fc4fcacdf3 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:08.516960 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-541a8062-d82e-434e-9496-8e2668ca2f58 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2F9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 484 microversion: 2.1 time: 0.306732 Oct 04 20:43:08.532924 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 716/1414] 10.222.0.78 () {58 vars in 1303 bytes} [Tue Oct 4 20:43:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2F9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 484 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:08.575970 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8c67c2e9-d243-432f-b9dc-fb0ce86f9dd0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f7582b80>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:09.429926 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8c67c2e9-d243-432f-b9dc-fb0ce86f9dd0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.891371 Oct 04 20:43:09.454401 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 717/1415] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 4 20:43:08 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:09.475640 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-365bd2d1-c864-4300-93e6-232f5829e234 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:09.485006 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-365bd2d1-c864-4300-93e6-232f5829e234 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:09.513536 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-365bd2d1-c864-4300-93e6-232f5829e234 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:09.518801 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-365bd2d1-c864-4300-93e6-232f5829e234 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:09.522812 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-365bd2d1-c864-4300-93e6-232f5829e234 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:09.524902 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-365bd2d1-c864-4300-93e6-232f5829e234 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:09.526243 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-365bd2d1-c864-4300-93e6-232f5829e234 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:09.529739 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-365bd2d1-c864-4300-93e6-232f5829e234 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:09.608755 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-429cb025-139f-48fb-afda-45fc4fcacdf3 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:09.650822 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=57 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:09.657850 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-429cb025-139f-48fb-afda-45fc4fcacdf3 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1317 microversion: 2.1 time: 1.373179 Oct 04 20:43:09.659380 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 699/1416] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:08 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1317 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:09.696185 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7f86d118-71ee-4be8-8128-bf700a90995a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee13430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:10.051475 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7f86d118-71ee-4be8-8128-bf700a90995a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.367857 Oct 04 20:43:10.070565 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 700/1417] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 4 20:43:09 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:10.097308 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-be3de15e-1708-461d-8fee-5c872f892f05 req-6efef21e-4a3f-457e-860c-7cb13fc86102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d", "name": "network-vif-plugged", "status": "completed", "tag": "ecc4bf5f-7d12-4714-83d5-e6b2d3d3cbb3"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:10.149673 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-be3de15e-1708-461d-8fee-5c872f892f05 req-6efef21e-4a3f-457e-860c-7cb13fc86102 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.156237 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-be3de15e-1708-461d-8fee-5c872f892f05 req-6efef21e-4a3f-457e-860c-7cb13fc86102 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.157922 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-be3de15e-1708-461d-8fee-5c872f892f05 req-6efef21e-4a3f-457e-860c-7cb13fc86102 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:10.219280 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-be3de15e-1708-461d-8fee-5c872f892f05 req-6efef21e-4a3f-457e-860c-7cb13fc86102 service nova] Creating event network-vif-plugged:ecc4bf5f-7d12-4714-83d5-e6b2d3d3cbb3 for instance 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d on n-h1-852085-12 Oct 04 20:43:10.243067 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-be3de15e-1708-461d-8fee-5c872f892f05 req-6efef21e-4a3f-457e-860c-7cb13fc86102 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173980 Oct 04 20:43:10.244510 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 701/1418] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:10.271887 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dd09021b-863c-482f-9943-ebefaadfd94d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eedad700>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:10.513683 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-dd09021b-863c-482f-9943-ebefaadfd94d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.265368 Oct 04 20:43:10.527646 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 702/1419] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:43:10 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:10.552388 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-931e589a-e2e0-4f92-a5ff-155e13cfe4fd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eedf6700>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:10.793785 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-365bd2d1-c864-4300-93e6-232f5829e234 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:10.802881 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-931e589a-e2e0-4f92-a5ff-155e13cfe4fd tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/detail?changes-since=2022-10-04T20%3A38%3A05Z" status: 200 len: 6331 microversion: 2.1 time: 0.259976 Oct 04 20:43:10.806288 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 703/1420] 10.222.0.78 () {58 vars in 1220 bytes} [Tue Oct 4 20:43:10 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-04T20%3A38%3A05Z => generated 6331 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:10.816955 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-61367560-9f72-4f3e-a861-8eb524b87b92 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:10.821123 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-61367560-9f72-4f3e-a861-8eb524b87b92 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:10.841399 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-61367560-9f72-4f3e-a861-8eb524b87b92 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.842792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-61367560-9f72-4f3e-a861-8eb524b87b92 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.845400 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-61367560-9f72-4f3e-a861-8eb524b87b92 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:10.849443 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-365bd2d1-c864-4300-93e6-232f5829e234 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 1.392367 Oct 04 20:43:10.852708 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 718/1421] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:09 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:10.863651 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-61367560-9f72-4f3e-a861-8eb524b87b92 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.864553 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-61367560-9f72-4f3e-a861-8eb524b87b92 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.865364 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-61367560-9f72-4f3e-a861-8eb524b87b92 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:10.877199 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3da0e0fa-1307-410a-b1a8-d6e15304750c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f753c940>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:11.041068 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3da0e0fa-1307-410a-b1a8-d6e15304750c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-955757493" status: 200 len: 664 microversion: 2.1 time: 0.185967 Oct 04 20:43:11.046845 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 719/1422] 10.222.0.78 () {58 vars in 1250 bytes} [Tue Oct 4 20:43:10 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-955757493 => generated 664 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:11.080244 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8d13db7c-926a-443d-bf23-376eace2f9e8 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f751d0d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:11.317584 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8d13db7c-926a-443d-bf23-376eace2f9e8 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2F9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1466 microversion: 2.1 time: 0.243295 Oct 04 20:43:11.322865 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 720/1423] 10.222.0.78 () {58 vars in 1338 bytes} [Tue Oct 4 20:43:11 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2F9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1466 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:43:11.373097 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e210130a-8bdc-4042-a4e3-98e09a1c8f9c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f7582d30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:11.641978 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e210130a-8bdc-4042-a4e3-98e09a1c8f9c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2F9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1466 microversion: 2.1 time: 0.284209 Oct 04 20:43:11.646152 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 721/1424] 10.222.0.78 () {58 vars in 1324 bytes} [Tue Oct 4 20:43:11 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2F9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1466 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:43:11.701036 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8c1bd9b5-eedd-45ed-aad1-9b453a58f922 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f751d9d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:12.064279 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8c1bd9b5-eedd-45ed-aad1-9b453a58f922 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7106 microversion: 2.1 time: 0.395294 Oct 04 20:43:12.118427 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 722/1425] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Oct 4 20:43:11 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7106 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:12.150061 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-efbb8354-e7f3-482c-970a-fdee25b268ea tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:12.153615 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-efbb8354-e7f3-482c-970a-fdee25b268ea tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:12.157008 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=25 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:12.175156 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-efbb8354-e7f3-482c-970a-fdee25b268ea tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:12.176150 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-efbb8354-e7f3-482c-970a-fdee25b268ea tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:12.176802 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-efbb8354-e7f3-482c-970a-fdee25b268ea tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.178030 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-efbb8354-e7f3-482c-970a-fdee25b268ea tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:12.178768 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-efbb8354-e7f3-482c-970a-fdee25b268ea tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:12.179638 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-efbb8354-e7f3-482c-970a-fdee25b268ea tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.230468 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-61367560-9f72-4f3e-a861-8eb524b87b92 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:12.319404 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-61367560-9f72-4f3e-a861-8eb524b87b92 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1317 microversion: 2.1 time: 1.508672 Oct 04 20:43:12.336071 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 704/1426] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:10 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1317 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:12.371767 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f9c5796f-7af5-44f4-b068-ff805ffb87b3 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee8e8b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:12.662697 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f9c5796f-7af5-44f4-b068-ff805ffb87b3 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.323162 Oct 04 20:43:12.665416 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 705/1427] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Oct 4 20:43:12 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:12.696634 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-c3b0bf00-5f69-441a-87c8-1781611cbd87 req-40e39f97-34db-442b-a599-5b9a632ff01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd64c084-10af-4b12-bdd9-ef53866be364", "name": "network-vif-unplugged", "status": "completed", "tag": "a55c4fe7-8c63-4a39-819e-95561de2446e"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:12.799546 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-c3b0bf00-5f69-441a-87c8-1781611cbd87 req-40e39f97-34db-442b-a599-5b9a632ff01e service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:12.804165 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-c3b0bf00-5f69-441a-87c8-1781611cbd87 req-40e39f97-34db-442b-a599-5b9a632ff01e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:12.812022 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-c3b0bf00-5f69-441a-87c8-1781611cbd87 req-40e39f97-34db-442b-a599-5b9a632ff01e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.877607 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-c3b0bf00-5f69-441a-87c8-1781611cbd87 req-40e39f97-34db-442b-a599-5b9a632ff01e service nova] Creating event network-vif-unplugged:a55c4fe7-8c63-4a39-819e-95561de2446e for instance bd64c084-10af-4b12-bdd9-ef53866be364 on n-h1-852085-12 Oct 04 20:43:12.911706 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-c3b0bf00-5f69-441a-87c8-1781611cbd87 req-40e39f97-34db-442b-a599-5b9a632ff01e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.241195 Oct 04 20:43:12.913611 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 706/1428] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:12.944401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-44a9b0c0-d170-4e4d-a6f9-4a11812edf30 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eedf6a60>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:13.094683 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-44a9b0c0-d170-4e4d-a6f9-4a11812edf30 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/72e89793-9b3c-463e-96d2-f69d6ab1a9d9" status: 200 len: 784 microversion: 2.1 time: 0.168189 Oct 04 20:43:13.104226 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 707/1429] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:43:12 2022] GET /compute/v2.1/images/72e89793-9b3c-463e-96d2-f69d6ab1a9d9 => generated 784 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:13.146050 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c81f0dc5-5e5d-4624-8e4d-4d5a36b3f7ff tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee13f70>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:13.294575 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c81f0dc5-5e5d-4624-8e4d-4d5a36b3f7ff tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.154187 Oct 04 20:43:13.296475 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 708/1430] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:43:13 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:43:13.333610 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3d2bb291-fac9-43dc-97b0-04e1a7aec1a3 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eef623a0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:14.224143 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-efbb8354-e7f3-482c-970a-fdee25b268ea tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:14.264643 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-efbb8354-e7f3-482c-970a-fdee25b268ea tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1314 microversion: 2.1 time: 2.143912 Oct 04 20:43:14.290922 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 723/1431] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:12 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1314 bytes in 2172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:14.321987 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cb83ac1a-200e-4624-a043-a9ff56671de9 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:14.327557 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-cb83ac1a-200e-4624-a043-a9ff56671de9 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:14.338902 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb83ac1a-200e-4624-a043-a9ff56671de9 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:14.340944 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb83ac1a-200e-4624-a043-a9ff56671de9 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:14.342101 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb83ac1a-200e-4624-a043-a9ff56671de9 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:14.343874 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb83ac1a-200e-4624-a043-a9ff56671de9 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:14.345138 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb83ac1a-200e-4624-a043-a9ff56671de9 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:14.346312 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cb83ac1a-200e-4624-a043-a9ff56671de9 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:15.981993 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-cb83ac1a-200e-4624-a043-a9ff56671de9 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:16.011680 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cb83ac1a-200e-4624-a043-a9ff56671de9 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1317 microversion: 2.1 time: 1.714523 Oct 04 20:43:16.015186 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 724/1432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:14 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1317 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:16.038828 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-d6a985a1-d5f1-49ca-9b00-401a383f1be8 req-88682827-3584-4930-8917-6812cb1b7377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "568cbe45-b90d-49d4-8ed6-90923e399d49", "tag": "46ab96a5-0e71-4267-bb4f-54da94372f8e"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:16.119466 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-d6a985a1-d5f1-49ca-9b00-401a383f1be8 req-88682827-3584-4930-8917-6812cb1b7377 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:16.120988 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-d6a985a1-d5f1-49ca-9b00-401a383f1be8 req-88682827-3584-4930-8917-6812cb1b7377 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:16.121813 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-d6a985a1-d5f1-49ca-9b00-401a383f1be8 req-88682827-3584-4930-8917-6812cb1b7377 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:16.185978 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-d6a985a1-d5f1-49ca-9b00-401a383f1be8 req-88682827-3584-4930-8917-6812cb1b7377 service nova] Creating event network-changed:46ab96a5-0e71-4267-bb4f-54da94372f8e for instance 568cbe45-b90d-49d4-8ed6-90923e399d49 on n-h2-852085-12 Oct 04 20:43:16.259745 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-d6a985a1-d5f1-49ca-9b00-401a383f1be8 req-88682827-3584-4930-8917-6812cb1b7377 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232571 Oct 04 20:43:16.275904 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 725/1433] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:16.305762 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f4a4e91c-b10f-4240-80ac-dae29ae84d60 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:16.309012 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f4a4e91c-b10f-4240-80ac-dae29ae84d60 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:16.346194 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f4a4e91c-b10f-4240-80ac-dae29ae84d60 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:16.347175 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f4a4e91c-b10f-4240-80ac-dae29ae84d60 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:16.347965 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f4a4e91c-b10f-4240-80ac-dae29ae84d60 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:16.349336 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f4a4e91c-b10f-4240-80ac-dae29ae84d60 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:16.354973 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f4a4e91c-b10f-4240-80ac-dae29ae84d60 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:16.359237 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f4a4e91c-b10f-4240-80ac-dae29ae84d60 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:17.632778 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f4a4e91c-b10f-4240-80ac-dae29ae84d60 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:17.689880 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f4a4e91c-b10f-4240-80ac-dae29ae84d60 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1464 microversion: 2.1 time: 1.408267 Oct 04 20:43:17.690979 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 726/1434] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:16 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1464 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:17.803312 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3d2bb291-fac9-43dc-97b0-04e1a7aec1a3 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "DELETE /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf" status: 204 len: 0 microversion: 2.1 time: 4.477618 Oct 04 20:43:17.805316 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 709/1435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:13 2022] DELETE /compute/v2.1/images/6adc8469-e54f-4a43-9af6-58eff2001caf => generated 0 bytes in 4483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:43:17.822924 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cffc8bdf-2a93-4a14-a907-6dc394d2a63e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:17.829199 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cffc8bdf-2a93-4a14-a907-6dc394d2a63e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:17.858230 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cffc8bdf-2a93-4a14-a907-6dc394d2a63e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:17.876019 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cffc8bdf-2a93-4a14-a907-6dc394d2a63e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:17.876019 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cffc8bdf-2a93-4a14-a907-6dc394d2a63e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:17.879195 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cffc8bdf-2a93-4a14-a907-6dc394d2a63e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:17.883060 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cffc8bdf-2a93-4a14-a907-6dc394d2a63e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:17.883763 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cffc8bdf-2a93-4a14-a907-6dc394d2a63e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:18.128390 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c9af8193-7800-413f-bbbf-03d722be79f8 tempest-InstanceActionsTestJSON-693658848 tempest-InstanceActionsTestJSON-693658848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-383797353", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "230ddf19-0279-4e45-a111-f5818907c323"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:18.258266 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-c9af8193-7800-413f-bbbf-03d722be79f8 tempest-InstanceActionsTestJSON-693658848 tempest-InstanceActionsTestJSON-693658848-project] validate_networks() for [('230ddf19-0279-4e45-a111-f5818907c323', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:43:18.843168 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-cffc8bdf-2a93-4a14-a907-6dc394d2a63e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:18.863324 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cffc8bdf-2a93-4a14-a907-6dc394d2a63e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1317 microversion: 2.1 time: 1.055489 Oct 04 20:43:18.866411 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 710/1436] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:17 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1317 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:19.405309 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-df007049-17de-4df2-90b4-2a0db4f37b18 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:19.430793 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-df007049-17de-4df2-90b4-2a0db4f37b18 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Searching by: {'deleted': False, 'project_id': '76ebb788e0674a7b99f294cb37a30f46'} {{(pid=123539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:43:19.472232 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-df007049-17de-4df2-90b4-2a0db4f37b18 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.473592 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-df007049-17de-4df2-90b4-2a0db4f37b18 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.475119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-df007049-17de-4df2-90b4-2a0db4f37b18 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.477401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-df007049-17de-4df2-90b4-2a0db4f37b18 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.481241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-df007049-17de-4df2-90b4-2a0db4f37b18 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.486829 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-df007049-17de-4df2-90b4-2a0db4f37b18 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-c9af8193-7800-413f-bbbf-03d722be79f8 tempest-InstanceActionsTestJSON-693658848 tempest-InstanceActionsTestJSON-693658848-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7c2756bf-b78d-463b-b562-56a2869932ec) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:43:19.774753 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7c2756bf-b78d-463b-b562-56a2869932ec) Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-c9af8193-7800-413f-bbbf-03d722be79f8 tempest-InstanceActionsTestJSON-693658848 tempest-InstanceActionsTestJSON-693658848-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c9af8193-7800-413f-bbbf-03d722be79f8 tempest-InstanceActionsTestJSON-693658848 tempest-InstanceActionsTestJSON-693658848-project] Request method failure captured: Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 208 Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJrjDPF2S2oijQBTWIwXSoXR8qqAj9DsjKGFeTVXJIdryMH7EzEUXGawSu1GVXZz-Xrhyqa4bcg68Osx_d6hotgT3goYItVRXme4SOegd6ApozLvi5nFHKlMLDkwlaB0ZpDUo_JbpB6UCKrJOLwG7FGYRdwit3e1GoHTYixVzWTN-kQ Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 477e43afdaeb4926a8a0ef8560e30980 Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-InstanceActionsTestJSON-693658848 Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_477e43afdaeb4926a8a0ef8560e30980", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/477e43afdaeb4926a8a0ef8560e30980"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/477e43afdaeb4926a8a0ef8560e30980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/477e43afdaeb4926a8a0ef8560e30980"}]}] Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-InstanceActionsTestJSON-693658848 Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 477e43afdaeb4926a8a0ef8560e30980 Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-InstanceActionsTestJSON-693658848 Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-InstanceActionsTestJSON-693658848-project Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 927b3e0f9cb340978e6f3a16107becf0 Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-InstanceActionsTestJSON-693658848-project Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-InstanceActionsTestJSON-server-383797353", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "230ddf19-0279-4e45-a111-f5818907c323"}]}} Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsTestJSON-server-383797353', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '230ddf19-0279-4e45-a111-f5818907c323'}]}}} Oct 04 20:43:19.791287 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:43:19.813214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7c2756bf-b78d-463b-b562-56a2869932ec) Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c9af8193-7800-413f-bbbf-03d722be79f8 tempest-InstanceActionsTestJSON-693658848 tempest-InstanceActionsTestJSON-693658848-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c9af8193-7800-413f-bbbf-03d722be79f8 tempest-InstanceActionsTestJSON-693658848 tempest-InstanceActionsTestJSON-693658848-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.099712 Oct 04 20:43:19.832842 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 727/1437] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:43:17 2022] POST /compute/v2.1/servers => generated 214 bytes in 2108 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:43:19.844366 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fb01b30d-9d0c-4dc1-a509-878ac3cf713a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f751dca0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:19.973810 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-df007049-17de-4df2-90b4-2a0db4f37b18 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 1.104363 Oct 04 20:43:19.987183 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 711/1438] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:43:18 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:43:20.006843 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a6a36136-066e-448b-89a8-24aa983547c1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:20.006843 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a6a36136-066e-448b-89a8-24aa983547c1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:20.034166 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a6a36136-066e-448b-89a8-24aa983547c1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:20.035301 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a6a36136-066e-448b-89a8-24aa983547c1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:20.036129 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a6a36136-066e-448b-89a8-24aa983547c1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:20.037630 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a6a36136-066e-448b-89a8-24aa983547c1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:20.038711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a6a36136-066e-448b-89a8-24aa983547c1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:20.039543 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a6a36136-066e-448b-89a8-24aa983547c1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:21.165061 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a6a36136-066e-448b-89a8-24aa983547c1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:21.243299 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a6a36136-066e-448b-89a8-24aa983547c1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1317 microversion: 2.1 time: 1.265422 Oct 04 20:43:21.246901 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 712/1439] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:19 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1317 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:21.263245 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:21.278720 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Searching by: {'deleted': False} {{(pid=123539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:43:21.296745 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:21.298379 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:21.302238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:21.302238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:21.304742 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:21.306157 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:21.813955 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.multi_cell_list [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=123539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:43:22.179368 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:22.181819 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:22.184826 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:22.880348 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fb01b30d-9d0c-4dc1-a509-878ac3cf713a tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "DELETE /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9" status: 204 len: 0 microversion: 2.1 time: 3.078371 Oct 04 20:43:22.887508 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 728/1440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:19 2022] DELETE /compute/v2.1/images/f2b788fe-27a9-412d-b7b3-c925839a8ac9 => generated 0 bytes in 3081 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:43:22.909238 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7711caf2-1434-46ca-b8a3-8696ca66fd47 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:22.910961 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7711caf2-1434-46ca-b8a3-8696ca66fd47 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:22.938604 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7711caf2-1434-46ca-b8a3-8696ca66fd47 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:22.949098 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7711caf2-1434-46ca-b8a3-8696ca66fd47 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:22.950691 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7711caf2-1434-46ca-b8a3-8696ca66fd47 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:22.952862 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7711caf2-1434-46ca-b8a3-8696ca66fd47 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:22.954381 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7711caf2-1434-46ca-b8a3-8696ca66fd47 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:22.955626 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7711caf2-1434-46ca-b8a3-8696ca66fd47 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:23.954243 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7711caf2-1434-46ca-b8a3-8696ca66fd47 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:23.988772 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7711caf2-1434-46ca-b8a3-8696ca66fd47 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1317 microversion: 2.1 time: 1.099001 Oct 04 20:43:23.995616 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 729/1441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:22 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1317 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:24.023819 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-be84d62e-1eb1-4b6c-9604-64ba5c624222 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] Calling method '.version_select at 0x7f77f751d160>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:24.265270 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-be84d62e-1eb1-4b6c-9604-64ba5c624222 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/60fc4542-5be6-4f6e-a1e8-4799321706cb" status: 200 len: 350 microversion: 2.1 time: 0.266287 Oct 04 20:43:24.266366 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 730/1442] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:43:23 2022] GET /compute/v2.1/os-volumes/60fc4542-5be6-4f6e-a1e8-4799321706cb => generated 350 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:24.286779 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6f4970a4-ee2f-4ee3-ad76-c3f44daede52 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77f7582280>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:25.185914 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9da840de-bb25-425f-8148-c75f66dd0ea2 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 9513 microversion: 2.1 time: 3.936731 Oct 04 20:43:25.238444 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 713/1443] 10.222.0.78 () {58 vars in 1171 bytes} [Tue Oct 4 20:43:21 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 9513 bytes in 3979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:25.267987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a746d671-8c83-4474-8bee-d26dfbbd7268 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:25.269713 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a746d671-8c83-4474-8bee-d26dfbbd7268 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:25.312501 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a746d671-8c83-4474-8bee-d26dfbbd7268 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:25.316488 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a746d671-8c83-4474-8bee-d26dfbbd7268 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:25.318213 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a746d671-8c83-4474-8bee-d26dfbbd7268 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:25.325049 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a746d671-8c83-4474-8bee-d26dfbbd7268 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:25.327754 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a746d671-8c83-4474-8bee-d26dfbbd7268 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:25.329059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a746d671-8c83-4474-8bee-d26dfbbd7268 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:25.965207 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a746d671-8c83-4474-8bee-d26dfbbd7268 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:26.024204 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a746d671-8c83-4474-8bee-d26dfbbd7268 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1317 microversion: 2.1 time: 0.780130 Oct 04 20:43:26.030485 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 714/1444] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:25 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1317 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:26.039895 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e6a7dab3-ae4e-4561-881a-15ee6e093088 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:26.052202 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e6a7dab3-ae4e-4561-881a-15ee6e093088 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Searching by: {'deleted': False, 'project_id': '76ebb788e0674a7b99f294cb37a30f46'} {{(pid=123539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:43:26.064267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e6a7dab3-ae4e-4561-881a-15ee6e093088 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:26.065801 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e6a7dab3-ae4e-4561-881a-15ee6e093088 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:26.067922 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e6a7dab3-ae4e-4561-881a-15ee6e093088 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.071611 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e6a7dab3-ae4e-4561-881a-15ee6e093088 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:26.073390 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e6a7dab3-ae4e-4561-881a-15ee6e093088 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:26.074596 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e6a7dab3-ae4e-4561-881a-15ee6e093088 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.214906 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e6a7dab3-ae4e-4561-881a-15ee6e093088 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?tenant_id=e9fae788056d4b8e9d45e8988fc6920f" status: 200 len: 15 microversion: 2.1 time: 0.181936 Oct 04 20:43:26.217441 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 715/1445] 10.222.0.78 () {58 vars in 1231 bytes} [Tue Oct 4 20:43:26 2022] GET /compute/v2.1/servers/detail?tenant_id=e9fae788056d4b8e9d45e8988fc6920f => generated 15 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:43:26.299580 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:26.335185 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Searching by: {'tenant_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'deleted': False} {{(pid=123539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:43:26.378919 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:26.380406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:26.381099 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.383128 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:26.383128 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:26.419350 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.665955 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.multi_cell_list [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:43:27.704222 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6f4970a4-ee2f-4ee3-ad76-c3f44daede52 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "DELETE /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051" status: 204 len: 0 microversion: 2.1 time: 3.432618 Oct 04 20:43:27.705722 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 731/1446] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:24 2022] DELETE /compute/v2.1/images/4ad88564-31c3-4fd3-94b0-89ec04f16051 => generated 0 bytes in 3439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:43:27.751424 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:27.752397 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:27.753240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:27.983266 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cd56f296-84f5-43c9-9f38-0137bd480db9 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-307439287", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "a01e9a88-74fc-4f6c-a9eb-b64446db8cab"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:28.234280 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-cd56f296-84f5-43c9-9f38-0137bd480db9 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] validate_networks() for [('a01e9a88-74fc-4f6c-a9eb-b64446db8cab', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:43:28.310091 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-152b93b4-13e1-467c-a064-36b1612070dc tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e9fae788056d4b8e9d45e8988fc6920f" status: 200 len: 4832 microversion: 2.1 time: 2.043831 Oct 04 20:43:28.324811 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 716/1447] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 4 20:43:26 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e9fae788056d4b8e9d45e8988fc6920f => generated 4832 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:28.362292 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1fe65f33-e135-49b0-9ae8-dba57335b724 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:28.364132 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-1fe65f33-e135-49b0-9ae8-dba57335b724 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:28.401053 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1fe65f33-e135-49b0-9ae8-dba57335b724 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.402489 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1fe65f33-e135-49b0-9ae8-dba57335b724 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:28.403561 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1fe65f33-e135-49b0-9ae8-dba57335b724 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:28.405124 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1fe65f33-e135-49b0-9ae8-dba57335b724 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.406183 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1fe65f33-e135-49b0-9ae8-dba57335b724 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:28.407303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1fe65f33-e135-49b0-9ae8-dba57335b724 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-cd56f296-84f5-43c9-9f38-0137bd480db9 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-47a9c215-8f8f-40c6-81e0-8ae279f28069) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:43:29.840406 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-47a9c215-8f8f-40c6-81e0-8ae279f28069) Oct 04 20:43:29.846159 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:29.851182 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-cd56f296-84f5-43c9-9f38-0137bd480db9 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:29.851182 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cd56f296-84f5-43c9-9f38-0137bd480db9 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] Request method failure captured: Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 209 Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJrtqmeo7jkMjrMRXzqfwLMObTBGrXH1lnxgmlbyprQl42zwuEP3Ijh7w5WGbFeTtwMa9ngs4ibe5oKKCpx6Bt1Qm7r_sLJwfyrWVYSqE6Yd_WA6uOX6G1YF7iEA7yXrKMRxYkoj0GUp8HrEYdNtcMt2bQ_e_R61wR7EYwG__Cm_XW4 Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: a9756cde63f04174a293f5b7558d1a96 Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1197486047 Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a9756cde63f04174a293f5b7558d1a96", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9756cde63f04174a293f5b7558d1a96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9756cde63f04174a293f5b7558d1a96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a9756cde63f04174a293f5b7558d1a96"}]}] Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerDiskConfigTestJSON-1197486047 Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: a9756cde63f04174a293f5b7558d1a96 Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1197486047 Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerDiskConfigTestJSON-1197486047-project Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 4636896816224423b6f379b160c609ee Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerDiskConfigTestJSON-1197486047-project Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-307439287", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "a01e9a88-74fc-4f6c-a9eb-b64446db8cab"}]}} Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-307439287', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'a01e9a88-74fc-4f6c-a9eb-b64446db8cab'}]}}} Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:43:29.871860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-47a9c215-8f8f-40c6-81e0-8ae279f28069) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:43:29.878585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:29.882851 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:43:29.889094 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cd56f296-84f5-43c9-9f38-0137bd480db9 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:29.889094 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:29.899631 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cd56f296-84f5-43c9-9f38-0137bd480db9 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.182511 Oct 04 20:43:29.903303 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 732/1448] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:43:27 2022] POST /compute/v2.1/servers => generated 214 bytes in 2197 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:43:29.944304 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2a824d57-af2e-4c2d-ab80-e9ad38cad3ee tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:29.960657 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2a824d57-af2e-4c2d-ab80-e9ad38cad3ee tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:29.998899 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2a824d57-af2e-4c2d-ab80-e9ad38cad3ee tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.020548 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2a824d57-af2e-4c2d-ab80-e9ad38cad3ee tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.026023 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2a824d57-af2e-4c2d-ab80-e9ad38cad3ee tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.030076 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2a824d57-af2e-4c2d-ab80-e9ad38cad3ee tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.041170 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2a824d57-af2e-4c2d-ab80-e9ad38cad3ee tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.045764 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2a824d57-af2e-4c2d-ab80-e9ad38cad3ee tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.126262 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-1fe65f33-e135-49b0-9ae8-dba57335b724 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.159161 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1fe65f33-e135-49b0-9ae8-dba57335b724 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1317 microversion: 2.1 time: 1.832125 Oct 04 20:43:30.169987 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 717/1449] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:28 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1317 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:30.214429 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2a824d57-af2e-4c2d-ab80-e9ad38cad3ee tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:43:30.218723 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5c8d3865-112f-4503-a8c4-173a2dfc8c46 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:30.239604 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-5c8d3865-112f-4503-a8c4-173a2dfc8c46 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Searching by: {'tenant_id': '76ebb788e0674a7b99f294cb37a30f46', 'deleted': False} {{(pid=123539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:43:30.261075 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5c8d3865-112f-4503-a8c4-173a2dfc8c46 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.262445 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5c8d3865-112f-4503-a8c4-173a2dfc8c46 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.264440 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5c8d3865-112f-4503-a8c4-173a2dfc8c46 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.268500 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5c8d3865-112f-4503-a8c4-173a2dfc8c46 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.269701 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5c8d3865-112f-4503-a8c4-173a2dfc8c46 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.288949 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5c8d3865-112f-4503-a8c4-173a2dfc8c46 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.390620 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5c8d3865-112f-4503-a8c4-173a2dfc8c46 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=76ebb788e0674a7b99f294cb37a30f46" status: 200 len: 15 microversion: 2.1 time: 0.204986 Oct 04 20:43:30.399192 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 718/1450] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 4 20:43:30 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=76ebb788e0674a7b99f294cb37a30f46 => generated 15 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:43:30.406581 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-45978ca5-4f03-46df-92de-ca811349a14e tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1954633303", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "a01e9a88-74fc-4f6c-a9eb-b64446db8cab"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:30.641563 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-45978ca5-4f03-46df-92de-ca811349a14e tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] validate_networks() for [('a01e9a88-74fc-4f6c-a9eb-b64446db8cab', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:43:30.909557 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2a824d57-af2e-4c2d-ab80-e9ad38cad3ee tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 204 len: 0 microversion: 2.1 time: 0.984171 Oct 04 20:43:30.911727 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 733/1451] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:43:29 2022] DELETE /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:43:30.933538 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-875227b6-b202-43cb-ac19-8702288d4b5b tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:30.955871 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-875227b6-b202-43cb-ac19-8702288d4b5b tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.041706 Oct 04 20:43:30.972265 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 734/1452] 10.222.0.78 () {58 vars in 1189 bytes} [Tue Oct 4 20:43:30 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:43:30.988902 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1d79146d-7997-4e75-bd94-682af7a66c45 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:30.996974 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1d79146d-7997-4e75-bd94-682af7a66c45 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:31.028073 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d79146d-7997-4e75-bd94-682af7a66c45 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:31.029033 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d79146d-7997-4e75-bd94-682af7a66c45 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:31.029889 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d79146d-7997-4e75-bd94-682af7a66c45 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:31.041866 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d79146d-7997-4e75-bd94-682af7a66c45 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:31.042939 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d79146d-7997-4e75-bd94-682af7a66c45 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:31.043691 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1d79146d-7997-4e75-bd94-682af7a66c45 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-45978ca5-4f03-46df-92de-ca811349a14e tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8164dbb7-1527-4181-8733-a40dc09f7cae) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:43:32.036996 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8164dbb7-1527-4181-8733-a40dc09f7cae) Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-45978ca5-4f03-46df-92de-ca811349a14e tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-45978ca5-4f03-46df-92de-ca811349a14e tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] Request method failure captured: Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 210 Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJrtqmeo7jkMjrMRXzqfwLMObTBGrXH1lnxgmlbyprQl42zwuEP3Ijh7w5WGbFeTtwMa9ngs4ibe5oKKCpx6Bt1Qm7r_sLJwfyrWVYSqE6Yd_WA6uOX6G1YF7iEA7yXrKMRxYkoj0GUp8HrEYdNtcMt2bQ_e_R61wR7EYwG__Cm_XW4 Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: a9756cde63f04174a293f5b7558d1a96 Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1197486047 Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a9756cde63f04174a293f5b7558d1a96", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9756cde63f04174a293f5b7558d1a96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9756cde63f04174a293f5b7558d1a96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a9756cde63f04174a293f5b7558d1a96"}]}] Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServerDiskConfigTestJSON-1197486047 Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: a9756cde63f04174a293f5b7558d1a96 Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1197486047 Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServerDiskConfigTestJSON-1197486047-project Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 4636896816224423b6f379b160c609ee Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServerDiskConfigTestJSON-1197486047-project Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1954633303", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "a01e9a88-74fc-4f6c-a9eb-b64446db8cab"}]}} Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:43:32.052630 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-1954633303', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'a01e9a88-74fc-4f6c-a9eb-b64446db8cab'}]}}} Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:43:32.078945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8164dbb7-1527-4181-8733-a40dc09f7cae) Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-45978ca5-4f03-46df-92de-ca811349a14e tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:32.096990 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-45978ca5-4f03-46df-92de-ca811349a14e tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.666533 Oct 04 20:43:32.105450 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 719/1453] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:43:30 2022] POST /compute/v2.1/servers => generated 214 bytes in 1708 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:43:32.114515 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5649e114-576e-4769-abc9-43d08aa7e312 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:32.120262 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-5649e114-576e-4769-abc9-43d08aa7e312 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:32.136777 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5649e114-576e-4769-abc9-43d08aa7e312 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.138319 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5649e114-576e-4769-abc9-43d08aa7e312 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.139586 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5649e114-576e-4769-abc9-43d08aa7e312 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.142337 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5649e114-576e-4769-abc9-43d08aa7e312 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.143890 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5649e114-576e-4769-abc9-43d08aa7e312 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.145065 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5649e114-576e-4769-abc9-43d08aa7e312 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.677087 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1d79146d-7997-4e75-bd94-682af7a66c45 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:32.712975 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1d79146d-7997-4e75-bd94-682af7a66c45 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1474 microversion: 2.1 time: 1.738258 Oct 04 20:43:32.719702 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 735/1454] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:30 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1474 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:32.740419 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f7a3b7b6-ed2f-499d-b5f3-2fbd94a016a0 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:32.748286 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f7a3b7b6-ed2f-499d-b5f3-2fbd94a016a0 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:32.794703 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f7a3b7b6-ed2f-499d-b5f3-2fbd94a016a0 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.794703 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f7a3b7b6-ed2f-499d-b5f3-2fbd94a016a0 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.797495 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f7a3b7b6-ed2f-499d-b5f3-2fbd94a016a0 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.803214 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f7a3b7b6-ed2f-499d-b5f3-2fbd94a016a0 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.806290 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f7a3b7b6-ed2f-499d-b5f3-2fbd94a016a0 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.808499 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f7a3b7b6-ed2f-499d-b5f3-2fbd94a016a0 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.833138 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5649e114-576e-4769-abc9-43d08aa7e312 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action" status: 202 len: 0 microversion: 2.1 time: 0.725655 Oct 04 20:43:32.838961 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 720/1455] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:32 2022] POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:43:32.871549 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-265d5f0d-9656-42c5-b511-0757e557f412 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] Calling method '.version_select at 0x7f77eeeba3a0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:33.107114 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-265d5f0d-9656-42c5-b511-0757e557f412 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/35d73fe2-e0bf-402e-b7dc-b604e9ad28d1" status: 200 len: 350 microversion: 2.1 time: 0.261276 Oct 04 20:43:33.108060 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 721/1456] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:43:32 2022] GET /compute/v2.1/os-volumes/35d73fe2-e0bf-402e-b7dc-b604e9ad28d1 => generated 350 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:33.121422 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-58f7f753-bd5c-48a4-88ac-4088a496e0ac req-bd092241-a52f-40ac-b99d-57e635b0c60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568cbe45-b90d-49d4-8ed6-90923e399d49", "name": "network-vif-plugged", "status": "completed", "tag": "46ab96a5-0e71-4267-bb4f-54da94372f8e"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:33.161594 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-58f7f753-bd5c-48a4-88ac-4088a496e0ac req-bd092241-a52f-40ac-b99d-57e635b0c60e service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:33.164038 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-58f7f753-bd5c-48a4-88ac-4088a496e0ac req-bd092241-a52f-40ac-b99d-57e635b0c60e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:33.172329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-58f7f753-bd5c-48a4-88ac-4088a496e0ac req-bd092241-a52f-40ac-b99d-57e635b0c60e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:33.237669 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-58f7f753-bd5c-48a4-88ac-4088a496e0ac req-bd092241-a52f-40ac-b99d-57e635b0c60e service nova] Creating event network-vif-plugged:46ab96a5-0e71-4267-bb4f-54da94372f8e for instance 568cbe45-b90d-49d4-8ed6-90923e399d49 on n-h2-852085-12 Oct 04 20:43:33.265406 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-58f7f753-bd5c-48a4-88ac-4088a496e0ac req-bd092241-a52f-40ac-b99d-57e635b0c60e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154785 Oct 04 20:43:33.283073 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 722/1457] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:33.294259 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8111b19a-2a70-4c35-a2aa-3c420a1c1540 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-751979261", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "a01e9a88-74fc-4f6c-a9eb-b64446db8cab"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:33.580412 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-8111b19a-2a70-4c35-a2aa-3c420a1c1540 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] validate_networks() for [('a01e9a88-74fc-4f6c-a9eb-b64446db8cab', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:43:35.412991 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f7a3b7b6-ed2f-499d-b5f3-2fbd94a016a0 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:35.581476 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f7a3b7b6-ed2f-499d-b5f3-2fbd94a016a0 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1317 microversion: 2.1 time: 2.859310 Oct 04 20:43:35.609934 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 736/1458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:32 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1317 bytes in 2886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:35.649931 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0a78f181-6a9a-4ee1-a32a-2e05a312cf71 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:35.719008 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-0a78f181-6a9a-4ee1-a32a-2e05a312cf71 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:35.732659 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0a78f181-6a9a-4ee1-a32a-2e05a312cf71 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f'} {{(pid=123540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:43:35.770881 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0a78f181-6a9a-4ee1-a32a-2e05a312cf71 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:35.784571 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0a78f181-6a9a-4ee1-a32a-2e05a312cf71 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:35.789125 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0a78f181-6a9a-4ee1-a32a-2e05a312cf71 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:35.796887 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0a78f181-6a9a-4ee1-a32a-2e05a312cf71 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:35.806423 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0a78f181-6a9a-4ee1-a32a-2e05a312cf71 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:35.809815 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0a78f181-6a9a-4ee1-a32a-2e05a312cf71 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.481178 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.multi_cell_list [None req-0a78f181-6a9a-4ee1-a32a-2e05a312cf71 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:43:36.914252 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0a78f181-6a9a-4ee1-a32a-2e05a312cf71 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 1.297647 Oct 04 20:43:36.937494 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 737/1459] 10.222.0.78 () {58 vars in 1150 bytes} [Tue Oct 4 20:43:35 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:36.976173 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:36.987285 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:37.025119 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.038657 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.040289 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.045323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.048651 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.054083 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.224731 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.240909 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.242012 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.248272 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lazy-loading 'fault' on Instance uuid 9d42994f-e35e-413c-a0a3-14bb3878e209 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-8111b19a-2a70-4c35-a2aa-3c420a1c1540 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7edde84b-b253-487b-b88b-1dc975b1cba3) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:43:37.312584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7edde84b-b253-487b-b88b-1dc975b1cba3) Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-8111b19a-2a70-4c35-a2aa-3c420a1c1540 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:37.326457 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8111b19a-2a70-4c35-a2aa-3c420a1c1540 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] Request method failure captured: Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 209 Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJrtqmeo7jkMjrMRXzqfwLMObTBGrXH1lnxgmlbyprQl42zwuEP3Ijh7w5WGbFeTtwMa9ngs4ibe5oKKCpx6Bt1Qm7r_sLJwfyrWVYSqE6Yd_WA6uOX6G1YF7iEA7yXrKMRxYkoj0GUp8HrEYdNtcMt2bQ_e_R61wR7EYwG__Cm_XW4 Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: a9756cde63f04174a293f5b7558d1a96 Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1197486047 Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a9756cde63f04174a293f5b7558d1a96", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9756cde63f04174a293f5b7558d1a96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9756cde63f04174a293f5b7558d1a96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a9756cde63f04174a293f5b7558d1a96"}]}] Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServerDiskConfigTestJSON-1197486047 Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: a9756cde63f04174a293f5b7558d1a96 Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1197486047 Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServerDiskConfigTestJSON-1197486047-project Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 4636896816224423b6f379b160c609ee Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServerDiskConfigTestJSON-1197486047-project Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-751979261", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "a01e9a88-74fc-4f6c-a9eb-b64446db8cab"}]}} Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-751979261', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'a01e9a88-74fc-4f6c-a9eb-b64446db8cab'}]}}} Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:43:37.336436 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7edde84b-b253-487b-b88b-1dc975b1cba3) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:43:37.343912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:37.349911 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:37.351686 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8111b19a-2a70-4c35-a2aa-3c420a1c1540 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:43:37.351686 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:37.357172 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8111b19a-2a70-4c35-a2aa-3c420a1c1540 tempest-ServerDiskConfigTestJSON-1197486047 tempest-ServerDiskConfigTestJSON-1197486047-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 4.087577 Oct 04 20:43:37.362353 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 723/1460] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:43:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 4094 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:43:37.396552 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-3bdc67c5-b005-460a-a25f-0c1a8cf5cfb8 req-ca1d2865-0f8c-4eb1-8907-bcf2cd4e1a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d42994f-e35e-413c-a0a3-14bb3878e209", "name": "network-vif-deleted", "tag": "2a1a7e79-2aa6-49de-b62c-90d4d8aa18d1"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:37.450730 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=52 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:37.480782 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-3bdc67c5-b005-460a-a25f-0c1a8cf5cfb8 req-ca1d2865-0f8c-4eb1-8907-bcf2cd4e1a25 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.503737 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-3bdc67c5-b005-460a-a25f-0c1a8cf5cfb8 req-ca1d2865-0f8c-4eb1-8907-bcf2cd4e1a25 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.510889 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-3bdc67c5-b005-460a-a25f-0c1a8cf5cfb8 req-ca1d2865-0f8c-4eb1-8907-bcf2cd4e1a25 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.528071 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:37.602450 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-3bdc67c5-b005-460a-a25f-0c1a8cf5cfb8 req-ca1d2865-0f8c-4eb1-8907-bcf2cd4e1a25 service nova] Creating event network-vif-deleted:2a1a7e79-2aa6-49de-b62c-90d4d8aa18d1 for instance 9d42994f-e35e-413c-a0a3-14bb3878e209 on n-h2-852085-12 Oct 04 20:43:37.700950 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:37.747233 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-3bdc67c5-b005-460a-a25f-0c1a8cf5cfb8 req-ca1d2865-0f8c-4eb1-8907-bcf2cd4e1a25 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.343761 Oct 04 20:43:37.761274 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 724/1461] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:37.876643 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ccaebb74-8e7c-471c-a5c5-0a9f9647aa38 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:37.888279 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ccaebb74-8e7c-471c-a5c5-0a9f9647aa38 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:37.992109 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ccaebb74-8e7c-471c-a5c5-0a9f9647aa38 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.993842 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ccaebb74-8e7c-471c-a5c5-0a9f9647aa38 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:38.006304 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ccaebb74-8e7c-471c-a5c5-0a9f9647aa38 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:38.018314 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ccaebb74-8e7c-471c-a5c5-0a9f9647aa38 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:38.025079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ccaebb74-8e7c-471c-a5c5-0a9f9647aa38 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:38.029727 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ccaebb74-8e7c-471c-a5c5-0a9f9647aa38 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:38.192264 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:38.289751 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d0007762-d4eb-4982-8a44-732f1ead5d4c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1308 microversion: 2.1 time: 1.343227 Oct 04 20:43:38.297147 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 738/1462] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:36 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1308 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:38.326665 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-425adc90-c0eb-43b9-88e2-a32c0e2e3204 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:38.346458 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-425adc90-c0eb-43b9-88e2-a32c0e2e3204 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:38.405356 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-425adc90-c0eb-43b9-88e2-a32c0e2e3204 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:38.411556 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-425adc90-c0eb-43b9-88e2-a32c0e2e3204 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:38.415366 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-425adc90-c0eb-43b9-88e2-a32c0e2e3204 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:38.419725 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-425adc90-c0eb-43b9-88e2-a32c0e2e3204 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:38.422986 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-425adc90-c0eb-43b9-88e2-a32c0e2e3204 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:38.429404 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-425adc90-c0eb-43b9-88e2-a32c0e2e3204 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:39.714096 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-425adc90-c0eb-43b9-88e2-a32c0e2e3204 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action" status: 202 len: 0 microversion: 2.1 time: 1.413821 Oct 04 20:43:39.716130 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 739/1463] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:38 2022] POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action => generated 0 bytes in 1418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:43:39.732005 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:39.740690 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:39.778575 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:39.788855 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:39.790325 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:39.796942 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:39.798700 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:39.799869 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:39.902300 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ccaebb74-8e7c-471c-a5c5-0a9f9647aa38 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:39.957942 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ccaebb74-8e7c-471c-a5c5-0a9f9647aa38 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1317 microversion: 2.1 time: 2.190986 Oct 04 20:43:39.970642 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 725/1464] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:37 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1317 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:40.008137 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-88091335-932b-4b1e-b5c1-909c97eeacd5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:40.013149 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-88091335-932b-4b1e-b5c1-909c97eeacd5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:40.055448 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-88091335-932b-4b1e-b5c1-909c97eeacd5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:40.068594 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-88091335-932b-4b1e-b5c1-909c97eeacd5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:40.073869 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-88091335-932b-4b1e-b5c1-909c97eeacd5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:40.076171 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-88091335-932b-4b1e-b5c1-909c97eeacd5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:40.080480 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-88091335-932b-4b1e-b5c1-909c97eeacd5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:40.086419 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:40.087987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-88091335-932b-4b1e-b5c1-909c97eeacd5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:40.095516 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:40.098560 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:40.114039 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lazy-loading 'fault' on Instance uuid 9d42994f-e35e-413c-a0a3-14bb3878e209 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:40.118550 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:40.317168 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=10 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:40.399097 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:40.445952 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-052b612a-776e-44ec-b96e-c37701a81f43 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 200 len: 1308 microversion: 2.1 time: 0.727514 Oct 04 20:43:40.454899 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 740/1465] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:39 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 1308 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:41.024471 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7b5dff6b-e0b7-4a6a-bf5a-6fbed0e2f087 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:41.031316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7b5dff6b-e0b7-4a6a-bf5a-6fbed0e2f087 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:41.095810 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7b5dff6b-e0b7-4a6a-bf5a-6fbed0e2f087 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:41.097683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7b5dff6b-e0b7-4a6a-bf5a-6fbed0e2f087 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:41.104448 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7b5dff6b-e0b7-4a6a-bf5a-6fbed0e2f087 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:41.112374 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7b5dff6b-e0b7-4a6a-bf5a-6fbed0e2f087 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:41.121234 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7b5dff6b-e0b7-4a6a-bf5a-6fbed0e2f087 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:41.130749 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7b5dff6b-e0b7-4a6a-bf5a-6fbed0e2f087 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:41.834729 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-88091335-932b-4b1e-b5c1-909c97eeacd5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1616 microversion: 2.1 time: 1.856566 Oct 04 20:43:41.865674 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 726/1466] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:39 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1616 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:41.934566 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c497e549-d853-4f94-b81d-6b159e0f17e0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:41.953491 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c497e549-d853-4f94-b81d-6b159e0f17e0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: 9d42994f-e35e-413c-a0a3-14bb3878e209] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:42.013797 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c497e549-d853-4f94-b81d-6b159e0f17e0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.028569 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c497e549-d853-4f94-b81d-6b159e0f17e0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.029398 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c497e549-d853-4f94-b81d-6b159e0f17e0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:42.030720 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c497e549-d853-4f94-b81d-6b159e0f17e0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.031615 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c497e549-d853-4f94-b81d-6b159e0f17e0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.032394 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c497e549-d853-4f94-b81d-6b159e0f17e0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-c497e549-d853-4f94-b81d-6b159e0f17e0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] HTTP exception thrown: Instance 9d42994f-e35e-413c-a0a3-14bb3878e209 could not be found. Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c497e549-d853-4f94-b81d-6b159e0f17e0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Request method failure captured: Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 HTTP/1.1 Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJmsvv_QZ4gW8perru0gwGANl_vUU2w_cPiidlksFFxTkdgFLqDUCDFOTWx_FykKJceoV3ngjYp0yZtj7jvAwRsX9lxzHF_oqLDGRVCdKy_LsgEnvvjaMv7WsfGVxEMLwyIr4HEn8tDn843ufgZ9Bn78uTmQCxk0OTYJ4BcbeXSEs7g Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: b46055f08aae47a99a59e1192db71b8e Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ListImageFiltersTestJSON-1446086560 Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b46055f08aae47a99a59e1192db71b8e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b46055f08aae47a99a59e1192db71b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b46055f08aae47a99a59e1192db71b8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b46055f08aae47a99a59e1192db71b8e"}]}] Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ListImageFiltersTestJSON-1446086560 Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: b46055f08aae47a99a59e1192db71b8e Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1446086560 Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ListImageFiltersTestJSON-1446086560-project Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 5e0144899b8946309d4524a4cf515d98 Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ListImageFiltersTestJSON-1446086560-project Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 9d42994f-e35e-413c-a0a3-14bb3878e209 could not be found. Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '9d42994f-e35e-413c-a0a3-14bb3878e209'} Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d42994f-e35e-413c-a0a3-14bb3878e209 could not be found. Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:43:42.124903 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:43:42.129708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d42994f-e35e-413c-a0a3-14bb3878e209 could not be found. Oct 04 20:43:42.129708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:42.129708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:42.129708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:42.129708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:42.129708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:42.129708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:42.129708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:42.129708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:42.129708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d42994f-e35e-413c-a0a3-14bb3878e209 could not be found. Oct 04 20:43:42.129708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:43:42.129708 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c497e549-d853-4f94-b81d-6b159e0f17e0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Returning 404 to user: Instance 9d42994f-e35e-413c-a0a3-14bb3878e209 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:42.134888 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c497e549-d853-4f94-b81d-6b159e0f17e0 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209" status: 404 len: 111 microversion: 2.1 time: 0.244119 Oct 04 20:43:42.136719 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 727/1467] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:41 2022] GET /compute/v2.1/servers/9d42994f-e35e-413c-a0a3-14bb3878e209 => generated 111 bytes in 270 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:43:42.147577 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-353dfefa-6c7b-4c24-85ab-20bcaaf572e0 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:42.149349 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-353dfefa-6c7b-4c24-85ab-20bcaaf572e0 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:42.164808 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-353dfefa-6c7b-4c24-85ab-20bcaaf572e0 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.166412 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-353dfefa-6c7b-4c24-85ab-20bcaaf572e0 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.167535 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-353dfefa-6c7b-4c24-85ab-20bcaaf572e0 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:42.169218 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-353dfefa-6c7b-4c24-85ab-20bcaaf572e0 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.170346 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-353dfefa-6c7b-4c24-85ab-20bcaaf572e0 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.175714 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-353dfefa-6c7b-4c24-85ab-20bcaaf572e0 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:44.013294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7b5dff6b-e0b7-4a6a-bf5a-6fbed0e2f087 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:44.088956 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7b5dff6b-e0b7-4a6a-bf5a-6fbed0e2f087 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1466 microversion: 2.1 time: 3.073631 Oct 04 20:43:44.115015 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 741/1468] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:41 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1466 bytes in 3076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:44.178898 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3b7e82aa-b984-4e3d-b308-a388cca33132 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:44.182154 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3b7e82aa-b984-4e3d-b308-a388cca33132 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:44.228962 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:44.243474 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b7e82aa-b984-4e3d-b308-a388cca33132 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:44.245690 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b7e82aa-b984-4e3d-b308-a388cca33132 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:44.248700 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b7e82aa-b984-4e3d-b308-a388cca33132 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:44.254842 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b7e82aa-b984-4e3d-b308-a388cca33132 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:44.261798 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b7e82aa-b984-4e3d-b308-a388cca33132 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:44.265240 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b7e82aa-b984-4e3d-b308-a388cca33132 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:44.526711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3b7e82aa-b984-4e3d-b308-a388cca33132 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:43:44.541468 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-353dfefa-6c7b-4c24-85ab-20bcaaf572e0 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1616 microversion: 2.1 time: 2.398609 Oct 04 20:43:44.547045 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 728/1469] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:42 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1616 bytes in 2409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:44.586327 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-563d4ed2-ae35-4e3d-96bb-e9998d106214 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] Calling method '.version_select at 0x7f77eee76ee0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:45.046590 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-563d4ed2-ae35-4e3d-96bb-e9998d106214 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/f5157496-d914-47b9-a499-20dc95477747" status: 200 len: 350 microversion: 2.1 time: 0.487145 Oct 04 20:43:45.048149 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 729/1470] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:43:44 2022] GET /compute/v2.1/os-volumes/f5157496-d914-47b9-a499-20dc95477747 => generated 350 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:45.106823 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2a563226-d423-4208-9058-21ee43d2a768 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-577875689", "metadata": {"image_type": "test"}}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:45.134196 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2a563226-d423-4208-9058-21ee43d2a768 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:45.213924 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a563226-d423-4208-9058-21ee43d2a768 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:45.217575 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a563226-d423-4208-9058-21ee43d2a768 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:45.221793 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a563226-d423-4208-9058-21ee43d2a768 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:45.226427 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a563226-d423-4208-9058-21ee43d2a768 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:45.232785 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a563226-d423-4208-9058-21ee43d2a768 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:45.236475 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2a563226-d423-4208-9058-21ee43d2a768 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:45.502466 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-2a563226-d423-4208-9058-21ee43d2a768 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Getting quotas for project baa9bc0601f141e48e1b5f001769d221. Resources: dict_keys(['metadata_items']) {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:43:45.552532 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-2a563226-d423-4208-9058-21ee43d2a768 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Getting quotas for user c7677d259d034a68aaba770506475f73 and project baa9bc0601f141e48e1b5f001769d221. Resources: dict_keys(['metadata_items']) {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:43:45.589009 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3b7e82aa-b984-4e3d-b308-a388cca33132 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364" status: 204 len: 0 microversion: 2.1 time: 1.465857 Oct 04 20:43:45.594130 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 742/1471] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:43:44 2022] DELETE /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364 => generated 0 bytes in 1478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:43:45.629243 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-baa31524-690b-4dd2-ac67-0580216d19a3 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:45.666190 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-baa31524-690b-4dd2-ac67-0580216d19a3 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Searching by: {'host': 'n-h1-852085-12', 'deleted': False} {{(pid=123540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:43:45.703745 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-baa31524-690b-4dd2-ac67-0580216d19a3 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:45.712591 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-baa31524-690b-4dd2-ac67-0580216d19a3 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:45.724509 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-baa31524-690b-4dd2-ac67-0580216d19a3 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:45.726226 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-baa31524-690b-4dd2-ac67-0580216d19a3 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:45.728738 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-baa31524-690b-4dd2-ac67-0580216d19a3 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:45.729144 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-baa31524-690b-4dd2-ac67-0580216d19a3 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:46.372533 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.multi_cell_list [None req-baa31524-690b-4dd2-ac67-0580216d19a3 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=123540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:43:46.766000 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-baa31524-690b-4dd2-ac67-0580216d19a3 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "GET /compute/v2.1/servers?host=n-h1-852085-12&all_tenants=1" status: 200 len: 1319 microversion: 2.1 time: 1.168478 Oct 04 20:43:46.778065 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 743/1472] 10.222.0.78 () {58 vars in 1192 bytes} [Tue Oct 4 20:43:45 2022] GET /compute/v2.1/servers?host=n-h1-852085-12&all_tenants=1 => generated 1319 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:46.824875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0f8534a1-9379-4ed5-884e-2dc0ea3806da tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] Calling method '.version_select at 0x7f77f7498040>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:47.129587 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2a563226-d423-4208-9058-21ee43d2a768 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "POST /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49/action" status: 202 len: 0 microversion: 2.1 time: 2.073399 Oct 04 20:43:47.137014 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 730/1473] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:45 2022] POST /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49/action => generated 0 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:43:47.196561 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d1e81818-1305-4841-a0a0-f167388aff27 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:47.213333 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d1e81818-1305-4841-a0a0-f167388aff27 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:47.307347 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d1e81818-1305-4841-a0a0-f167388aff27 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:47.316887 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d1e81818-1305-4841-a0a0-f167388aff27 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:47.325718 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d1e81818-1305-4841-a0a0-f167388aff27 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:47.329692 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d1e81818-1305-4841-a0a0-f167388aff27 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:47.344101 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d1e81818-1305-4841-a0a0-f167388aff27 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:47.349097 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d1e81818-1305-4841-a0a0-f167388aff27 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:47.523746 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0f8534a1-9379-4ed5-884e-2dc0ea3806da tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.740817 Oct 04 20:43:47.525723 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 744/1474] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 4 20:43:46 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:47.550297 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9eb59530-d315-4d1f-a07e-91ad1cad4abb tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:47.605914 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9eb59530-d315-4d1f-a07e-91ad1cad4abb tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=123540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:43:47.630923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9eb59530-d315-4d1f-a07e-91ad1cad4abb tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:47.638294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9eb59530-d315-4d1f-a07e-91ad1cad4abb tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:47.642685 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9eb59530-d315-4d1f-a07e-91ad1cad4abb tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:47.645692 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9eb59530-d315-4d1f-a07e-91ad1cad4abb tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:47.649508 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9eb59530-d315-4d1f-a07e-91ad1cad4abb tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:47.651466 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9eb59530-d315-4d1f-a07e-91ad1cad4abb tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:47.748160 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9eb59530-d315-4d1f-a07e-91ad1cad4abb tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.220103 Oct 04 20:43:47.749587 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 745/1475] 10.222.0.78 () {58 vars in 1196 bytes} [Tue Oct 4 20:43:47 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:43:47.776552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c9430899-cd6e-4afe-9255-98094f3d4b5d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f74c5dc0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:47.958710 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c9430899-cd6e-4afe-9255-98094f3d4b5d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561" status: 200 len: 1423 microversion: 2.1 time: 0.192219 Oct 04 20:43:47.972335 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 746/1476] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:43:47 2022] GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 => generated 1423 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:47.992387 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a5003723-a6af-49a3-a15d-a8756e059b11 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] Calling method '.version_select at 0x7f77f73e7160>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:48.663096 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a5003723-a6af-49a3-a15d-a8756e059b11 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.687554 Oct 04 20:43:48.664013 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 747/1477] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 4 20:43:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:48.701522 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fb6b7748-830b-4fad-abde-eedbb039ac23 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:48.716673 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-fb6b7748-830b-4fad-abde-eedbb039ac23 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:48.757309 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb6b7748-830b-4fad-abde-eedbb039ac23 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:48.758173 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb6b7748-830b-4fad-abde-eedbb039ac23 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:48.759044 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb6b7748-830b-4fad-abde-eedbb039ac23 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:48.783253 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb6b7748-830b-4fad-abde-eedbb039ac23 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:48.784277 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb6b7748-830b-4fad-abde-eedbb039ac23 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:48.784568 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb6b7748-830b-4fad-abde-eedbb039ac23 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:49.141353 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d1e81818-1305-4841-a0a0-f167388aff27 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:49.209106 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d1e81818-1305-4841-a0a0-f167388aff27 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364" status: 200 len: 1473 microversion: 2.1 time: 2.064385 Oct 04 20:43:49.213201 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 731/1478] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:47 2022] GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364 => generated 1473 bytes in 2075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:49.237093 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-671e714e-d890-4418-8cc1-db487f582678 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] Calling method '.version_select at 0x7f77eee2b790>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:49.603699 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fb6b7748-830b-4fad-abde-eedbb039ac23 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action" status: 202 len: 0 microversion: 2.1 time: 0.925098 Oct 04 20:43:49.625569 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 748/1479] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:48 2022] POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action => generated 0 bytes in 940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:43:49.655044 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1c49da9e-3e43-4558-9ad1-ae5318aa330f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f75831f0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:49.990578 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-671e714e-d890-4418-8cc1-db487f582678 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.772637 Oct 04 20:43:49.992096 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 732/1480] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 4 20:43:49 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:50.026397 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1c49da9e-3e43-4558-9ad1-ae5318aa330f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561" status: 200 len: 1423 microversion: 2.1 time: 0.401311 Oct 04 20:43:50.040414 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:50.050745 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 749/1481] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:43:49 2022] GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 => generated 1423 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:50.060990 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:50.090413 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-81732a25-5932-4acb-912e-6200e12b6597 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] Calling method '.version_select at 0x7f77f7498670>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:50.123987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:50.129273 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:50.132066 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:50.139212 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:50.148312 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:50.151345 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:50.846210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:43:50.849235 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:43:50.855260 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:43:50.856646 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:43:50.860015 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:43:50.876654 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-81732a25-5932-4acb-912e-6200e12b6597 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.808512 Oct 04 20:43:50.887161 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 750/1482] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 4 20:43:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:50.891211 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bc700959-1da1-47c4-820e-f64606933545 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:50.898640 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-bc700959-1da1-47c4-820e-f64606933545 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:50.960683 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc700959-1da1-47c4-820e-f64606933545 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:50.961457 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc700959-1da1-47c4-820e-f64606933545 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:50.962694 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc700959-1da1-47c4-820e-f64606933545 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:51.008379 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc700959-1da1-47c4-820e-f64606933545 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:51.009198 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc700959-1da1-47c4-820e-f64606933545 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:51.013837 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bc700959-1da1-47c4-820e-f64606933545 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:51.420677 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:51.466848 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:51.482132 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:51.485457 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:51.497443 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:51.498736 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:51.499835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:51.656409 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d7edff1b-9aa9-4828-8b72-0f1c8d6e626c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action" status: 202 len: 1067 microversion: 2.1 time: 1.661132 Oct 04 20:43:51.658129 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 733/1483] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:49 2022] POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action => generated 1067 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 20:43:51.757544 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-79d0fc4a-4b2d-4447-b3db-a2b6d1a65e01 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] Calling method '.version_select at 0x7f77eed8ee50>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:52.282488 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-bc700959-1da1-47c4-820e-f64606933545 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:52.314131 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bc700959-1da1-47c4-820e-f64606933545 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364" status: 200 len: 1473 microversion: 2.1 time: 1.434684 Oct 04 20:43:52.331284 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 751/1484] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:50 2022] GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364 => generated 1473 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:52.373466 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cfda693b-328b-4ac9-8394-3d1eb07a276e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f73e74c0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:52.497775 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-79d0fc4a-4b2d-4447-b3db-a2b6d1a65e01 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.757008 Oct 04 20:43:52.516400 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 734/1485] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Oct 4 20:43:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:52.539524 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2b7277a4-1d59-451c-8ccf-e1c3a9674674 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:52.554285 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2b7277a4-1d59-451c-8ccf-e1c3a9674674 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:52.621145 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cfda693b-328b-4ac9-8394-3d1eb07a276e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561" status: 200 len: 1423 microversion: 2.1 time: 0.281934 Oct 04 20:43:52.631358 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 752/1486] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:43:52 2022] GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 => generated 1423 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:52.645771 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b7277a4-1d59-451c-8ccf-e1c3a9674674 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:52.646829 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b7277a4-1d59-451c-8ccf-e1c3a9674674 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:52.648605 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d512b2de-599c-4393-9598-62b50c63382a tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] Calling method '.version_select at 0x7f77f7583040>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:52.684445 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b7277a4-1d59-451c-8ccf-e1c3a9674674 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:52.714332 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b7277a4-1d59-451c-8ccf-e1c3a9674674 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:52.731864 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b7277a4-1d59-451c-8ccf-e1c3a9674674 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:52.733032 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b7277a4-1d59-451c-8ccf-e1c3a9674674 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:53.089496 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d512b2de-599c-4393-9598-62b50c63382a tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.456984 Oct 04 20:43:53.091179 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 753/1487] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:43:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:53.134808 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e377c109-d4e4-4d86-9996-ae4c8676dad4 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] Calling method '.version_select at 0x7f77f73f6670>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:53.691529 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e377c109-d4e4-4d86-9996-ae4c8676dad4 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.560278 Oct 04 20:43:53.692883 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 754/1488] 10.222.0.78 () {58 vars in 1188 bytes} [Tue Oct 4 20:43:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:43:53.716426 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b3bd1384-2e7d-4060-b8f4-7f1837b897f1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:53.720346 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b3bd1384-2e7d-4060-b8f4-7f1837b897f1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:53.757728 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3bd1384-2e7d-4060-b8f4-7f1837b897f1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:53.758485 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3bd1384-2e7d-4060-b8f4-7f1837b897f1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:53.759900 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3bd1384-2e7d-4060-b8f4-7f1837b897f1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:53.761028 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3bd1384-2e7d-4060-b8f4-7f1837b897f1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:53.761737 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3bd1384-2e7d-4060-b8f4-7f1837b897f1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:53.762392 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b3bd1384-2e7d-4060-b8f4-7f1837b897f1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:54.398196 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2b7277a4-1d59-451c-8ccf-e1c3a9674674 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:54.440397 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2b7277a4-1d59-451c-8ccf-e1c3a9674674 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1471 microversion: 2.1 time: 1.930901 Oct 04 20:43:54.447965 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 735/1489] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:52 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1471 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:54.473771 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a56af3f8-6f5c-4278-b0db-e2408a7329fa tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eee31940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:54.627030 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a56af3f8-6f5c-4278-b0db-e2408a7329fa tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561" status: 200 len: 1423 microversion: 2.1 time: 0.168459 Oct 04 20:43:54.628600 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 736/1490] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:43:54 2022] GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 => generated 1423 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:54.637588 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a5b09ca0-b8d1-4271-81c0-f5ac97c05850 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] Calling method '.version_select at 0x7f77eeeba670>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:55.019437 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a5b09ca0-b8d1-4271-81c0-f5ac97c05850 tempest-VolumesTestJSON-1895827030 tempest-VolumesTestJSON-1895827030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.388379 Oct 04 20:43:55.021233 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 737/1491] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:43:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:55.034066 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-10603f48-832c-40fb-88fb-b026a33b49ce tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] Action: 'create', calling method: .version_select at 0x7f77eef63e50>, body: {"keypair": {"name": "tempest-keypair-106158845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCZDI8Ak8adJ/mdL/kuSifIO7n0OyRNuKCqq7X4J91Paai/YP5JY5QDWt+y8m4qqS81IYE1yAJKjVuaAXcrvy1x2jVah3CEwATLL/iJru5vTzuKcIRvdu7+PJDGovXz8g=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:55.086846 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-10603f48-832c-40fb-88fb-b026a33b49ce tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] Getting quotas for project 6c5aaa2031d8481ebc5a7b3b9a0522dc. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:43:55.124386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-10603f48-832c-40fb-88fb-b026a33b49ce tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] Getting quotas for user f641a595a9e242da9564a483717f3b48 and project 6c5aaa2031d8481ebc5a7b3b9a0522dc. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:43:55.202984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b3bd1384-2e7d-4060-b8f4-7f1837b897f1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:55.252674 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b3bd1384-2e7d-4060-b8f4-7f1837b897f1 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364" status: 200 len: 1473 microversion: 2.1 time: 1.546499 Oct 04 20:43:55.254013 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 755/1492] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:53 2022] GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364 => generated 1473 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:55.482784 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-10603f48-832c-40fb-88fb-b026a33b49ce tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.459266 Oct 04 20:43:55.498835 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 738/1493] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 4 20:43:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 475 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:43:55.501511 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-29345230-133a-4641-ba93-45fdca42e69e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:55.504067 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-29345230-133a-4641-ba93-45fdca42e69e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:55.516386 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-29345230-133a-4641-ba93-45fdca42e69e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:55.517638 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-29345230-133a-4641-ba93-45fdca42e69e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:55.520369 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-29345230-133a-4641-ba93-45fdca42e69e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:55.520369 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-29345230-133a-4641-ba93-45fdca42e69e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:55.521653 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-29345230-133a-4641-ba93-45fdca42e69e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:55.522744 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-29345230-133a-4641-ba93-45fdca42e69e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:55.681353 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-105d9781-b168-40ca-8c96-6ecfe07b662d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eef62dc0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:56.499986 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-105d9781-b168-40ca-8c96-6ecfe07b662d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561" status: 200 len: 1423 microversion: 2.1 time: 0.845453 Oct 04 20:43:56.517774 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 739/1494] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:43:55 2022] GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 => generated 1423 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:56.538702 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c86cbc00-4a32-4159-b632-53aaa3b37d5c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:56.542859 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c86cbc00-4a32-4159-b632-53aaa3b37d5c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:56.553307 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c86cbc00-4a32-4159-b632-53aaa3b37d5c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:56.554139 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c86cbc00-4a32-4159-b632-53aaa3b37d5c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:56.555219 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c86cbc00-4a32-4159-b632-53aaa3b37d5c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:56.562040 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c86cbc00-4a32-4159-b632-53aaa3b37d5c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:56.563501 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c86cbc00-4a32-4159-b632-53aaa3b37d5c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:56.565492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c86cbc00-4a32-4159-b632-53aaa3b37d5c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:56.623211 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-29345230-133a-4641-ba93-45fdca42e69e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:56.681012 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-29345230-133a-4641-ba93-45fdca42e69e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1471 microversion: 2.1 time: 1.191468 Oct 04 20:43:56.685469 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 756/1495] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:55 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1471 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:57.005352 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c86cbc00-4a32-4159-b632-53aaa3b37d5c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:57.062404 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c86cbc00-4a32-4159-b632-53aaa3b37d5c tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364" status: 200 len: 1431 microversion: 2.1 time: 0.538777 Oct 04 20:43:57.077744 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 740/1496] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:56 2022] GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364 => generated 1431 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:57.544480 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-60ef292b-b374-4499-a917-e1bb067ccf5d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f73f6820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:57.724406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:57.748600 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-02835bbd-30a4-4332-b2ee-c85f86b86714 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:57.753708 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-02835bbd-30a4-4332-b2ee-c85f86b86714 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:57.816519 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-02835bbd-30a4-4332-b2ee-c85f86b86714 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:57.817743 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-02835bbd-30a4-4332-b2ee-c85f86b86714 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:57.818590 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-02835bbd-30a4-4332-b2ee-c85f86b86714 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:57.820816 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-02835bbd-30a4-4332-b2ee-c85f86b86714 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:57.853624 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-02835bbd-30a4-4332-b2ee-c85f86b86714 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:57.862660 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-02835bbd-30a4-4332-b2ee-c85f86b86714 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:59.376404 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-02835bbd-30a4-4332-b2ee-c85f86b86714 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:59.425433 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-02835bbd-30a4-4332-b2ee-c85f86b86714 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1471 microversion: 2.1 time: 1.699633 Oct 04 20:43:59.438445 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 741/1497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:57 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1471 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:43:59.500548 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-12f7267e-1e8f-4664-9690-db4f9d2a91bd req-6daa13cf-cc33-46f8-b0f4-4216451e197e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd64c084-10af-4b12-bdd9-ef53866be364", "name": "network-vif-deleted", "tag": "a55c4fe7-8c63-4a39-819e-95561de2446e"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:59.548370 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-12f7267e-1e8f-4664-9690-db4f9d2a91bd req-6daa13cf-cc33-46f8-b0f4-4216451e197e service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:59.562587 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-12f7267e-1e8f-4664-9690-db4f9d2a91bd req-6daa13cf-cc33-46f8-b0f4-4216451e197e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:59.563925 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-12f7267e-1e8f-4664-9690-db4f9d2a91bd req-6daa13cf-cc33-46f8-b0f4-4216451e197e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:59.638974 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-12f7267e-1e8f-4664-9690-db4f9d2a91bd req-6daa13cf-cc33-46f8-b0f4-4216451e197e service nova] Creating event network-vif-deleted:a55c4fe7-8c63-4a39-819e-95561de2446e for instance bd64c084-10af-4b12-bdd9-ef53866be364 on n-h1-852085-12 Oct 04 20:43:59.666915 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-12f7267e-1e8f-4664-9690-db4f9d2a91bd req-6daa13cf-cc33-46f8-b0f4-4216451e197e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206855 Oct 04 20:43:59.671562 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 742/1498] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:59.731769 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:59.736763 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:59.773181 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:59.778035 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:59.781810 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:59.783646 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:59.786572 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:59.791163 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:59.984619 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:59.989481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:59.991010 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:59.992173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lazy-loading 'fault' on Instance uuid bd64c084-10af-4b12-bdd9-ef53866be364 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:44:00.228901 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0144899b8946309d4524a4cf515d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46055f08aae47a99a59e1192db71b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:00.262304 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ff81155b-4c91-485d-8fcd-4e115c3585da tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364" status: 200 len: 1307 microversion: 2.1 time: 0.567567 Oct 04 20:44:00.267466 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 743/1499] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:59 2022] GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364 => generated 1307 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:00.502257 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-58f57588-6413-4c80-bf1f-5c2b83208909 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:00.507909 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-58f57588-6413-4c80-bf1f-5c2b83208909 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:00.584301 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-58f57588-6413-4c80-bf1f-5c2b83208909 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:00.591070 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-58f57588-6413-4c80-bf1f-5c2b83208909 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:00.615551 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-58f57588-6413-4c80-bf1f-5c2b83208909 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:00.624330 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-58f57588-6413-4c80-bf1f-5c2b83208909 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:00.643475 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-58f57588-6413-4c80-bf1f-5c2b83208909 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:00.644427 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-58f57588-6413-4c80-bf1f-5c2b83208909 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:02.176065 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-58f57588-6413-4c80-bf1f-5c2b83208909 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:02.264042 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-58f57588-6413-4c80-bf1f-5c2b83208909 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1471 microversion: 2.1 time: 1.778835 Oct 04 20:44:02.288203 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 744/1500] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:00 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1471 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:02.320089 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e3cc8a32-cec2-4a9a-80bb-affeb1e75a94 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:02.329781 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e3cc8a32-cec2-4a9a-80bb-affeb1e75a94 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] [instance: bd64c084-10af-4b12-bdd9-ef53866be364] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:02.352710 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3cc8a32-cec2-4a9a-80bb-affeb1e75a94 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:02.358005 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3cc8a32-cec2-4a9a-80bb-affeb1e75a94 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:02.358987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3cc8a32-cec2-4a9a-80bb-affeb1e75a94 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:02.363752 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3cc8a32-cec2-4a9a-80bb-affeb1e75a94 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:02.364570 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3cc8a32-cec2-4a9a-80bb-affeb1e75a94 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:02.377749 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3cc8a32-cec2-4a9a-80bb-affeb1e75a94 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:02.437054 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-e3cc8a32-cec2-4a9a-80bb-affeb1e75a94 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] HTTP exception thrown: Instance bd64c084-10af-4b12-bdd9-ef53866be364 could not be found. Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e3cc8a32-cec2-4a9a-80bb-affeb1e75a94 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Request method failure captured: Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364 HTTP/1.1 Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJmsvv_QZ4gW8perru0gwGANl_vUU2w_cPiidlksFFxTkdgFLqDUCDFOTWx_FykKJceoV3ngjYp0yZtj7jvAwRsX9lxzHF_oqLDGRVCdKy_LsgEnvvjaMv7WsfGVxEMLwyIr4HEn8tDn843ufgZ9Bn78uTmQCxk0OTYJ4BcbeXSEs7g Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: b46055f08aae47a99a59e1192db71b8e Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ListImageFiltersTestJSON-1446086560 Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b46055f08aae47a99a59e1192db71b8e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b46055f08aae47a99a59e1192db71b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b46055f08aae47a99a59e1192db71b8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b46055f08aae47a99a59e1192db71b8e"}]}] Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ListImageFiltersTestJSON-1446086560 Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: b46055f08aae47a99a59e1192db71b8e Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1446086560 Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ListImageFiltersTestJSON-1446086560-project Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 5e0144899b8946309d4524a4cf515d98 Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ListImageFiltersTestJSON-1446086560-project Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance bd64c084-10af-4b12-bdd9-ef53866be364 could not be found. Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'bd64c084-10af-4b12-bdd9-ef53866be364'} Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd64c084-10af-4b12-bdd9-ef53866be364 could not be found. Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd64c084-10af-4b12-bdd9-ef53866be364 could not be found. Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:02.445708 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:02.460238 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:02.460238 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:02.460238 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:02.460238 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:02.460238 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:02.460238 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd64c084-10af-4b12-bdd9-ef53866be364 could not be found. Oct 04 20:44:02.460238 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:02.499537 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e3cc8a32-cec2-4a9a-80bb-affeb1e75a94 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Returning 404 to user: Instance bd64c084-10af-4b12-bdd9-ef53866be364 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:02.507588 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e3cc8a32-cec2-4a9a-80bb-affeb1e75a94 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364" status: 404 len: 111 microversion: 2.1 time: 0.198175 Oct 04 20:44:02.510742 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 745/1501] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:02 2022] GET /compute/v2.1/servers/bd64c084-10af-4b12-bdd9-ef53866be364 => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:02.547636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b842fa20-7e2e-4769-8b8a-5cac6155dac2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eeebab80>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:05.196258 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:05.525409 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:06.650466 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:12.352489 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:12.390528 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:21.838468 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:44:21.839347 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 20:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 (ip 10.222.0.78) !!! Oct 04 20:44:39.136437 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-60ef292b-b374-4499-a917-e1bb067ccf5d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561" status: 200 len: 1432 microversion: 2.1 time: 41.596432 Oct 04 20:44:39.139791 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 757/1502] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:43:57 2022] GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 => generated 1432 bytes in 41615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:39.155232 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-215d8c73-3964-4f51-8440-6f1e55723081 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:39.157326 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-215d8c73-3964-4f51-8440-6f1e55723081 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:39.170534 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-215d8c73-3964-4f51-8440-6f1e55723081 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.172534 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-215d8c73-3964-4f51-8440-6f1e55723081 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.172888 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-215d8c73-3964-4f51-8440-6f1e55723081 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.174256 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-215d8c73-3964-4f51-8440-6f1e55723081 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.175112 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-215d8c73-3964-4f51-8440-6f1e55723081 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.175935 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-215d8c73-3964-4f51-8440-6f1e55723081 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.538732 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b842fa20-7e2e-4769-8b8a-5cac6155dac2 tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "DELETE /compute/v2.1/images/829d0df1-ae76-4afe-9c6c-de0f2a16fea8" status: 204 len: 0 microversion: 2.1 time: 37.020742 Oct 04 20:44:39.540901 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 746/1503] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:02 2022] DELETE /compute/v2.1/images/829d0df1-ae76-4afe-9c6c-de0f2a16fea8 => generated 0 bytes in 37025 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:39.550020 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-e76ee4ae-5f3a-4f93-9b30-fc0bccd54891 req-a91c52a2-2f81-4696-b60d-99d3f08d608e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568cbe45-b90d-49d4-8ed6-90923e399d49", "name": "network-vif-plugged", "status": "completed", "tag": "46ab96a5-0e71-4267-bb4f-54da94372f8e"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:39.572357 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-e76ee4ae-5f3a-4f93-9b30-fc0bccd54891 req-a91c52a2-2f81-4696-b60d-99d3f08d608e service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.574628 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-e76ee4ae-5f3a-4f93-9b30-fc0bccd54891 req-a91c52a2-2f81-4696-b60d-99d3f08d608e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.575742 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-e76ee4ae-5f3a-4f93-9b30-fc0bccd54891 req-a91c52a2-2f81-4696-b60d-99d3f08d608e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.614380 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-e76ee4ae-5f3a-4f93-9b30-fc0bccd54891 req-a91c52a2-2f81-4696-b60d-99d3f08d608e service nova] Creating event network-vif-plugged:46ab96a5-0e71-4267-bb4f-54da94372f8e for instance 568cbe45-b90d-49d4-8ed6-90923e399d49 on n-h2-852085-12 Oct 04 20:44:39.657601 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-e76ee4ae-5f3a-4f93-9b30-fc0bccd54891 req-a91c52a2-2f81-4696-b60d-99d3f08d608e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113802 Oct 04 20:44:39.661607 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 747/1504] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:39.699788 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-37694522-e444-412f-bff5-06c00b9e1d3d tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1412173861", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "76684a80-7326-45f0-83f0-fb100785407f"}, {"port": "2dcc0d61-734d-414a-aa5b-8b02f7908ee5", "tag": "port-1"}, {"port": "0f3e1f36-6db2-46f0-9c39-b492566d6f3f", "tag": "port-2"}, {"uuid": "d440815a-c7cb-41b5-bf01-b92283177fa8", "tag": "net-1"}, {"uuid": "d440815a-c7cb-41b5-bf01-b92283177fa8"}, {"uuid": "b84e7f4d-8664-4a49-a0c3-307d7abc2f7e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b84e7f4d-8664-4a49-a0c3-307d7abc2f7e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "eb3c31d7-19ad-453a-9273-d03bae1c2fbf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ec57b97b-f8d3-4de2-8bf8-525bf49781f7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f2b808d5-4103-4fc3-904f-b716d4c898a2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--657943761"}], "key_name": "tempest-keypair-106158845", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:40.466094 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-215d8c73-3964-4f51-8440-6f1e55723081 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:40.505862 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-215d8c73-3964-4f51-8440-6f1e55723081 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1463 microversion: 2.1 time: 1.345803 Oct 04 20:44:40.509069 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 758/1505] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:39 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1463 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:40.596578 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-37694522-e444-412f-bff5-06c00b9e1d3d tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] validate_networks() for [('76684a80-7326-45f0-83f0-fb100785407f', None, None, None, None, None), (None, None, '2dcc0d61-734d-414a-aa5b-8b02f7908ee5', None, None, None), (None, None, '0f3e1f36-6db2-46f0-9c39-b492566d6f3f', None, None, None), ('d440815a-c7cb-41b5-bf01-b92283177fa8', None, None, None, None, None), ('d440815a-c7cb-41b5-bf01-b92283177fa8', None, None, None, None, None), ('b84e7f4d-8664-4a49-a0c3-307d7abc2f7e', '10.2.2.100', None, None, None, None), ('b84e7f4d-8664-4a49-a0c3-307d7abc2f7e', '10.2.2.200', None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:41.053040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-51da7cd2-0d39-46b6-a878-301b16589e4d tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1576639111", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "4b01a391-c7da-45cc-b2a5-65b181a347df"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:41.181024 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-51da7cd2-0d39-46b6-a878-301b16589e4d tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] validate_networks() for [('4b01a391-c7da-45cc-b2a5-65b181a347df', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-51da7cd2-0d39-46b6-a878-301b16589e4d tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-11cef65e-aa8a-4807-9317-6c7d4b278659) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:44:41.938041 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-11cef65e-aa8a-4807-9317-6c7d4b278659) Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-51da7cd2-0d39-46b6-a878-301b16589e4d tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-51da7cd2-0d39-46b6-a878-301b16589e4d tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] Request method failure captured: Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 226 Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJsk8P7iFGHwtdfWfrllLxCwKE3qY29ZSym9GBWMyAkH-pn4Y4tNiEa2PlBK_OflXkIIgqLpd3emvnqqmhgmQd1Icfzcap1LMBcF3SpLNSjQWEaQn8ntNsQQjySpD4GJEKDx0Z-tX2P_TtnqlLodv5mFhb7H5mw69cp7T20OxufRwlQ Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 9d5c0142707c420798e04f8826804031 Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-MultipleCreateTestJSON-901257962 Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9d5c0142707c420798e04f8826804031", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9d5c0142707c420798e04f8826804031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9d5c0142707c420798e04f8826804031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9d5c0142707c420798e04f8826804031"}]}] Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-MultipleCreateTestJSON-901257962 Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 9d5c0142707c420798e04f8826804031 Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-MultipleCreateTestJSON-901257962 Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-MultipleCreateTestJSON-901257962-project Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 7e9a0befa1584e64870462d780dcfc1f Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-MultipleCreateTestJSON-901257962-project Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-tempest.common.compute-instance-1576639111", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "4b01a391-c7da-45cc-b2a5-65b181a347df"}]}} Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-tempest.common.compute-instance-1576639111', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'min_count': 2, 'networks': [{'uuid': '4b01a391-c7da-45cc-b2a5-65b181a347df'}]}}} Oct 04 20:44:41.957150 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:44:41.965359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-11cef65e-aa8a-4807-9317-6c7d4b278659) Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-51da7cd2-0d39-46b6-a878-301b16589e4d tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-51da7cd2-0d39-46b6-a878-301b16589e4d tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.437601 Oct 04 20:44:41.982283 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 759/1506] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:44:40 2022] POST /compute/v2.1/servers => generated 214 bytes in 1440 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-37694522-e444-412f-bff5-06c00b9e1d3d tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c6b8ba29-e172-4796-adc5-7eed1cfd0046) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:44:42.000054 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c6b8ba29-e172-4796-adc5-7eed1cfd0046) Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-37694522-e444-412f-bff5-06c00b9e1d3d tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:42.007867 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-37694522-e444-412f-bff5-06c00b9e1d3d tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] Request method failure captured: Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 1343 Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJpPmZlNz1egzj-qLllJIexqH7ZPN-8Yy-4DJMA8kWQ2N4sdLQKA1_uVf8kuLE-HSUcVf3DSm422J4oj7CpSt64loJwNDgTuDGL-P2F0Df5Yw1jQUxB_RZcyozPJy8kzLhZlLUYR7bIUDxrcPPe2FXzC9mPv_REimO6jBLxQgZS-vCE Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 6c5aaa2031d8481ebc5a7b3b9a0522dc Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-823522393 Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c5aaa2031d8481ebc5a7b3b9a0522dc", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c5aaa2031d8481ebc5a7b3b9a0522dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c5aaa2031d8481ebc5a7b3b9a0522dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c5aaa2031d8481ebc5a7b3b9a0522dc"}]}] Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TaggedBootDevicesTest_v242-823522393 Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 6c5aaa2031d8481ebc5a7b3b9a0522dc Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-823522393 Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TaggedBootDevicesTest_v242-823522393-project Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: f641a595a9e242da9564a483717f3b48 Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TaggedBootDevicesTest_v242-823522393-project Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-device-tagging-server-1412173861", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "76684a80-7326-45f0-83f0-fb100785407f"}, {"port": "2dcc0d61-734d-414a-aa5b-8b02f7908ee5", "tag": "port-1"}, {"port": "0f3e1f36-6db2-46f0-9c39-b492566d6f3f", "tag": "port-2"}, {"uuid": "d440815a-c7cb-41b5-bf01-b92283177fa8", "tag": "net-1"}, {"uuid": "d440815a-c7cb-41b5-bf01-b92283177fa8"}, {"uuid": "b84e7f4d-8664-4a49-a0c3-307d7abc2f7e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b84e7f4d-8664-4a49-a0c3-307d7abc2f7e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "eb3c31d7-19ad-453a-9273-d03bae1c2fbf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ec57b97b-f8d3-4de2-8bf8-525bf49781f7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f2b808d5-4103-4fc3-904f-b716d4c898a2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--657943761"}], "key_name": "tempest-keypair-106158845", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-device-tagging-server-1412173861', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': '76684a80-7326-45f0-83f0-fb100785407f'}, {'port': '2dcc0d61-734d-414a-aa5b-8b02f7908ee5', 'tag': 'port-1'}, {'port': '0f3e1f36-6db2-46f0-9c39-b492566d6f3f', 'tag': 'port-2'}, {'uuid': 'd440815a-c7cb-41b5-bf01-b92283177fa8', 'tag': 'net-1'}, {'uuid': 'd440815a-c7cb-41b5-bf01-b92283177fa8'}, {'uuid': 'b84e7f4d-8664-4a49-a0c3-307d7abc2f7e', 'fixed_ip': '10.2.2.100', 'tag': 'net-2-100'}, {'uuid': 'b84e7f4d-8664-4a49-a0c3-307d7abc2f7e', 'fixed_ip': '10.2.2.200', 'tag': 'net-2-200'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'tag': 'boot', 'volume_id': 'eb3c31d7-19ad-453a-9273-d03bae1c2fbf', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 1, 'tag': 'other', 'volume_id': 'ec57b97b-f8d3-4de2-8bf8-525bf49781f7', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 2, 'volume_id': 'f2b808d5-4103-4fc3-904f-b716d4c898a2', 'delete_on_termination': False}], 'security_groups': [{'name': 'tempest-securitygroup--657943761'}], 'key_name': 'tempest-keypair-106158845', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:42.011483 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:44:42.028013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c6b8ba29-e172-4796-adc5-7eed1cfd0046) Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-37694522-e444-412f-bff5-06c00b9e1d3d tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-37694522-e444-412f-bff5-06c00b9e1d3d tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.42 time: 2.342833 Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 748/1507] 10.222.0.78 () {62 vars in 1189 bytes} [Tue Oct 4 20:44:39 2022] POST /compute/v2.1/servers => generated 214 bytes in 2351 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 04 20:44:42.037886 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-016a3f72-299f-443d-98b1-462fa023e4ae tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eef5e1f0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:42.145799 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-016a3f72-299f-443d-98b1-462fa023e4ae tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561" status: 200 len: 1432 microversion: 2.1 time: 0.130951 Oct 04 20:44:42.146798 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 749/1508] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:42 2022] GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 => generated 1432 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:42.167044 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d647a559-a97a-46f0-8927-18e7ef3eec0d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee40940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:42.607905 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-79b8c448-9ea6-4eed-b0d3-f6882191cee8 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] Action: 'create', calling method: .version_select at 0x7f77f73f6ee0>, body: {"keypair": {"name": "tempest-keypair-1974675721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvUrwNfNiEmn/Z3hlirNvnDMmkueCBet0SOkHvq38xZGnc8wksEOwfqhmjAk/i+YpyoeK+Fce7OfItgeRwg+pd4cIqSQ+ANMLLrsqZxxO+WA5PtjbO7BXsnPOQ0+JLE9A=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:42.651222 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-79b8c448-9ea6-4eed-b0d3-f6882191cee8 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] Getting quotas for project 1181b876697c473ba1d15bbefeea2cf2. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:42.661679 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-79b8c448-9ea6-4eed-b0d3-f6882191cee8 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] Getting quotas for user 91627f3584b0402896fd6e64b421b458 and project 1181b876697c473ba1d15bbefeea2cf2. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:42.779796 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-79b8c448-9ea6-4eed-b0d3-f6882191cee8 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.827018 Oct 04 20:44:42.781658 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 760/1509] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:44:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:42.814361 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3749822c-3284-4a65-8b69-7be4edf1e5c5 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:42.816909 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3749822c-3284-4a65-8b69-7be4edf1e5c5 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:42.837016 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3749822c-3284-4a65-8b69-7be4edf1e5c5 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.839995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3749822c-3284-4a65-8b69-7be4edf1e5c5 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.841507 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3749822c-3284-4a65-8b69-7be4edf1e5c5 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:42.844039 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3749822c-3284-4a65-8b69-7be4edf1e5c5 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.845634 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3749822c-3284-4a65-8b69-7be4edf1e5c5 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.846605 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3749822c-3284-4a65-8b69-7be4edf1e5c5 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:43.239409 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3749822c-3284-4a65-8b69-7be4edf1e5c5 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:43.254183 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3749822c-3284-4a65-8b69-7be4edf1e5c5 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1463 microversion: 2.1 time: 0.470454 Oct 04 20:44:43.255478 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 761/1510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:42 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1463 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:43.627298 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d647a559-a97a-46f0-8927-18e7ef3eec0d tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "DELETE /compute/v2.1/images/fa153043-0b63-469f-b782-43b9fe9d0813" status: 204 len: 0 microversion: 2.1 time: 1.477689 Oct 04 20:44:43.629403 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 750/1511] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:42 2022] DELETE /compute/v2.1/images/fa153043-0b63-469f-b782-43b9fe9d0813 => generated 0 bytes in 1482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:43.648637 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-6e5f3b73-0902-4b36-b56a-423204ff5796 req-9be46cac-f0fc-4028-a218-7ed8387dd5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3b28cc-8307-4f7a-889b-ab08d068ec0e", "name": "network-vif-unplugged", "status": "completed", "tag": "e7face03-f5ca-470d-ba1f-9b74713e1d67"}, {"server_uuid": "ad3b28cc-8307-4f7a-889b-ab08d068ec0e", "name": "network-vif-plugged", "status": "completed", "tag": "e7face03-f5ca-470d-ba1f-9b74713e1d67"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:43.671579 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-6e5f3b73-0902-4b36-b56a-423204ff5796 req-9be46cac-f0fc-4028-a218-7ed8387dd5b9 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:43.672517 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-6e5f3b73-0902-4b36-b56a-423204ff5796 req-9be46cac-f0fc-4028-a218-7ed8387dd5b9 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:43.673515 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-6e5f3b73-0902-4b36-b56a-423204ff5796 req-9be46cac-f0fc-4028-a218-7ed8387dd5b9 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:43.716805 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-6e5f3b73-0902-4b36-b56a-423204ff5796 req-9be46cac-f0fc-4028-a218-7ed8387dd5b9 service nova] Creating event network-vif-unplugged:e7face03-f5ca-470d-ba1f-9b74713e1d67 for instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e on n-h1-852085-12 Oct 04 20:44:43.718510 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-6e5f3b73-0902-4b36-b56a-423204ff5796 req-9be46cac-f0fc-4028-a218-7ed8387dd5b9 service nova] Creating event network-vif-plugged:e7face03-f5ca-470d-ba1f-9b74713e1d67 for instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e on n-h1-852085-12 Oct 04 20:44:43.728399 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f7836d0f-7bda-4589-a772-d92f5f2a7580 tempest-ServerAddressesNegativeTestJSON-796818950 tempest-ServerAddressesNegativeTestJSON-796818950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-630172768", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "e9566301-491d-4b89-94f5-ade6a905db3e"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:43.728830 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-6e5f3b73-0902-4b36-b56a-423204ff5796 req-9be46cac-f0fc-4028-a218-7ed8387dd5b9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.091180 Oct 04 20:44:43.729985 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 751/1512] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:43.743923 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-86d18863-cb6b-4c55-acfd-c1310662e9b9 tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] Calling method '.version_select at 0x7f77eee76280>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:43.841715 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-f7836d0f-7bda-4589-a772-d92f5f2a7580 tempest-ServerAddressesNegativeTestJSON-796818950 tempest-ServerAddressesNegativeTestJSON-796818950-project] validate_networks() for [('e9566301-491d-4b89-94f5-ade6a905db3e', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:43.923248 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-86d18863-cb6b-4c55-acfd-c1310662e9b9 tempest-TaggedBootDevicesTest_v242-823522393 tempest-TaggedBootDevicesTest_v242-823522393-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-106158845" status: 204 len: 0 microversion: 2.42 time: 0.190498 Oct 04 20:44:43.925952 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 752/1513] 10.222.0.78 () {60 vars in 1259 bytes} [Tue Oct 4 20:44:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-106158845 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:44:43.943555 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a1a7dd4e-9b5f-41e1-bbb4-5ba6a52863ca tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:43.945390 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a1a7dd4e-9b5f-41e1-bbb4-5ba6a52863ca tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:43.965307 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1a7dd4e-9b5f-41e1-bbb4-5ba6a52863ca tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:43.966157 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1a7dd4e-9b5f-41e1-bbb4-5ba6a52863ca tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:43.967192 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1a7dd4e-9b5f-41e1-bbb4-5ba6a52863ca tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:43.968152 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1a7dd4e-9b5f-41e1-bbb4-5ba6a52863ca tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:43.968774 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1a7dd4e-9b5f-41e1-bbb4-5ba6a52863ca tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:43.969377 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a1a7dd4e-9b5f-41e1-bbb4-5ba6a52863ca tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-f7836d0f-7bda-4589-a772-d92f5f2a7580 tempest-ServerAddressesNegativeTestJSON-796818950 tempest-ServerAddressesNegativeTestJSON-796818950-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-224c7cf5-3e26-47e1-8198-0d1db1629083) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:44:44.392078 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-224c7cf5-3e26-47e1-8198-0d1db1629083) Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-f7836d0f-7bda-4589-a772-d92f5f2a7580 tempest-ServerAddressesNegativeTestJSON-796818950 tempest-ServerAddressesNegativeTestJSON-796818950-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:44.398347 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f7836d0f-7bda-4589-a772-d92f5f2a7580 tempest-ServerAddressesNegativeTestJSON-796818950 tempest-ServerAddressesNegativeTestJSON-796818950-project] Request method failure captured: Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 216 Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJs58uoFFqEMSBWzl1l6nPp8dRdzsxVrcFG5P5nIaiO3cd4DcFlcIAEkRZYFDNSER8PYO4ufazqYGWlmSyd23gnhdLeeVJFEIYzfJudpBOA62RA2afhHRZXNzKQMmKHDSgeXmqK4zz9x3oSG1QZaNe-jEI-tOeGz060oTxMA1vUL5uQ Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 35b911873f83408f8831ae7971cf021d Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-796818950 Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_35b911873f83408f8831ae7971cf021d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/35b911873f83408f8831ae7971cf021d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/35b911873f83408f8831ae7971cf021d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/35b911873f83408f8831ae7971cf021d"}]}] Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-796818950 Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 35b911873f83408f8831ae7971cf021d Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-796818950 Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerAddressesNegativeTestJSON-796818950-project Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: ef3619bf0324455db92ef500f16c664f Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-796818950-project Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-630172768", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "e9566301-491d-4b89-94f5-ade6a905db3e"}]}} Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServerAddressesNegativeTestJSON-server-630172768', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'e9566301-491d-4b89-94f5-ade6a905db3e'}]}}} Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:44:44.404864 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-224c7cf5-3e26-47e1-8198-0d1db1629083) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:44:44.410796 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f7836d0f-7bda-4589-a772-d92f5f2a7580 tempest-ServerAddressesNegativeTestJSON-796818950 tempest-ServerAddressesNegativeTestJSON-796818950-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f7836d0f-7bda-4589-a772-d92f5f2a7580 tempest-ServerAddressesNegativeTestJSON-796818950 tempest-ServerAddressesNegativeTestJSON-796818950-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.145983 Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 762/1514] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:44:43 2022] POST /compute/v2.1/servers => generated 214 bytes in 1148 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:44:44.425279 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-85a52385-7889-42c7-afad-6e4b220e4475 tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1095444349", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "4b01a391-c7da-45cc-b2a5-65b181a347df"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:44.580723 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-85a52385-7889-42c7-afad-6e4b220e4475 tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] validate_networks() for [('4b01a391-c7da-45cc-b2a5-65b181a347df', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:44.610826 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a1a7dd4e-9b5f-41e1-bbb4-5ba6a52863ca tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:44.634235 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a1a7dd4e-9b5f-41e1-bbb4-5ba6a52863ca tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1466 microversion: 2.1 time: 0.700310 Oct 04 20:44:44.635593 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 753/1515] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:43 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1466 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:44.659170 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:44.680492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:44.698407 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.703420 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.704633 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.706471 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.707898 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.709134 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.931309 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:44:44.931844 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:44:44.932875 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:44:44.934419 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:44:44.935577 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:44:45.317220 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:45.366989 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:45.367926 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:45.368729 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:45.370091 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:45.370942 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:45.383902 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:45.455223 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-20b545ea-4351-40bb-bbe0-50a9a588b42f tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action" status: 202 len: 1067 microversion: 2.1 time: 0.817665 Oct 04 20:44:45.469033 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 754/1516] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:44:44 2022] POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action => generated 1067 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 20:44:45.494708 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-34cd562f-eb61-4b97-a074-9a27d3fdcfcb tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] Calling method '.version_select at 0x7f77eee76160>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-85a52385-7889-42c7-afad-6e4b220e4475 tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-80182acb-23f7-411e-86a5-01679dd74abb) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:44:46.055988 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-80182acb-23f7-411e-86a5-01679dd74abb) Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-85a52385-7889-42c7-afad-6e4b220e4475 tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-85a52385-7889-42c7-afad-6e4b220e4475 tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] Request method failure captured: Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 271 Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJsk8P7iFGHwtdfWfrllLxCwKE3qY29ZSym9GBWMyAkH-pn4Y4tNiEa2PlBK_OflXkIIgqLpd3emvnqqmhgmQd1Icfzcap1LMBcF3SpLNSjQWEaQn8ntNsQQjySpD4GJEKDx0Z-tX2P_TtnqlLodv5mFhb7H5mw69cp7T20OxufRwlQ Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 9d5c0142707c420798e04f8826804031 Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-MultipleCreateTestJSON-901257962 Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9d5c0142707c420798e04f8826804031", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9d5c0142707c420798e04f8826804031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9d5c0142707c420798e04f8826804031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9d5c0142707c420798e04f8826804031"}]}] Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-MultipleCreateTestJSON-901257962 Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 9d5c0142707c420798e04f8826804031 Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-MultipleCreateTestJSON-901257962 Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-MultipleCreateTestJSON-901257962-project Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 7e9a0befa1584e64870462d780dcfc1f Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-MultipleCreateTestJSON-901257962-project Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1095444349", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "4b01a391-c7da-45cc-b2a5-65b181a347df"}]}} Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:44:46.062161 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateTestJSON-server-1095444349', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'min_count': 1, 'max_count': 2, 'return_reservation_id': True, 'networks': [{'uuid': '4b01a391-c7da-45cc-b2a5-65b181a347df'}]}}} Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:44:46.077917 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-80182acb-23f7-411e-86a5-01679dd74abb) Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-85a52385-7889-42c7-afad-6e4b220e4475 tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-85a52385-7889-42c7-afad-6e4b220e4475 tempest-MultipleCreateTestJSON-901257962 tempest-MultipleCreateTestJSON-901257962-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.667151 Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 763/1517] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:44:44 2022] POST /compute/v2.1/servers => generated 214 bytes in 1676 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:44:46.104343 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-82f4f6bf-679d-4b5d-b4bd-aa5a074b48ee tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f74c5d30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:46.222436 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-82f4f6bf-679d-4b5d-b4bd-aa5a074b48ee tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/72e89793-9b3c-463e-96d2-f69d6ab1a9d9" status: 200 len: 784 microversion: 2.1 time: 0.139148 Oct 04 20:44:46.224829 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 764/1518] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:46 2022] GET /compute/v2.1/images/72e89793-9b3c-463e-96d2-f69d6ab1a9d9 => generated 784 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:46.233518 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-90a0f342-6f00-41db-a25d-fabd1aaf9df4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:46.244326 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-90a0f342-6f00-41db-a25d-fabd1aaf9df4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:46.273923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-90a0f342-6f00-41db-a25d-fabd1aaf9df4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:46.292530 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-90a0f342-6f00-41db-a25d-fabd1aaf9df4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:46.293668 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-90a0f342-6f00-41db-a25d-fabd1aaf9df4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:46.304459 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-90a0f342-6f00-41db-a25d-fabd1aaf9df4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:46.305825 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-90a0f342-6f00-41db-a25d-fabd1aaf9df4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:46.308767 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-90a0f342-6f00-41db-a25d-fabd1aaf9df4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:47.289557 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-90a0f342-6f00-41db-a25d-fabd1aaf9df4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:47.328330 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-90a0f342-6f00-41db-a25d-fabd1aaf9df4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1472 microversion: 2.1 time: 1.100767 Oct 04 20:44:47.357622 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 765/1519] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:46 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1472 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:47.386287 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-550c326d-4223-4660-8a6d-4c8537181697 req-e676da43-12b2-4a36-a54c-89def6f93d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568cbe45-b90d-49d4-8ed6-90923e399d49", "name": "network-vif-unplugged", "status": "completed", "tag": "46ab96a5-0e71-4267-bb4f-54da94372f8e"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:47.430770 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-550c326d-4223-4660-8a6d-4c8537181697 req-e676da43-12b2-4a36-a54c-89def6f93d9e service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:47.432518 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-550c326d-4223-4660-8a6d-4c8537181697 req-e676da43-12b2-4a36-a54c-89def6f93d9e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:47.434388 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-550c326d-4223-4660-8a6d-4c8537181697 req-e676da43-12b2-4a36-a54c-89def6f93d9e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:47.517380 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-550c326d-4223-4660-8a6d-4c8537181697 req-e676da43-12b2-4a36-a54c-89def6f93d9e service nova] Creating event network-vif-unplugged:46ab96a5-0e71-4267-bb4f-54da94372f8e for instance 568cbe45-b90d-49d4-8ed6-90923e399d49 on n-h2-852085-12 Oct 04 20:44:47.557299 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-550c326d-4223-4660-8a6d-4c8537181697 req-e676da43-12b2-4a36-a54c-89def6f93d9e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.189476 Oct 04 20:44:47.566816 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 766/1520] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:47.608268 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-38d18d5e-81b0-477d-8100-def5466e5109 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:47.643642 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-38d18d5e-81b0-477d-8100-def5466e5109 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.065318 Oct 04 20:44:47.645307 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 767/1521] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:44:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:47.671703 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b2e1278d-8087-4a5f-bb7b-6dc1d0e006bf tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f7331dc0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:47.699436 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-34cd562f-eb61-4b97-a074-9a27d3fdcfcb tempest-ListImageFiltersTestJSON-1446086560 tempest-ListImageFiltersTestJSON-1446086560-project] 10.222.0.78 "DELETE /compute/v2.1/images/27cf760d-69b4-4924-8f8a-08fc005840b9" status: 204 len: 0 microversion: 2.1 time: 2.220790 Oct 04 20:44:47.718523 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 755/1522] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:45 2022] DELETE /compute/v2.1/images/27cf760d-69b4-4924-8f8a-08fc005840b9 => generated 0 bytes in 2231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:48.405797 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c445a07c-bd37-4672-968e-0862eff0d100 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:48.409169 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c445a07c-bd37-4672-968e-0862eff0d100 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:48.438723 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c445a07c-bd37-4672-968e-0862eff0d100 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:48.455021 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c445a07c-bd37-4672-968e-0862eff0d100 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:48.456935 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c445a07c-bd37-4672-968e-0862eff0d100 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:48.458712 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c445a07c-bd37-4672-968e-0862eff0d100 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:48.460763 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c445a07c-bd37-4672-968e-0862eff0d100 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:48.467120 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c445a07c-bd37-4672-968e-0862eff0d100 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.564605 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c445a07c-bd37-4672-968e-0862eff0d100 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:49.588727 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c445a07c-bd37-4672-968e-0862eff0d100 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1472 microversion: 2.1 time: 1.213691 Oct 04 20:44:49.606940 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 756/1523] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:48 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1472 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:50.660825 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e9a9e980-c5d0-46db-84ba-5a48ca4c4dbe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:50.662167 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e9a9e980-c5d0-46db-84ba-5a48ca4c4dbe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:50.695441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e9a9e980-c5d0-46db-84ba-5a48ca4c4dbe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:50.695441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e9a9e980-c5d0-46db-84ba-5a48ca4c4dbe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:50.695441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e9a9e980-c5d0-46db-84ba-5a48ca4c4dbe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:50.695441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e9a9e980-c5d0-46db-84ba-5a48ca4c4dbe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:50.695441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e9a9e980-c5d0-46db-84ba-5a48ca4c4dbe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:50.695441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e9a9e980-c5d0-46db-84ba-5a48ca4c4dbe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:51.321695 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b2e1278d-8087-4a5f-bb7b-6dc1d0e006bf tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "DELETE /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561" status: 204 len: 0 microversion: 2.1 time: 3.658744 Oct 04 20:44:51.323338 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 768/1524] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:47 2022] DELETE /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 => generated 0 bytes in 3663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:44:51.338828 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a7000300-5041-48a9-b5e5-5d4584401595 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f73e78b0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:51.396491 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-a7000300-5041-48a9-b5e5-5d4584401595 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] HTTP exception thrown: Image not found. Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a7000300-5041-48a9-b5e5-5d4584401595 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Request method failure captured: Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 HTTP/1.1 Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJrHiaQDUDmcCXWfUUHPwiZ9e31Meb32b3xF1XIQ2bwIqaNBM4oWnZP-_PqR516iLwYk2vk49vaOjh6FVl2wRovEiItFDS1eCtqUzAv4Pa5NJX6MymczXGbPhGD-7N81bMGXRUA1AusWqRilOAIpf5TYM5f6BDuHHsCwsbpC_oiMrK8 Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: baa9bc0601f141e48e1b5f001769d221 Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ImagesOneServerTestJSON-2098750367 Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_baa9bc0601f141e48e1b5f001769d221", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/baa9bc0601f141e48e1b5f001769d221"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/baa9bc0601f141e48e1b5f001769d221"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/baa9bc0601f141e48e1b5f001769d221"}]}] Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ImagesOneServerTestJSON-2098750367 Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: baa9bc0601f141e48e1b5f001769d221 Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2098750367 Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ImagesOneServerTestJSON-2098750367-project Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: c7677d259d034a68aaba770506475f73 Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ImagesOneServerTestJSON-2098750367-project Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: exception: Image not found. Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '5b3f4a4d-a424-4c82-8857-620a5d66c561'} Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5b3f4a4d-a424-4c82-8857-620a5d66c561 Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:44:51.501688 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5b3f4a4d-a424-4c82-8857-620a5d66c561 could not be found. Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a7000300-5041-48a9-b5e5-5d4584401595 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Returning 404 to user: Image not found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a7000300-5041-48a9-b5e5-5d4584401595 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561" status: 404 len: 62 microversion: 2.1 time: 0.176993 Oct 04 20:44:51.522502 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 769/1525] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:51 2022] GET /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 => generated 62 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:44:51.548655 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ffc6fa38-023d-438c-a602-5fa1ddb9e29f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-611173088"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:51.557355 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ffc6fa38-023d-438c-a602-5fa1ddb9e29f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:51.572575 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ffc6fa38-023d-438c-a602-5fa1ddb9e29f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:51.574557 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ffc6fa38-023d-438c-a602-5fa1ddb9e29f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:51.575633 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ffc6fa38-023d-438c-a602-5fa1ddb9e29f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:51.577738 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ffc6fa38-023d-438c-a602-5fa1ddb9e29f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:51.579187 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ffc6fa38-023d-438c-a602-5fa1ddb9e29f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:51.580458 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ffc6fa38-023d-438c-a602-5fa1ddb9e29f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:52.251599 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e9a9e980-c5d0-46db-84ba-5a48ca4c4dbe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:52.285323 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e9a9e980-c5d0-46db-84ba-5a48ca4c4dbe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1472 microversion: 2.1 time: 1.631311 Oct 04 20:44:52.288664 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 757/1526] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:50 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1472 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:44:52.624362 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ffc6fa38-023d-438c-a602-5fa1ddb9e29f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "POST /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49/action" status: 202 len: 0 microversion: 2.1 time: 1.096057 Oct 04 20:44:52.635624 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 770/1527] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:44:51 2022] POST /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49/action => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:44:52.658118 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7c632313-fab5-45a3-9e06-2aede36a6fed tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef4cedc0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:52.770469 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7c632313-fab5-45a3-9e06-2aede36a6fed tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.127719 Oct 04 20:44:52.772908 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 758/1528] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:52 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:53.324595 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:53.341062 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-75a86048-9a07-410b-8ba0-d78635c14977 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:53.345146 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-75a86048-9a07-410b-8ba0-d78635c14977 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:53.392559 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-75a86048-9a07-410b-8ba0-d78635c14977 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:53.393349 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-75a86048-9a07-410b-8ba0-d78635c14977 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:53.394164 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-75a86048-9a07-410b-8ba0-d78635c14977 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:53.405074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-75a86048-9a07-410b-8ba0-d78635c14977 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:53.408082 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-75a86048-9a07-410b-8ba0-d78635c14977 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:53.416153 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-75a86048-9a07-410b-8ba0-d78635c14977 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:53.804099 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0d18566f-fa9a-4c84-b390-f81dc68fbf5f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eef62ca0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:54.129705 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0d18566f-fa9a-4c84-b390-f81dc68fbf5f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.173267 Oct 04 20:44:54.129705 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 759/1529] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:53 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:54.825584 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-75a86048-9a07-410b-8ba0-d78635c14977 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:54.868533 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-75a86048-9a07-410b-8ba0-d78635c14977 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1472 microversion: 2.1 time: 1.539298 Oct 04 20:44:54.870008 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 771/1530] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:53 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1472 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:55.138024 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-edc58869-c4e1-4d14-8176-8192c7bc67ba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f73f6280>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:55.440630 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-edc58869-c4e1-4d14-8176-8192c7bc67ba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.310346 Oct 04 20:44:55.441670 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 772/1531] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:55 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:55.471937 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-384d8610-37be-4177-b34c-1193b5261758 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1306882389", "imageRef": "e7488b0b-015d-490e-b12f-c13f61c10ea6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e26dd16c-c221-4602-987e-d0307147f3f4"}], "security_groups": [{"name": "tempest-securitygroup--52556719"}], "key_name": "tempest-keypair-1974675721", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:55.539586 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-221ba66d-2989-424c-b5ef-ebaa070dc5ba tempest-ListImageFiltersNegativeTestJSON-29547124 tempest-ListImageFiltersNegativeTestJSON-29547124-project] Calling method '.version_select at 0x7f77eef63dc0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:55.621139 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-221ba66d-2989-424c-b5ef-ebaa070dc5ba tempest-ListImageFiltersNegativeTestJSON-29547124 tempest-ListImageFiltersNegativeTestJSON-29547124-project] HTTP exception thrown: Image not found. Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-221ba66d-2989-424c-b5ef-ebaa070dc5ba tempest-ListImageFiltersNegativeTestJSON-29547124 tempest-ListImageFiltersNegativeTestJSON-29547124-project] Request method failure captured: Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/images/66c9a3a4-6b7a-4bdb-ad97-96db81748fa1 HTTP/1.1 Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJtG1hI82loV4KhecedTFBpxo2t4y9fktSJWNG3801Sknydd16YwW7SxV5s76XwwJRWLWMgrNYuDFHBO75le2PFdcWGg3aEfmEHBY8O6qVtJtu_Lvnq8IO6iBbodu7i-Hb6Nc_fYSn6cD4JauQFkqg-bnvRGzyC8SjzfU6GdVmTVKQE Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 104842f18dae47dcaab4e91bca1e5d7c Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-29547124 Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_104842f18dae47dcaab4e91bca1e5d7c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/104842f18dae47dcaab4e91bca1e5d7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/104842f18dae47dcaab4e91bca1e5d7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/104842f18dae47dcaab4e91bca1e5d7c"}]}] Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-29547124 Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 104842f18dae47dcaab4e91bca1e5d7c Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-29547124 Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ListImageFiltersNegativeTestJSON-29547124-project Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: eb630c940efb4637b63a798b3e6d1172 Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-29547124-project Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: exception: Image not found. Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '66c9a3a4-6b7a-4bdb-ad97-96db81748fa1'} Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 66c9a3a4-6b7a-4bdb-ad97-96db81748fa1 Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:44:55.626288 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66c9a3a4-6b7a-4bdb-ad97-96db81748fa1 could not be found. Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-221ba66d-2989-424c-b5ef-ebaa070dc5ba tempest-ListImageFiltersNegativeTestJSON-29547124 tempest-ListImageFiltersNegativeTestJSON-29547124-project] Returning 404 to user: Image not found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-221ba66d-2989-424c-b5ef-ebaa070dc5ba tempest-ListImageFiltersNegativeTestJSON-29547124 tempest-ListImageFiltersNegativeTestJSON-29547124-project] 10.222.0.78 "GET /compute/v2.1/images/66c9a3a4-6b7a-4bdb-ad97-96db81748fa1" status: 404 len: 62 microversion: 2.1 time: 0.840479 Oct 04 20:44:55.645018 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 760/1532] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:54 2022] GET /compute/v2.1/images/66c9a3a4-6b7a-4bdb-ad97-96db81748fa1 => generated 62 bytes in 851 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:44:55.926959 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b3c42ea3-7b19-4916-bc25-c0138159e8f1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:55.928880 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b3c42ea3-7b19-4916-bc25-c0138159e8f1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:55.989530 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3c42ea3-7b19-4916-bc25-c0138159e8f1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:55.993207 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3c42ea3-7b19-4916-bc25-c0138159e8f1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:56.000497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3c42ea3-7b19-4916-bc25-c0138159e8f1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:56.002004 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3c42ea3-7b19-4916-bc25-c0138159e8f1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:56.003038 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3c42ea3-7b19-4916-bc25-c0138159e8f1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:56.003985 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b3c42ea3-7b19-4916-bc25-c0138159e8f1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:56.508858 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-384d8610-37be-4177-b34c-1193b5261758 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] validate_networks() for [('e26dd16c-c221-4602-987e-d0307147f3f4', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:57.965711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b3c42ea3-7b19-4916-bc25-c0138159e8f1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:58.032281 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b3c42ea3-7b19-4916-bc25-c0138159e8f1 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1478 microversion: 2.1 time: 2.113798 Oct 04 20:44:58.067510 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 761/1533] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:55 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1478 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:58.086225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3c92407a-ed0b-4ad9-a7ea-3d997ad07dba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eef014c0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:58.256158 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3c92407a-ed0b-4ad9-a7ea-3d997ad07dba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.186103 Oct 04 20:44:58.257253 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 762/1534] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:58 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:58.772405 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-0a236bf1-09e4-42ce-8642-f6b1e5e8d372 req-cba35300-3c8a-4493-9469-2d6bb62b7d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3b28cc-8307-4f7a-889b-ab08d068ec0e", "name": "network-vif-unplugged", "status": "completed", "tag": "e7face03-f5ca-470d-ba1f-9b74713e1d67"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:58.793008 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-0a236bf1-09e4-42ce-8642-f6b1e5e8d372 req-cba35300-3c8a-4493-9469-2d6bb62b7d01 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:58.793992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-0a236bf1-09e4-42ce-8642-f6b1e5e8d372 req-cba35300-3c8a-4493-9469-2d6bb62b7d01 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:58.795112 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-0a236bf1-09e4-42ce-8642-f6b1e5e8d372 req-cba35300-3c8a-4493-9469-2d6bb62b7d01 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:58.817960 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-0a236bf1-09e4-42ce-8642-f6b1e5e8d372 req-cba35300-3c8a-4493-9469-2d6bb62b7d01 service nova] Creating event network-vif-unplugged:e7face03-f5ca-470d-ba1f-9b74713e1d67 for instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e on n-h1-852085-12 Oct 04 20:44:58.830450 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-0a236bf1-09e4-42ce-8642-f6b1e5e8d372 req-cba35300-3c8a-4493-9469-2d6bb62b7d01 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072292 Oct 04 20:44:58.832048 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 763/1535] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-384d8610-37be-4177-b34c-1193b5261758 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ad210877-c749-4cf9-b112-a327a168a898) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:44:59.036541 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ad210877-c749-4cf9-b112-a327a168a898) Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-384d8610-37be-4177-b34c-1193b5261758 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:59.052108 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-384d8610-37be-4177-b34c-1193b5261758 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] Request method failure captured: Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 485 Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJrMziMlo2S3aOR8u7qRUmqaR5jHWSJzgwwd_MmLG29qq71B5ObsbwlAX8v-4UAXFM8uiGjfL6KcyIZ1zmLKwsTGOhwutFnUFz6FyJhVGzf0ySzrwZMpjmF2MT3h0X9uTXlEKFzXl_3m8AKRww5QQKzUlQ9bdhUeiIuQWWolxrUgr9c Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 1181b876697c473ba1d15bbefeea2cf2 Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1392402720 Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1181b876697c473ba1d15bbefeea2cf2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1181b876697c473ba1d15bbefeea2cf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1181b876697c473ba1d15bbefeea2cf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1181b876697c473ba1d15bbefeea2cf2"}]}] Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1392402720 Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 1181b876697c473ba1d15bbefeea2cf2 Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1392402720 Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AttachSCSIVolumeTestJSON-1392402720-project Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 91627f3584b0402896fd6e64b421b458 Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1392402720-project Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1306882389", "imageRef": "e7488b0b-015d-490e-b12f-c13f61c10ea6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e26dd16c-c221-4602-987e-d0307147f3f4"}], "security_groups": [{"name": "tempest-securitygroup--52556719"}], "key_name": "tempest-keypair-1974675721", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-AttachSCSIVolumeTestJSON-server-1306882389', 'imageRef': 'e7488b0b-015d-490e-b12f-c13f61c10ea6', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': 'e26dd16c-c221-4602-987e-d0307147f3f4'}], 'security_groups': [{'name': 'tempest-securitygroup--52556719'}], 'key_name': 'tempest-keypair-1974675721', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:44:59.061140 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ad210877-c749-4cf9-b112-a327a168a898) Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:59.071884 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-384d8610-37be-4177-b34c-1193b5261758 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:44:59.086977 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:59.091850 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-94e0520c-0172-4ddf-b342-0a04ac5689fd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:59.091850 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-94e0520c-0172-4ddf-b342-0a04ac5689fd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:59.095202 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-384d8610-37be-4177-b34c-1193b5261758 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.622095 Oct 04 20:44:59.097768 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 773/1536] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:44:55 2022] POST /compute/v2.1/servers => generated 214 bytes in 3650 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:44:59.136544 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-284377c3-9092-4c37-82b4-933f6d633f91 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] Calling method '.version_select at 0x7f77eecc1700>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:59.149047 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-94e0520c-0172-4ddf-b342-0a04ac5689fd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:59.149993 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-94e0520c-0172-4ddf-b342-0a04ac5689fd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:59.150967 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-94e0520c-0172-4ddf-b342-0a04ac5689fd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:59.155975 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-94e0520c-0172-4ddf-b342-0a04ac5689fd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:59.164535 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-94e0520c-0172-4ddf-b342-0a04ac5689fd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:59.165404 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-94e0520c-0172-4ddf-b342-0a04ac5689fd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:59.364932 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-284377c3-9092-4c37-82b4-933f6d633f91 tempest-AttachSCSIVolumeTestJSON-1392402720 tempest-AttachSCSIVolumeTestJSON-1392402720-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1974675721" status: 202 len: 0 microversion: 2.1 time: 0.252737 Oct 04 20:44:59.367506 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 774/1537] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:44:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1974675721 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:44:59.379041 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-aa53661f-e590-4e2f-8da0-bdb8388551d8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef209f70>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:59.580930 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-aa53661f-e590-4e2f-8da0-bdb8388551d8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.211009 Oct 04 20:44:59.607439 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 775/1538] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:59 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:59.902437 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-94e0520c-0172-4ddf-b342-0a04ac5689fd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:59.948479 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-94e0520c-0172-4ddf-b342-0a04ac5689fd tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1478 microversion: 2.1 time: 0.863568 Oct 04 20:44:59.951309 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 764/1539] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:59 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1478 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:00.637589 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b7ba6a7f-a9e2-4a5c-8b4a-8f1024d43905 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eecc1a60>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:00.879379 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b7ba6a7f-a9e2-4a5c-8b4a-8f1024d43905 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.249001 Oct 04 20:45:00.898192 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 776/1540] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:00 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:01.012828 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e9e95afc-852f-42a8-bdbe-d966ae5130cf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:01.015238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e9e95afc-852f-42a8-bdbe-d966ae5130cf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:01.042117 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e9e95afc-852f-42a8-bdbe-d966ae5130cf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:01.054012 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e9e95afc-852f-42a8-bdbe-d966ae5130cf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:01.056885 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e9e95afc-852f-42a8-bdbe-d966ae5130cf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:01.060744 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e9e95afc-852f-42a8-bdbe-d966ae5130cf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:01.064762 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e9e95afc-852f-42a8-bdbe-d966ae5130cf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:01.067188 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e9e95afc-852f-42a8-bdbe-d966ae5130cf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:01.911672 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4c19017d-3eaf-4f47-bfe5-721dd5ab465d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f751dca0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:01.973775 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e9e95afc-852f-42a8-bdbe-d966ae5130cf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:02.014240 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e9e95afc-852f-42a8-bdbe-d966ae5130cf tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1463 microversion: 2.1 time: 1.012556 Oct 04 20:45:02.037186 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 765/1541] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:00 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1463 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:02.083824 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e0a59fe1-cb5c-4820-b3ba-41f1b12f09a5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:02.090206 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e0a59fe1-cb5c-4820-b3ba-41f1b12f09a5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:02.106568 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e0a59fe1-cb5c-4820-b3ba-41f1b12f09a5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:02.107427 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e0a59fe1-cb5c-4820-b3ba-41f1b12f09a5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:02.108508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e0a59fe1-cb5c-4820-b3ba-41f1b12f09a5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:02.110119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e0a59fe1-cb5c-4820-b3ba-41f1b12f09a5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:02.111532 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e0a59fe1-cb5c-4820-b3ba-41f1b12f09a5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:02.112635 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e0a59fe1-cb5c-4820-b3ba-41f1b12f09a5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:02.146505 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4c19017d-3eaf-4f47-bfe5-721dd5ab465d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.240995 Oct 04 20:45:02.160733 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 777/1542] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:01 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:02.728583 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:02.883928 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e0a59fe1-cb5c-4820-b3ba-41f1b12f09a5 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action" status: 202 len: 0 microversion: 2.1 time: 0.807472 Oct 04 20:45:02.885966 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 766/1543] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:45:02 2022] POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action => generated 0 bytes in 811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:45:02.902841 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:02.906959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:02.977068 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:02.980547 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:02.995460 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:03.038712 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:03.038712 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:03.038712 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:03.185243 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4f68d7c8-bc90-4284-9e3b-4052ce9d86e1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eef62ee0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:03.228604 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:03.230234 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:03.231589 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:03.233350 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lazy-loading 'fault' on Instance uuid ad3b28cc-8307-4f7a-889b-ab08d068ec0e {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:03.369409 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4f68d7c8-bc90-4284-9e3b-4052ce9d86e1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.195618 Oct 04 20:45:03.381836 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 767/1544] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:03 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:04.237717 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-effddf9b-2d15-440f-94e9-e66bf476f270 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1599 microversion: 2.1 time: 1.344787 Oct 04 20:45:04.244648 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0e4edcb5-1a0b-4182-8a9d-27f353313259 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Action: 'create', calling method: .version_select at 0x7f77eee76820>, body: {"keypair": {"name": "tempest-keypair-1093338364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyACWgMlfGV4jhX5yX6SKyfKngANan8jj2LabCdvRXtMNLnOl//4xgKtLlsbIRbSZmwh7Ba35uUoXVXcBzxoClof9mH+V8DSjXfj2cgrM18ps+srkWchWCetuVb7aHOtw=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:04.272633 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 778/1545] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:02 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1599 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:04.287255 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:04.292205 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-f8563861-48b1-4720-8e81-866670381f23 req-289007c7-9a1d-4b3e-922b-399d1cbda63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568cbe45-b90d-49d4-8ed6-90923e399d49", "name": "network-vif-plugged", "status": "completed", "tag": "46ab96a5-0e71-4267-bb4f-54da94372f8e"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:04.335890 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-f8563861-48b1-4720-8e81-866670381f23 req-289007c7-9a1d-4b3e-922b-399d1cbda63d service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:04.339270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-f8563861-48b1-4720-8e81-866670381f23 req-289007c7-9a1d-4b3e-922b-399d1cbda63d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:04.342643 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-f8563861-48b1-4720-8e81-866670381f23 req-289007c7-9a1d-4b3e-922b-399d1cbda63d service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:04.348718 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-0e4edcb5-1a0b-4182-8a9d-27f353313259 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:04.373413 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-f8563861-48b1-4720-8e81-866670381f23 req-289007c7-9a1d-4b3e-922b-399d1cbda63d service nova] Creating event network-vif-plugged:46ab96a5-0e71-4267-bb4f-54da94372f8e for instance 568cbe45-b90d-49d4-8ed6-90923e399d49 on n-h2-852085-12 Oct 04 20:45:04.385494 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-0e4edcb5-1a0b-4182-8a9d-27f353313259 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for user ab7b3c3e499f44de893ccc5a57912701 and project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:04.385829 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-f8563861-48b1-4720-8e81-866670381f23 req-289007c7-9a1d-4b3e-922b-399d1cbda63d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110292 Oct 04 20:45:04.387410 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 779/1546] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:04.400004 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ff1aed94-c509-4ab8-a2f0-35d62be5827f tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:04.412527 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ff1aed94-c509-4ab8-a2f0-35d62be5827f tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:04.430940 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ff1aed94-c509-4ab8-a2f0-35d62be5827f tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:04.432385 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ff1aed94-c509-4ab8-a2f0-35d62be5827f tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:04.433460 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ff1aed94-c509-4ab8-a2f0-35d62be5827f tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:04.435208 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ff1aed94-c509-4ab8-a2f0-35d62be5827f tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:04.436643 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ff1aed94-c509-4ab8-a2f0-35d62be5827f tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:04.437793 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ff1aed94-c509-4ab8-a2f0-35d62be5827f tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:04.607994 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0e4edcb5-1a0b-4182-8a9d-27f353313259 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.899659 Oct 04 20:45:04.608893 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 768/1547] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 4 20:45:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 903 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:45:04.655502 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d06975c6-578c-4d70-b8f5-42f88d22d56e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eee760d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:04.779821 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d06975c6-578c-4d70-b8f5-42f88d22d56e tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.166177 Oct 04 20:45:04.789393 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 769/1548] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:04 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:04.811299 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e3f4fc73-cd06-431a-beb2-dc236e491210 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77eef62430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:04.848156 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e3f4fc73-cd06-431a-beb2-dc236e491210 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-1093338364" status: 200 len: 513 microversion: 2.2 time: 0.056380 Oct 04 20:45:04.848987 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 770/1549] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Oct 4 20:45:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1093338364 => generated 513 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:04.874749 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c3a460bb-d9e6-4cd9-8ced-10de5831903a tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77eef1e430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:05.172438 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c3a460bb-d9e6-4cd9-8ced-10de5831903a tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093338364" status: 204 len: 0 microversion: 2.2 time: 0.304551 Oct 04 20:45:05.173429 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 771/1550] 10.222.0.78 () {60 vars in 1261 bytes} [Tue Oct 4 20:45:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093338364 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:45:05.194640 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-19164461-760c-4ab5-90dd-e35cc79fa677 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Action: 'create', calling method: .version_select at 0x7f77eefca670>, body: {"keypair": {"name": "tempest-keypair-468229924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfPOPifRaUOrPFpKBl/6P5kVdFxa6yqFSPnatXqSbhz//DEPO0LRGYYR03SHDu6SJyfivcXdrlQXYr5ejBs8bMDg2iCW/LfLcOnxkrduu8QorTxpjaSkFuu2JvhKiUBmg=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:05.260574 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ff1aed94-c509-4ab8-a2f0-35d62be5827f tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action" status: 202 len: 0 microversion: 2.1 time: 0.870456 Oct 04 20:45:05.263942 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-19164461-760c-4ab5-90dd-e35cc79fa677 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:05.269507 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 780/1551] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 20:45:04 2022] POST /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e/action => generated 0 bytes in 881 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:45:05.283996 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-19164461-760c-4ab5-90dd-e35cc79fa677 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for user ab7b3c3e499f44de893ccc5a57912701 and project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:05.324898 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-de1553ae-0139-49ac-9e67-89a5187c38d8 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:05.335962 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-de1553ae-0139-49ac-9e67-89a5187c38d8 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:05.371682 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-de1553ae-0139-49ac-9e67-89a5187c38d8 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:05.375777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-de1553ae-0139-49ac-9e67-89a5187c38d8 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:05.382451 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-de1553ae-0139-49ac-9e67-89a5187c38d8 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:05.395831 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-de1553ae-0139-49ac-9e67-89a5187c38d8 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:05.399396 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-de1553ae-0139-49ac-9e67-89a5187c38d8 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:05.400968 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-de1553ae-0139-49ac-9e67-89a5187c38d8 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:05.456677 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-19164461-760c-4ab5-90dd-e35cc79fa677 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.266415 Oct 04 20:45:05.460979 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 772/1552] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 4 20:45:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 275 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:45:05.491945 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9972644a-6c83-4e06-800b-74e0e6e5d92d tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77eeed11f0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:05.700737 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9972644a-6c83-4e06-800b-74e0e6e5d92d tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468229924" status: 204 len: 0 microversion: 2.2 time: 0.219953 Oct 04 20:45:05.701810 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 773/1553] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Oct 4 20:45:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468229924 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:05.722251 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-85c8a1a1-eec6-4054-ad97-7aa035e1b0bf tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Action: 'create', calling method: .version_select at 0x7f77ef07fc10>, body: {"keypair": {"name": "tempest-keypair-754623810", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:05.841119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-85c8a1a1-eec6-4054-ad97-7aa035e1b0bf tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:05.862417 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-85c8a1a1-eec6-4054-ad97-7aa035e1b0bf tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for user ab7b3c3e499f44de893ccc5a57912701 and project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:06.021321 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-de1553ae-0139-49ac-9e67-89a5187c38d8 tempest-ServersAdminTestJSON-1123919183 tempest-ServersAdminTestJSON-1123919183-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1616 microversion: 2.1 time: 0.743396 Oct 04 20:45:06.023283 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 781/1554] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:05 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1616 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:06.041302 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8973a3d0-fc5c-4a5e-9aaf-53bb79d659f8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f73f6940>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:06.076296 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-85c8a1a1-eec6-4054-ad97-7aa035e1b0bf tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.365599 Oct 04 20:45:06.078343 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 774/1555] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 4 20:45:05 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 369 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:45:06.093288 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-61e6211b-876e-4a17-beca-3862e5577099 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:06.094722 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-61e6211b-876e-4a17-beca-3862e5577099 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:06.108711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-61e6211b-876e-4a17-beca-3862e5577099 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:06.109870 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-61e6211b-876e-4a17-beca-3862e5577099 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:06.110975 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-61e6211b-876e-4a17-beca-3862e5577099 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:06.114463 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-61e6211b-876e-4a17-beca-3862e5577099 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:06.116268 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-61e6211b-876e-4a17-beca-3862e5577099 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:06.117609 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-61e6211b-876e-4a17-beca-3862e5577099 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:06.192524 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-61e6211b-876e-4a17-beca-3862e5577099 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:45:06.961339 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-61e6211b-876e-4a17-beca-3862e5577099 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "DELETE /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 204 len: 0 microversion: 2.1 time: 0.879977 Oct 04 20:45:06.963801 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 775/1556] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:45:06 2022] DELETE /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 0 bytes in 885 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:06.984537 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1af22b8b-d4e3-4455-ae9c-f11f5edf5f80 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77eefcaa60>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:07.297620 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1af22b8b-d4e3-4455-ae9c-f11f5edf5f80 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754623810" status: 204 len: 0 microversion: 2.2 time: 0.326223 Oct 04 20:45:07.305189 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 776/1557] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Oct 4 20:45:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754623810 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:07.327881 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-97986e81-b396-4e79-9949-7bf49dac8848 req-faa0aab8-5bc1-489b-a123-32fa40581fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3b28cc-8307-4f7a-889b-ab08d068ec0e", "name": "network-vif-plugged", "status": "completed", "tag": "e7face03-f5ca-470d-ba1f-9b74713e1d67"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:07.368672 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-97986e81-b396-4e79-9949-7bf49dac8848 req-faa0aab8-5bc1-489b-a123-32fa40581fea service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:07.372926 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-97986e81-b396-4e79-9949-7bf49dac8848 req-faa0aab8-5bc1-489b-a123-32fa40581fea service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:07.376023 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-97986e81-b396-4e79-9949-7bf49dac8848 req-faa0aab8-5bc1-489b-a123-32fa40581fea service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:07.456253 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-97986e81-b396-4e79-9949-7bf49dac8848 req-faa0aab8-5bc1-489b-a123-32fa40581fea service nova] Creating event network-vif-plugged:e7face03-f5ca-470d-ba1f-9b74713e1d67 for instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e on n-h1-852085-12 Oct 04 20:45:07.475679 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-97986e81-b396-4e79-9949-7bf49dac8848 req-faa0aab8-5bc1-489b-a123-32fa40581fea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158631 Oct 04 20:45:07.477667 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 777/1558] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:07.510024 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4e4dec00-3bc8-472c-b55f-ef5da934f3a7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:07.512426 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4e4dec00-3bc8-472c-b55f-ef5da934f3a7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:07.529496 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e4dec00-3bc8-472c-b55f-ef5da934f3a7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:07.530295 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e4dec00-3bc8-472c-b55f-ef5da934f3a7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:07.531211 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e4dec00-3bc8-472c-b55f-ef5da934f3a7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:07.532580 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e4dec00-3bc8-472c-b55f-ef5da934f3a7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:07.533529 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e4dec00-3bc8-472c-b55f-ef5da934f3a7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:07.534272 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4e4dec00-3bc8-472c-b55f-ef5da934f3a7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:08.171074 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-4e4dec00-3bc8-472c-b55f-ef5da934f3a7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:08.206718 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4e4dec00-3bc8-472c-b55f-ef5da934f3a7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1470 microversion: 2.1 time: 0.721877 Oct 04 20:45:08.210592 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 778/1559] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:07 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1470 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:08.259507 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2d260001-9471-458c-b53d-1edf56184726 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Action: 'create', calling method: .version_select at 0x7f77eefcaf70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-181511729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGf+nIAUjGe1AjoQHamg404l+1BVI6yKz3aNBILdQzg5ndhT3sUpoIdUuKf6Yfx5F1gz5gQ9GWcphapHcWreQgu1iok1/8q8t9AEPebGMHuNLEQ4/v6qbyRGVdiSIzkRg=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:08.298405 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-2d260001-9471-458c-b53d-1edf56184726 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:08.344975 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-2d260001-9471-458c-b53d-1edf56184726 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for user ab7b3c3e499f44de893ccc5a57912701 and project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:08.659724 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8973a3d0-fc5c-4a5e-9aaf-53bb79d659f8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 2.634028 Oct 04 20:45:08.667360 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 782/1560] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:06 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 2643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:08.719212 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2d260001-9471-458c-b53d-1edf56184726 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.489109 Oct 04 20:45:08.721233 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 779/1561] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 4 20:45:08 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 493 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:45:08.755163 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4eb3e515-2287-476c-bd23-30bc662cf580 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Action: 'create', calling method: .version_select at 0x7f77eecc1a60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1187648008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLk6sUqBv4jdJ/NGq9o1rQNcBzNKaYM/KWgQK97l0wKO5jXW1VmsAe4PwYapOlQqHD2iW1s5w2r8trAVlGbDP/TpY9du5yktGXF7z8EHAWh6z5yDzMFr4pe1jDJSjl2Tlg=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:08.814204 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:08.865390 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-4eb3e515-2287-476c-bd23-30bc662cf580 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:08.886887 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-4eb3e515-2287-476c-bd23-30bc662cf580 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for user ab7b3c3e499f44de893ccc5a57912701 and project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:09.119000 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4eb3e515-2287-476c-bd23-30bc662cf580 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.371441 Oct 04 20:45:09.120181 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 783/1562] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 4 20:45:08 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 374 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:45:09.157499 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-212cc06a-d526-48ea-985e-383d9c4d9115 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Action: 'create', calling method: .version_select at 0x7f77ef13adc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1787240437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbuMr9c9Tq+LSCbYg7OlEn7pbAnvTmUJcUt3W30xy0R/cMIOn8iLIBmTHLq6YUCYH33YNLgz241kedHIYNEUD7BoQR/HlqmQ+sSezmx/GxxR2cTJ1Wp/Bl4bccJT448sw=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:09.266149 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-212cc06a-d526-48ea-985e-383d9c4d9115 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:09.276584 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:09.287988 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-212cc06a-d526-48ea-985e-383d9c4d9115 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for user ab7b3c3e499f44de893ccc5a57912701 and project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:09.289558 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:09.358907 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:09.372074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:09.376731 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:09.386344 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:09.397831 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:09.403594 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:09.484818 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:09.508432 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-212cc06a-d526-48ea-985e-383d9c4d9115 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.368838 Oct 04 20:45:09.509213 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 780/1563] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 4 20:45:09 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 371 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:45:09.530173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e890c78a-dae4-451b-aed7-49838480e36e tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77ef13a1f0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:09.567200 n-d-852085-12 devstack@n-api.service[123539]: WARNING oslo_db.sqlalchemy.utils [None req-e890c78a-dae4-451b-aed7-49838480e36e tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:45:09.605632 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e890c78a-dae4-451b-aed7-49838480e36e tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.084434 Oct 04 20:45:09.620928 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 781/1564] 10.222.0.78 () {60 vars in 1177 bytes} [Tue Oct 4 20:45:09 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:09.630977 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-14af07f4-f596-44b2-b198-174790a110a0 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77eefcaa60>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:09.828253 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-14af07f4-f596-44b2-b198-174790a110a0 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1787240437" status: 204 len: 0 microversion: 2.2 time: 0.203550 Oct 04 20:45:09.830029 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 782/1565] 10.222.0.78 () {60 vars in 1321 bytes} [Tue Oct 4 20:45:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1787240437 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:09.865993 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-260d5ec4-98c0-40fb-af7a-3cf3625a0a01 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eee31040>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:10.140365 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-260d5ec4-98c0-40fb-af7a-3cf3625a0a01 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.302986 Oct 04 20:45:10.142010 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 783/1566] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:09 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:10.165196 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-71df7249-20b2-4d23-920f-701b210883f1 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77eee31af0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:10.374435 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-71df7249-20b2-4d23-920f-701b210883f1 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1187648008" status: 204 len: 0 microversion: 2.2 time: 0.226871 Oct 04 20:45:10.380317 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 784/1567] 10.222.0.78 () {60 vars in 1321 bytes} [Tue Oct 4 20:45:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1187648008 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:10.384267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-71df7249-20b2-4d23-920f-701b210883f1 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:10.394119 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:10.408351 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-71df7249-20b2-4d23-920f-701b210883f1 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.014124 Oct 04 20:45:10.418076 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 785/1568] 10.222.0.78 () {56 vars in 886 bytes} [Tue Oct 4 20:45:10 2022] GET /compute/ => generated 377 bytes in 36 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 20:45:10.444502 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1470 microversion: 2.1 time: 1.170944 Oct 04 20:45:10.446491 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 784/1569] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:09 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1470 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:10.471492 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:10.479222 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.027922 Oct 04 20:45:10.485667 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e61c7e53-44f2-4653-829e-63b0652a383f tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77ef07f9d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:10.500836 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 785/1570] 10.222.0.78 () {54 vars in 1035 bytes} [Tue Oct 4 20:45:10 2022] GET /compute/v2/ => generated 379 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 04 20:45:10.510081 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:10.517633 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.014409 Oct 04 20:45:10.522121 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 786/1571] 10.222.0.78 () {54 vars in 1041 bytes} [Tue Oct 4 20:45:10 2022] GET /compute/v2.1/ => generated 388 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:10.540857 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:10.543745 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fb6d800e-e52c-487d-9594-2451037a3d97 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003196 Oct 04 20:45:10.545405 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 787/1572] 10.222.0.78 () {56 vars in 886 bytes} [Tue Oct 4 20:45:10 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 20:45:10.704665 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-bcf3158f-729c-492c-9211-06a439b394f9 req-4de26e7f-3b48-4d40-9969-5fa8111c0a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d", "name": "network-vif-deleted", "tag": "ecc4bf5f-7d12-4714-83d5-e6b2d3d3cbb3"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:10.729183 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-bcf3158f-729c-492c-9211-06a439b394f9 req-4de26e7f-3b48-4d40-9969-5fa8111c0a45 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:10.733011 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-bcf3158f-729c-492c-9211-06a439b394f9 req-4de26e7f-3b48-4d40-9969-5fa8111c0a45 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:10.734366 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-bcf3158f-729c-492c-9211-06a439b394f9 req-4de26e7f-3b48-4d40-9969-5fa8111c0a45 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:10.742699 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e61c7e53-44f2-4653-829e-63b0652a383f tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-181511729" status: 204 len: 0 microversion: 2.2 time: 0.320874 Oct 04 20:45:10.745434 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 786/1573] 10.222.0.78 () {60 vars in 1318 bytes} [Tue Oct 4 20:45:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-181511729 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:10.775331 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-bcf3158f-729c-492c-9211-06a439b394f9 req-4de26e7f-3b48-4d40-9969-5fa8111c0a45 service nova] Creating event network-vif-deleted:ecc4bf5f-7d12-4714-83d5-e6b2d3d3cbb3 for instance 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d on n-h1-852085-12 Oct 04 20:45:10.788299 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-bcf3158f-729c-492c-9211-06a439b394f9 req-4de26e7f-3b48-4d40-9969-5fa8111c0a45 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098266 Oct 04 20:45:10.800428 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 788/1574] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:45:10.807932 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1ed54896-d0d5-40a1-9e50-8b587924c2c1 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Action: 'create', calling method: .version_select at 0x7f77eef63ee0>, body: {"keypair": {"name": "tempest-keypair-147569901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD9o8waFAor8i9Jnfokr6D7g4ygV0bP6/qTt0P/oP/VJu7RcVa4KuBSqzirSSLap+1ILRIl7iLLet8CuC27fCNONh52hPC8ozW5k1oZjL3gEZkrsmprXWiAkQ93/Rce4g=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:10.851622 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:10.910676 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-1ed54896-d0d5-40a1-9e50-8b587924c2c1 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:10.959308 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-1ed54896-d0d5-40a1-9e50-8b587924c2c1 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for user ab7b3c3e499f44de893ccc5a57912701 and project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:11.180271 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-daf48cfa-271c-4668-94ab-9e7d48d2240b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f73e7280>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:11.242045 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1ed54896-d0d5-40a1-9e50-8b587924c2c1 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.479287 Oct 04 20:45:11.260738 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 787/1575] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Oct 4 20:45:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 492 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:45:11.300059 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2ae2e13b-ed54-4fc4-946b-7e901114c56f tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77eefd94c0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:11.361083 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2ae2e13b-ed54-4fc4-946b-7e901114c56f tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-147569901" status: 200 len: 512 microversion: 2.2 time: 0.095736 Oct 04 20:45:11.382096 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 788/1576] 10.222.0.78 () {60 vars in 1255 bytes} [Tue Oct 4 20:45:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-147569901 => generated 512 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:11.409681 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4013deca-960d-460a-b7bf-235552e6af6b tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77eee76dc0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:11.412931 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-daf48cfa-271c-4668-94ab-9e7d48d2240b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.247802 Oct 04 20:45:11.429237 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 789/1577] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:11 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:11.441062 n-d-852085-12 devstack@n-api.service[123539]: WARNING oslo_db.sqlalchemy.utils [None req-4013deca-960d-460a-b7bf-235552e6af6b tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:45:11.477180 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4013deca-960d-460a-b7bf-235552e6af6b tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.090734 Oct 04 20:45:11.487748 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 789/1578] 10.222.0.78 () {60 vars in 1177 bytes} [Tue Oct 4 20:45:11 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:45:11.505748 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ca2d8f3f-19bd-4e36-8600-d7931fc4e56a tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77ef2095e0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:11.516496 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:11.527902 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:11.543658 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:11.545166 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:11.546353 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:11.548517 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:11.549863 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:11.556900 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:11.725665 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:11.725815 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:11.726506 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:11.727378 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lazy-loading 'fault' on Instance uuid 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:11.748739 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ca2d8f3f-19bd-4e36-8600-d7931fc4e56a tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-147569901" status: 204 len: 0 microversion: 2.2 time: 0.250917 Oct 04 20:45:11.750606 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 790/1579] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Oct 4 20:45:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-147569901 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:11.775935 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-77ce91db-cee6-4646-a6c2-ff81aeead363 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Action: 'create', calling method: .version_select at 0x7f77eecc13a0>, body: {"keypair": {"name": "tempest-keypair-1425520266", "type": "x509"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:11.860663 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-77ce91db-cee6-4646-a6c2-ff81aeead363 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:11.884978 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-77ce91db-cee6-4646-a6c2-ff81aeead363 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for user ab7b3c3e499f44de893ccc5a57912701 and project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:11.963796 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.processutils [None req-77ce91db-cee6-4646-a6c2-ff81aeead363 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmppiq2fw0k/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmppiq2fw0k/temp.key -subj /CN=ab7b3c3e499f44de893ccc5a57912701 -extensions v3_req_client {{(pid=123540) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 20:45:12.149371 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:12.207541 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e13bd45b-b084-4329-85cb-ad29492a4ceb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 200 len: 1304 microversion: 2.1 time: 0.691917 Oct 04 20:45:12.217298 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 790/1580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:11 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 1304 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:12.447774 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9e7fab2c-db32-489b-8bd8-8d88ad18797d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef07f430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:12.712439 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9e7fab2c-db32-489b-8bd8-8d88ad18797d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.272444 Oct 04 20:45:12.728195 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 791/1581] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:12 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:12.839197 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.processutils [None req-77ce91db-cee6-4646-a6c2-ff81aeead363 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmppiq2fw0k/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmppiq2fw0k/temp.key -subj /CN=ab7b3c3e499f44de893ccc5a57912701 -extensions v3_req_client" returned: 0 in 0.876s {{(pid=123540) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 20:45:12.846210 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.processutils [None req-77ce91db-cee6-4646-a6c2-ff81aeead363 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmppiq2fw0k/temp.key -password pass: {{(pid=123540) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 20:45:12.939222 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.processutils [None req-77ce91db-cee6-4646-a6c2-ff81aeead363 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] CMD "openssl pkcs12 -export -inkey /tmp/tmppiq2fw0k/temp.key -password pass:" returned: 0 in 0.092s {{(pid=123540) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 20:45:13.181099 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-77ce91db-cee6-4646-a6c2-ff81aeead363 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:13.209688 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-77ce91db-cee6-4646-a6c2-ff81aeead363 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Getting quotas for user ab7b3c3e499f44de893ccc5a57912701 and project 649d27ef54104cce8d99a13d9d49da3a. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:13.265524 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-921f9251-7d4e-4692-9203-0a882f929c41 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:13.266652 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-921f9251-7d4e-4692-9203-0a882f929c41 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:13.293326 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-77ce91db-cee6-4646-a6c2-ff81aeead363 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.525231 Oct 04 20:45:13.296227 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 791/1582] 10.222.0.78 () {62 vars in 1198 bytes} [Tue Oct 4 20:45:11 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1532 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:45:13.328936 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-87adcd88-b3d5-4616-86de-c316166033e5 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77eec904c0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:13.353074 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-921f9251-7d4e-4692-9203-0a882f929c41 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:13.359175 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-921f9251-7d4e-4692-9203-0a882f929c41 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:13.360764 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-921f9251-7d4e-4692-9203-0a882f929c41 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:13.372718 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-921f9251-7d4e-4692-9203-0a882f929c41 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:13.373822 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-921f9251-7d4e-4692-9203-0a882f929c41 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:13.374509 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-87adcd88-b3d5-4616-86de-c316166033e5 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-1425520266" status: 200 len: 1534 microversion: 2.2 time: 0.066528 Oct 04 20:45:13.377397 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 792/1583] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Oct 4 20:45:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1425520266 => generated 1534 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:13.378423 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-921f9251-7d4e-4692-9203-0a882f929c41 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:13.416015 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4c978e9e-f22c-49b7-a160-abe81206025e tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77ef209f70>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:13.437522 n-d-852085-12 devstack@n-api.service[123540]: WARNING oslo_db.sqlalchemy.utils [None req-4c978e9e-f22c-49b7-a160-abe81206025e tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:45:13.464718 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4c978e9e-f22c-49b7-a160-abe81206025e tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.069338 Oct 04 20:45:13.468050 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-921f9251-7d4e-4692-9203-0a882f929c41 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] HTTP exception thrown: Instance 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d could not be found. Oct 04 20:45:13.478984 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 793/1584] 10.222.0.78 () {60 vars in 1177 bytes} [Tue Oct 4 20:45:13 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-921f9251-7d4e-4692-9203-0a882f929c41 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Request method failure captured: Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d HTTP/1.1 Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJpblJddoYMSPWcUTdqfvobvsfp93ICKvEGawGJjKkYFN9iJXVAAbI7Z-CdKre4WhWkTtxsrvK0tW3F3WdUKWWu9FNfNg9cH98ADcx78yMCfPUyc8k09Hn4OmIe_Y_DNQKGXtAvChX9Mbeq32xAh--Mhx3MjdnNdpEp3oXW49UkS2Uo Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: e9fae788056d4b8e9d45e8988fc6920f Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersAdminTestJSON-672945853 Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e9fae788056d4b8e9d45e8988fc6920f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e9fae788056d4b8e9d45e8988fc6920f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e9fae788056d4b8e9d45e8988fc6920f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e9fae788056d4b8e9d45e8988fc6920f"}]}] Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersAdminTestJSON-672945853 Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: e9fae788056d4b8e9d45e8988fc6920f Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersAdminTestJSON-672945853 Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersAdminTestJSON-672945853-project Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: edcdbeebe55e41cb9072a7561e0988f8 Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersAdminTestJSON-672945853-project Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d could not be found. Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d'} Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d could not be found. Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d could not be found. Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:13.480637 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:45:13.491585 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:13.491585 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:13.491585 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:13.491585 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:13.491585 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:13.491585 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d could not be found. Oct 04 20:45:13.491585 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:45:13.497002 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-921f9251-7d4e-4692-9203-0a882f929c41 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Returning 404 to user: Instance 62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:13.497216 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-57315c0e-7523-49a3-88c2-e7a966fd25c2 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] Calling method '.version_select at 0x7f77eec97160>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:13.503442 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-921f9251-7d4e-4692-9203-0a882f929c41 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d" status: 404 len: 111 microversion: 2.1 time: 0.242335 Oct 04 20:45:13.516328 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 792/1585] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:13 2022] GET /compute/v2.1/servers/62a318d1-22e6-4b7f-ae3b-e460e3ef8a6d => generated 111 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:13.547764 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4475062d-8300-45cd-8176-55beb1c7bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:13.548689 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4475062d-8300-45cd-8176-55beb1c7bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:13.606436 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4475062d-8300-45cd-8176-55beb1c7bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:13.610490 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4475062d-8300-45cd-8176-55beb1c7bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:13.616655 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4475062d-8300-45cd-8176-55beb1c7bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:13.618451 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4475062d-8300-45cd-8176-55beb1c7bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:13.622488 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4475062d-8300-45cd-8176-55beb1c7bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:13.624675 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4475062d-8300-45cd-8176-55beb1c7bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:13.642506 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-57315c0e-7523-49a3-88c2-e7a966fd25c2 tempest-KeyPairsV22TestJSON-1937141320 tempest-KeyPairsV22TestJSON-1937141320-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425520266" status: 204 len: 0 microversion: 2.2 time: 0.160383 Oct 04 20:45:13.646452 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 794/1586] 10.222.0.78 () {60 vars in 1261 bytes} [Tue Oct 4 20:45:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425520266 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:13.742309 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-4475062d-8300-45cd-8176-55beb1c7bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:45:13.771857 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c0a9f43f-578f-4a1d-8eae-e37819bc2cec tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eec978b0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:13.932297 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c0a9f43f-578f-4a1d-8eae-e37819bc2cec tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.176681 Oct 04 20:45:13.942382 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 795/1587] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:13 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:14.612195 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4475062d-8300-45cd-8176-55beb1c7bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 204 len: 0 microversion: 2.1 time: 1.084918 Oct 04 20:45:14.618275 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 793/1588] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:45:13 2022] DELETE /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 0 bytes in 1105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:14.634938 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a1172d95-87fa-47e2-8f88-31da4dea7b0e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:14.641975 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a1172d95-87fa-47e2-8f88-31da4dea7b0e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:14.689449 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1172d95-87fa-47e2-8f88-31da4dea7b0e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:14.699410 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1172d95-87fa-47e2-8f88-31da4dea7b0e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:14.700512 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1172d95-87fa-47e2-8f88-31da4dea7b0e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:14.707937 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1172d95-87fa-47e2-8f88-31da4dea7b0e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:14.707937 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1172d95-87fa-47e2-8f88-31da4dea7b0e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:14.707937 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a1172d95-87fa-47e2-8f88-31da4dea7b0e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:14.983488 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f506bb39-1485-4c81-abb0-a1275a9114d0 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eee31e50>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:15.217335 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f506bb39-1485-4c81-abb0-a1275a9114d0 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.244565 Oct 04 20:45:15.239744 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 794/1589] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:14 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:15.519973 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a1172d95-87fa-47e2-8f88-31da4dea7b0e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:15.575616 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a1172d95-87fa-47e2-8f88-31da4dea7b0e tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1469 microversion: 2.1 time: 0.951005 Oct 04 20:45:15.577100 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 796/1590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:14 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1469 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:16.273890 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9127889e-2a20-4064-b628-7a61adb73bf5 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eefd5040>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:16.522595 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9127889e-2a20-4064-b628-7a61adb73bf5 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.259350 Oct 04 20:45:16.527488 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 795/1591] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:16 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:16.640101 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-84e2301b-3bb9-4e2a-919c-f1f743387a90 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:16.648283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-84e2301b-3bb9-4e2a-919c-f1f743387a90 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:16.679579 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84e2301b-3bb9-4e2a-919c-f1f743387a90 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.685299 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84e2301b-3bb9-4e2a-919c-f1f743387a90 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.686145 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84e2301b-3bb9-4e2a-919c-f1f743387a90 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:16.687596 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84e2301b-3bb9-4e2a-919c-f1f743387a90 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.689386 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84e2301b-3bb9-4e2a-919c-f1f743387a90 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.689386 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-84e2301b-3bb9-4e2a-919c-f1f743387a90 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:17.568523 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9b7fbfe1-266f-43f2-9d71-14dd559bcc8b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef07f310>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:17.726458 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9b7fbfe1-266f-43f2-9d71-14dd559bcc8b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.176124 Oct 04 20:45:17.732311 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 796/1592] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:17 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:17.743650 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-84e2301b-3bb9-4e2a-919c-f1f743387a90 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:17.799658 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-84e2301b-3bb9-4e2a-919c-f1f743387a90 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1469 microversion: 2.1 time: 1.166646 Oct 04 20:45:17.805701 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 797/1593] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:16 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1469 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:18.764200 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4759a03f-7cc1-4aaf-8c1b-b95ee8137030 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef13a0d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:18.870306 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ee5755eb-b23f-46b6-994b-f364b3c92d85 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:18.876713 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ee5755eb-b23f-46b6-994b-f364b3c92d85 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:18.909304 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ee5755eb-b23f-46b6-994b-f364b3c92d85 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.914576 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ee5755eb-b23f-46b6-994b-f364b3c92d85 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.916279 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ee5755eb-b23f-46b6-994b-f364b3c92d85 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:18.920627 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ee5755eb-b23f-46b6-994b-f364b3c92d85 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.925952 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ee5755eb-b23f-46b6-994b-f364b3c92d85 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.932128 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ee5755eb-b23f-46b6-994b-f364b3c92d85 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.987606 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ee5755eb-b23f-46b6-994b-f364b3c92d85 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:20.024570 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ee5755eb-b23f-46b6-994b-f364b3c92d85 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1469 microversion: 2.1 time: 1.171720 Oct 04 20:45:20.060939 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 798/1594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:18 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1469 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:20.495184 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4759a03f-7cc1-4aaf-8c1b-b95ee8137030 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 1.732183 Oct 04 20:45:20.495184 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 797/1595] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:18 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:21.080025 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f206f3ac-22ae-4225-9130-80d788a9b5e7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:21.085837 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f206f3ac-22ae-4225-9130-80d788a9b5e7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:21.113942 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f206f3ac-22ae-4225-9130-80d788a9b5e7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.116247 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f206f3ac-22ae-4225-9130-80d788a9b5e7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.117403 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f206f3ac-22ae-4225-9130-80d788a9b5e7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.119233 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f206f3ac-22ae-4225-9130-80d788a9b5e7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.127390 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f206f3ac-22ae-4225-9130-80d788a9b5e7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.129612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f206f3ac-22ae-4225-9130-80d788a9b5e7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.191190 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-8cadf330-0929-404a-b078-c07af5d7b3fc req-f5c50ef9-e0b5-452d-bcdc-6adc9531f828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df857cc-3e6c-4b0b-910e-dd62869d64d1", "name": "network-vif-deleted", "tag": "54432a46-1686-4c52-94a1-47829a97e1e1"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:21.236453 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=24 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:21.265033 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-8cadf330-0929-404a-b078-c07af5d7b3fc req-f5c50ef9-e0b5-452d-bcdc-6adc9531f828 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.267975 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-8cadf330-0929-404a-b078-c07af5d7b3fc req-f5c50ef9-e0b5-452d-bcdc-6adc9531f828 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.271524 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-8cadf330-0929-404a-b078-c07af5d7b3fc req-f5c50ef9-e0b5-452d-bcdc-6adc9531f828 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.346244 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-8cadf330-0929-404a-b078-c07af5d7b3fc req-f5c50ef9-e0b5-452d-bcdc-6adc9531f828 service nova] Creating event network-vif-deleted:54432a46-1686-4c52-94a1-47829a97e1e1 for instance 7df857cc-3e6c-4b0b-910e-dd62869d64d1 on n-h1-852085-12 Oct 04 20:45:21.387652 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-8cadf330-0929-404a-b078-c07af5d7b3fc req-f5c50ef9-e0b5-452d-bcdc-6adc9531f828 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204607 Oct 04 20:45:21.396165 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f206f3ac-22ae-4225-9130-80d788a9b5e7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.398416 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 798/1596] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:45:21.415482 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f206f3ac-22ae-4225-9130-80d788a9b5e7 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1427 microversion: 2.1 time: 0.343144 Oct 04 20:45:21.421436 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 799/1597] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:21 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1427 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:21.533260 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b7203ad4-d5e8-4caa-b478-c3637a3fe515 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef07fe50>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:22.462451 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:22.469220 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:22.493456 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:22.499550 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:22.504225 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:22.507124 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:22.509578 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:22.511864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:22.714105 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:22.718802 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:22.725684 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:22.731224 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lazy-loading 'fault' on Instance uuid 7df857cc-3e6c-4b0b-910e-dd62869d64d1 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:22.776942 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b7203ad4-d5e8-4caa-b478-c3637a3fe515 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 1.256197 Oct 04 20:45:22.778031 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 799/1598] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:21 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:22.973298 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:23.006639 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3afc4741-2a63-4b9f-a735-271afee41b6d tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1303 microversion: 2.1 time: 0.550053 Oct 04 20:45:23.013362 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 800/1599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:22 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1303 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:23.814086 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bf813019-be80-4c6c-ac18-099dd15157e4 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eee769d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:24.089955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:24.115524 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:24.120172 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=12 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:24.182792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.192423 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.198997 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.199378 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.200236 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.201221 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.369312 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bf813019-be80-4c6c-ac18-099dd15157e4 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.559456 Oct 04 20:45:24.377537 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 800/1600] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:23 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:24.401639 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.402608 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.412080 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.413093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lazy-loading 'fault' on Instance uuid 7df857cc-3e6c-4b0b-910e-dd62869d64d1 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:24.681022 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:24.734977 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d776e139-3dfe-464e-833a-741102fa56ce tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 200 len: 1303 microversion: 2.1 time: 0.673757 Oct 04 20:45:24.739878 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 801/1601] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:24 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 1303 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:25.407627 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-26dc358e-0d81-4cf3-b626-2bb871aabb39 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef13a4c0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:25.575563 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-26dc358e-0d81-4cf3-b626-2bb871aabb39 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.173636 Oct 04 20:45:25.580369 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 801/1602] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:25 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:25.789110 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-24b38c86-30e0-4c15-8b5f-bba7dca01bfe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:25.799984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-24b38c86-30e0-4c15-8b5f-bba7dca01bfe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: 7df857cc-3e6c-4b0b-910e-dd62869d64d1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:25.856670 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-24b38c86-30e0-4c15-8b5f-bba7dca01bfe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:25.862708 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-24b38c86-30e0-4c15-8b5f-bba7dca01bfe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:25.870877 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-24b38c86-30e0-4c15-8b5f-bba7dca01bfe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:25.871778 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-24b38c86-30e0-4c15-8b5f-bba7dca01bfe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:25.873035 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-24b38c86-30e0-4c15-8b5f-bba7dca01bfe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:25.874193 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-24b38c86-30e0-4c15-8b5f-bba7dca01bfe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:25.953112 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-24b38c86-30e0-4c15-8b5f-bba7dca01bfe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] HTTP exception thrown: Instance 7df857cc-3e6c-4b0b-910e-dd62869d64d1 could not be found. Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-24b38c86-30e0-4c15-8b5f-bba7dca01bfe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Request method failure captured: Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 HTTP/1.1 Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJpblJddoYMSPWcUTdqfvobvsfp93ICKvEGawGJjKkYFN9iJXVAAbI7Z-CdKre4WhWkTtxsrvK0tW3F3WdUKWWu9FNfNg9cH98ADcx78yMCfPUyc8k09Hn4OmIe_Y_DNQKGXtAvChX9Mbeq32xAh--Mhx3MjdnNdpEp3oXW49UkS2Uo Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: e9fae788056d4b8e9d45e8988fc6920f Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersAdminTestJSON-672945853 Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e9fae788056d4b8e9d45e8988fc6920f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e9fae788056d4b8e9d45e8988fc6920f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e9fae788056d4b8e9d45e8988fc6920f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e9fae788056d4b8e9d45e8988fc6920f"}]}] Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersAdminTestJSON-672945853 Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: e9fae788056d4b8e9d45e8988fc6920f Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersAdminTestJSON-672945853 Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersAdminTestJSON-672945853-project Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: edcdbeebe55e41cb9072a7561e0988f8 Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersAdminTestJSON-672945853-project Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 7df857cc-3e6c-4b0b-910e-dd62869d64d1 could not be found. Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '7df857cc-3e6c-4b0b-910e-dd62869d64d1'} Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7df857cc-3e6c-4b0b-910e-dd62869d64d1 could not be found. Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7df857cc-3e6c-4b0b-910e-dd62869d64d1 could not be found. Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:25.961764 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:45:25.972803 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:25.972803 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:25.972803 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:25.972803 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:25.972803 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:25.972803 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7df857cc-3e6c-4b0b-910e-dd62869d64d1 could not be found. Oct 04 20:45:25.972803 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:45:26.009571 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-24b38c86-30e0-4c15-8b5f-bba7dca01bfe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Returning 404 to user: Instance 7df857cc-3e6c-4b0b-910e-dd62869d64d1 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:26.016182 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-24b38c86-30e0-4c15-8b5f-bba7dca01bfe tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1" status: 404 len: 111 microversion: 2.1 time: 0.236494 Oct 04 20:45:26.025619 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 802/1603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:25 2022] GET /compute/v2.1/servers/7df857cc-3e6c-4b0b-910e-dd62869d64d1 => generated 111 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:26.039107 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-77977df7-cb73-41bb-a81c-52f67d6a67ec tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:26.044891 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-77977df7-cb73-41bb-a81c-52f67d6a67ec tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:26.093513 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77977df7-cb73-41bb-a81c-52f67d6a67ec tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:26.095427 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77977df7-cb73-41bb-a81c-52f67d6a67ec tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:26.101314 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77977df7-cb73-41bb-a81c-52f67d6a67ec tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:26.101314 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77977df7-cb73-41bb-a81c-52f67d6a67ec tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:26.103798 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77977df7-cb73-41bb-a81c-52f67d6a67ec tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:26.108530 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-77977df7-cb73-41bb-a81c-52f67d6a67ec tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:26.244380 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-77977df7-cb73-41bb-a81c-52f67d6a67ec tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:45:26.611553 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-30ad169c-c6e5-4555-9a34-6c56c211e9a7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f7498040>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:26.921855 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-30ad169c-c6e5-4555-9a34-6c56c211e9a7 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.308414 Oct 04 20:45:26.939411 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 803/1604] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:26 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:27.051013 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-77977df7-cb73-41bb-a81c-52f67d6a67ec tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 204 len: 0 microversion: 2.1 time: 1.017741 Oct 04 20:45:27.058287 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 802/1605] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:45:26 2022] DELETE /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:27.070392 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d0a9e42b-0b3e-4555-89dd-756b78663a2c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:27.077264 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d0a9e42b-0b3e-4555-89dd-756b78663a2c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:27.107989 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0a9e42b-0b3e-4555-89dd-756b78663a2c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:27.113630 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0a9e42b-0b3e-4555-89dd-756b78663a2c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:27.113630 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0a9e42b-0b3e-4555-89dd-756b78663a2c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:27.117785 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0a9e42b-0b3e-4555-89dd-756b78663a2c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:27.119538 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0a9e42b-0b3e-4555-89dd-756b78663a2c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:27.125717 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d0a9e42b-0b3e-4555-89dd-756b78663a2c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:27.959718 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-002b5cc0-c8f4-4ce1-b89a-c5ad301b307b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eef01f70>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:28.027621 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-d0a9e42b-0b3e-4555-89dd-756b78663a2c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:28.064792 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d0a9e42b-0b3e-4555-89dd-756b78663a2c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1469 microversion: 2.1 time: 1.002004 Oct 04 20:45:28.092933 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 804/1606] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:27 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1469 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:28.161969 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-002b5cc0-c8f4-4ce1-b89a-c5ad301b307b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.209571 Oct 04 20:45:28.174807 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 803/1607] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:27 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:29.135335 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fb4592f3-6974-4709-9598-efdcea71bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:29.137901 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-fb4592f3-6974-4709-9598-efdcea71bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:29.171636 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb4592f3-6974-4709-9598-efdcea71bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.173125 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb4592f3-6974-4709-9598-efdcea71bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.188538 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb4592f3-6974-4709-9598-efdcea71bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.190585 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb4592f3-6974-4709-9598-efdcea71bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.191783 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb4592f3-6974-4709-9598-efdcea71bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.192864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fb4592f3-6974-4709-9598-efdcea71bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.216650 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ca0d8e34-87e5-4f0a-b856-3241f77ea296 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eef1eaf0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:29.459049 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ca0d8e34-87e5-4f0a-b856-3241f77ea296 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.253154 Oct 04 20:45:29.470544 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 804/1608] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:29 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:30.228947 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-fb4592f3-6974-4709-9598-efdcea71bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:30.256074 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fb4592f3-6974-4709-9598-efdcea71bc5b tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1469 microversion: 2.1 time: 1.141063 Oct 04 20:45:30.269838 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 805/1609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:29 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1469 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:30.504113 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1857b6a5-a424-4dba-84bb-36355210beb6 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef07fca0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:30.730985 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1857b6a5-a424-4dba-84bb-36355210beb6 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.240527 Oct 04 20:45:30.741786 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 805/1610] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:30 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:31.310270 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3c931d29-0833-4d74-a88c-92222bf773eb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:31.317473 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3c931d29-0833-4d74-a88c-92222bf773eb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:31.355625 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c931d29-0833-4d74-a88c-92222bf773eb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.357143 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c931d29-0833-4d74-a88c-92222bf773eb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.372356 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c931d29-0833-4d74-a88c-92222bf773eb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.374278 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c931d29-0833-4d74-a88c-92222bf773eb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.378224 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c931d29-0833-4d74-a88c-92222bf773eb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.391513 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c931d29-0833-4d74-a88c-92222bf773eb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.769480 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6ca4d557-3786-4a7f-93fd-4e4cef50b144 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eef63670>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:31.873949 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3c931d29-0833-4d74-a88c-92222bf773eb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:31.942735 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3c931d29-0833-4d74-a88c-92222bf773eb tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1427 microversion: 2.1 time: 0.639246 Oct 04 20:45:31.948450 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 806/1611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:31 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1427 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:32.007318 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6ca4d557-3786-4a7f-93fd-4e4cef50b144 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.247477 Oct 04 20:45:32.008796 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 806/1612] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:31 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:32.994552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cd334f67-c197-4dde-9c56-e4150e297d26 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:32.996456 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-cd334f67-c197-4dde-9c56-e4150e297d26 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:33.018686 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cd334f67-c197-4dde-9c56-e4150e297d26 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.024414 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cd334f67-c197-4dde-9c56-e4150e297d26 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.025691 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cd334f67-c197-4dde-9c56-e4150e297d26 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.037892 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9e5f9c5a-e709-4fc3-a6e3-efea1735b2ef tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eefca700>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:33.039877 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cd334f67-c197-4dde-9c56-e4150e297d26 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.041177 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cd334f67-c197-4dde-9c56-e4150e297d26 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.044396 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cd334f67-c197-4dde-9c56-e4150e297d26 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.362864 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9e5f9c5a-e709-4fc3-a6e3-efea1735b2ef tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.332330 Oct 04 20:45:33.373655 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 807/1613] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:33 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:33.393778 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-7ad85018-4bf8-4e1e-92a7-ae904a0915d7 req-10668a3a-a3f7-42d0-a6bc-98ed48803708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3b28cc-8307-4f7a-889b-ab08d068ec0e", "name": "network-vif-deleted", "tag": "e7face03-f5ca-470d-ba1f-9b74713e1d67"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:33.432432 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-7ad85018-4bf8-4e1e-92a7-ae904a0915d7 req-10668a3a-a3f7-42d0-a6bc-98ed48803708 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.437766 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-7ad85018-4bf8-4e1e-92a7-ae904a0915d7 req-10668a3a-a3f7-42d0-a6bc-98ed48803708 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.437766 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-7ad85018-4bf8-4e1e-92a7-ae904a0915d7 req-10668a3a-a3f7-42d0-a6bc-98ed48803708 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.510676 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-7ad85018-4bf8-4e1e-92a7-ae904a0915d7 req-10668a3a-a3f7-42d0-a6bc-98ed48803708 service nova] Creating event network-vif-deleted:e7face03-f5ca-470d-ba1f-9b74713e1d67 for instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e on n-h1-852085-12 Oct 04 20:45:33.590800 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-7ad85018-4bf8-4e1e-92a7-ae904a0915d7 req-10668a3a-a3f7-42d0-a6bc-98ed48803708 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211986 Oct 04 20:45:33.622445 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-cd334f67-c197-4dde-9c56-e4150e297d26 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:33.626993 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 808/1614] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:33.663219 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cd334f67-c197-4dde-9c56-e4150e297d26 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1427 microversion: 2.1 time: 0.682003 Oct 04 20:45:33.714324 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 807/1615] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:32 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1427 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:34.400509 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a922d53b-d7d8-47f6-9c84-cdc1945684e5 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef07f670>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:34.646670 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a922d53b-d7d8-47f6-9c84-cdc1945684e5 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.248046 Oct 04 20:45:34.666662 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 809/1616] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:34 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:34.774298 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:34.775550 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:34.809977 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:34.814967 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:34.824483 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:34.830855 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:34.833749 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:34.838720 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:34.989397 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:34.992713 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:34.994131 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.003027 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lazy-loading 'fault' on Instance uuid ad3b28cc-8307-4f7a-889b-ab08d068ec0e {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:35.684400 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-660a4591-e779-4d6c-bbec-efc1904f24d5 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eefd90d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:35.822425 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edcdbeebe55e41cb9072a7561e0988f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fae788056d4b8e9d45e8988fc6920f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:35.851603 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-dceea131-d8e5-4f6c-b5d2-ff3d43cec73c tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 200 len: 1304 microversion: 2.1 time: 1.088325 Oct 04 20:45:35.857788 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 808/1617] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:34 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 1304 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:35.985031 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-660a4591-e779-4d6c-bbec-efc1904f24d5 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.300159 Oct 04 20:45:35.986496 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 810/1618] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:35 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:36.907325 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c282fab3-ac5a-4bdd-b122-d2398235deb4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:36.916089 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c282fab3-ac5a-4bdd-b122-d2398235deb4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] [instance: ad3b28cc-8307-4f7a-889b-ab08d068ec0e] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:37.015278 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c282fab3-ac5a-4bdd-b122-d2398235deb4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.017147 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c282fab3-ac5a-4bdd-b122-d2398235deb4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:37.022757 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-14f4c7fd-01ad-4023-97a0-648bf4d33baa tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef6b9820>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:37.030702 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c282fab3-ac5a-4bdd-b122-d2398235deb4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:37.043113 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c282fab3-ac5a-4bdd-b122-d2398235deb4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.044800 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c282fab3-ac5a-4bdd-b122-d2398235deb4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:37.050542 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c282fab3-ac5a-4bdd-b122-d2398235deb4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:37.155919 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-c282fab3-ac5a-4bdd-b122-d2398235deb4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] HTTP exception thrown: Instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e could not be found. Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c282fab3-ac5a-4bdd-b122-d2398235deb4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Request method failure captured: Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e HTTP/1.1 Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJpblJddoYMSPWcUTdqfvobvsfp93ICKvEGawGJjKkYFN9iJXVAAbI7Z-CdKre4WhWkTtxsrvK0tW3F3WdUKWWu9FNfNg9cH98ADcx78yMCfPUyc8k09Hn4OmIe_Y_DNQKGXtAvChX9Mbeq32xAh--Mhx3MjdnNdpEp3oXW49UkS2Uo Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: e9fae788056d4b8e9d45e8988fc6920f Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersAdminTestJSON-672945853 Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e9fae788056d4b8e9d45e8988fc6920f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e9fae788056d4b8e9d45e8988fc6920f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e9fae788056d4b8e9d45e8988fc6920f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e9fae788056d4b8e9d45e8988fc6920f"}]}] Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersAdminTestJSON-672945853 Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: e9fae788056d4b8e9d45e8988fc6920f Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersAdminTestJSON-672945853 Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersAdminTestJSON-672945853-project Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: edcdbeebe55e41cb9072a7561e0988f8 Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersAdminTestJSON-672945853-project Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e could not be found. Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'ad3b28cc-8307-4f7a-889b-ab08d068ec0e'} Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e could not be found. Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e could not be found. Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:37.159731 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:45:37.178111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:37.178111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:37.178111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:37.178111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:37.178111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:37.178111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e could not be found. Oct 04 20:45:37.178111 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:45:37.193996 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c282fab3-ac5a-4bdd-b122-d2398235deb4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] Returning 404 to user: Instance ad3b28cc-8307-4f7a-889b-ab08d068ec0e could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:37.196778 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c282fab3-ac5a-4bdd-b122-d2398235deb4 tempest-ServersAdminTestJSON-672945853 tempest-ServersAdminTestJSON-672945853-project] 10.222.0.78 "GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e" status: 404 len: 111 microversion: 2.1 time: 0.300036 Oct 04 20:45:37.198037 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 809/1619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:36 2022] GET /compute/v2.1/servers/ad3b28cc-8307-4f7a-889b-ab08d068ec0e => generated 111 bytes in 304 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:37.425296 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-14f4c7fd-01ad-4023-97a0-648bf4d33baa tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.417117 Oct 04 20:45:37.432253 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 811/1620] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:37 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:38.464594 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c902170e-d277-4f6b-91e7-e56042e30c9d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eec90040>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:38.721390 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c902170e-d277-4f6b-91e7-e56042e30c9d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.263369 Oct 04 20:45:38.739710 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 810/1621] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:38 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:39.759906 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d9ce4bf2-c64a-4141-bf53-c8d6a32e42af tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef13a310>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:39.932563 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d9ce4bf2-c64a-4141-bf53-c8d6a32e42af tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.189246 Oct 04 20:45:39.939329 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 812/1622] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:39 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:40.974524 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3751ee5f-0a50-4f0a-8323-48abc615fb5d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eec97e50>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:41.162243 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3751ee5f-0a50-4f0a-8323-48abc615fb5d tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.202171 Oct 04 20:45:41.185326 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 811/1623] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:40 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:42.208165 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9344eb11-c5f6-442b-83cf-88eba15f75a1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eefd50d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:42.385050 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9344eb11-c5f6-442b-83cf-88eba15f75a1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.189236 Oct 04 20:45:42.407544 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 813/1624] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:42 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:43.438722 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b4c0c508-a855-4707-bbc1-e5700ad6762b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f74c5b80>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:43.712715 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b4c0c508-a855-4707-bbc1-e5700ad6762b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.275356 Oct 04 20:45:43.720304 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 812/1625] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:43 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:44.751265 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5dbba458-4ebd-40cd-8a87-131708cc7fa1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef0285e0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:44.782749 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:44.784477 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=65,nova_cell1:INSERT=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:44.938277 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5dbba458-4ebd-40cd-8a87-131708cc7fa1 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.196190 Oct 04 20:45:44.959997 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 814/1626] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:44 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:45.978330 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e8243aaf-e7ec-429a-82e9-4df18c2cd94f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f74c50d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:46.219834 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e8243aaf-e7ec-429a-82e9-4df18c2cd94f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.254011 Oct 04 20:45:46.224500 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 813/1627] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:45 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:47.260272 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9d8d966f-32c4-4c32-9ef3-483e5177fd5f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef6b9430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:47.494491 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9d8d966f-32c4-4c32-9ef3-483e5177fd5f tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.242429 Oct 04 20:45:47.513674 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 815/1628] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:47 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:48.535503 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-67abeb22-9479-4a6c-bf82-cf9d318a6666 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eec97e50>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:48.559465 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:48.568162 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=83 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:48.742471 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-67abeb22-9479-4a6c-bf82-cf9d318a6666 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.218552 Oct 04 20:45:48.763387 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 814/1629] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:48 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:49.777667 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6e3f4137-cce3-42f5-977e-111e17e61311 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eee40dc0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:50.036911 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6e3f4137-cce3-42f5-977e-111e17e61311 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.257353 Oct 04 20:45:50.042774 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 816/1630] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:49 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:51.078694 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0e837f8c-c9d9-40a3-8f6d-a483af7e1df4 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eec90c10>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:51.356567 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0e837f8c-c9d9-40a3-8f6d-a483af7e1df4 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.293054 Oct 04 20:45:51.376852 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 815/1631] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:51 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:52.387943 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e25b76cc-c479-45e0-b0a4-393d9b366b64 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eef63d30>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:52.635196 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e25b76cc-c479-45e0-b0a4-393d9b366b64 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.259038 Oct 04 20:45:52.645384 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 817/1632] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:52 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:53.667035 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bd590f80-39f2-453f-b480-256b48fc4223 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eec90700>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:53.929610 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bd590f80-39f2-453f-b480-256b48fc4223 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.269676 Oct 04 20:45:53.943714 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 816/1633] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:53 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:54.964468 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-19dfd0f9-c62d-464d-b61c-e87aa857df71 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eef1eb80>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:55.275193 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-19dfd0f9-c62d-464d-b61c-e87aa857df71 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.309195 Oct 04 20:45:55.280194 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 818/1634] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:54 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:56.342929 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-09c53ced-d194-424a-877c-2886d119c372 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eec97310>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:56.726508 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-09c53ced-d194-424a-877c-2886d119c372 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.428470 Oct 04 20:45:56.752357 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 817/1635] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:56 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:57.772264 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-24cbb17e-f8d0-4b23-9eb3-b9ca2409c5e3 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eefd95e0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:58.083167 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-24cbb17e-f8d0-4b23-9eb3-b9ca2409c5e3 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1428 microversion: 2.1 time: 0.315651 Oct 04 20:45:58.091510 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 819/1636] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:57 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1428 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:59.125857 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-966e2de8-d057-4465-b6da-d707a5916613 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77f74984c0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:59.326313 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-966e2de8-d057-4465-b6da-d707a5916613 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1437 microversion: 2.1 time: 0.211823 Oct 04 20:45:59.327561 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 818/1637] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:59 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1437 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:59.362185 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cf6f38c2-b97c-46de-ac43-bf76778c6d17 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77ef07f940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:59.564042 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cf6f38c2-b97c-46de-ac43-bf76778c6d17 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 200 len: 1437 microversion: 2.1 time: 0.209222 Oct 04 20:45:59.572517 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 820/1638] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:59 2022] GET /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 1437 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:59.618105 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d8660282-cdee-4a4f-9c8e-20585afbc712 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:59.619843 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d8660282-cdee-4a4f-9c8e-20585afbc712 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:59.644691 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d8660282-cdee-4a4f-9c8e-20585afbc712 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.645243 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d8660282-cdee-4a4f-9c8e-20585afbc712 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.646116 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d8660282-cdee-4a4f-9c8e-20585afbc712 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.649051 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d8660282-cdee-4a4f-9c8e-20585afbc712 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.650957 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d8660282-cdee-4a4f-9c8e-20585afbc712 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.652126 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d8660282-cdee-4a4f-9c8e-20585afbc712 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:00.695032 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-d8660282-cdee-4a4f-9c8e-20585afbc712 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:00.745850 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d8660282-cdee-4a4f-9c8e-20585afbc712 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1479 microversion: 2.1 time: 1.148196 Oct 04 20:46:00.748387 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 819/1639] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:59 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1479 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:01.625932 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dcd9cd7f-d14b-4617-8421-08563df8bac5 tempest-InstanceActionsNegativeTestJSON-2026946522 tempest-InstanceActionsNegativeTestJSON-2026946522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-718688914", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "ea295f65-b2b0-4162-9a9d-6d9b3e880cb5"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:01.807445 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-edbcf02f-21a6-4d1f-aff7-1af23f29db1a tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:01.809938 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-edbcf02f-21a6-4d1f-aff7-1af23f29db1a tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:01.816165 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-dcd9cd7f-d14b-4617-8421-08563df8bac5 tempest-InstanceActionsNegativeTestJSON-2026946522 tempest-InstanceActionsNegativeTestJSON-2026946522-project] validate_networks() for [('ea295f65-b2b0-4162-9a9d-6d9b3e880cb5', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:46:01.842888 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-edbcf02f-21a6-4d1f-aff7-1af23f29db1a tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:01.844265 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-edbcf02f-21a6-4d1f-aff7-1af23f29db1a tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:01.846035 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-edbcf02f-21a6-4d1f-aff7-1af23f29db1a tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:01.847887 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-edbcf02f-21a6-4d1f-aff7-1af23f29db1a tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:01.849567 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-edbcf02f-21a6-4d1f-aff7-1af23f29db1a tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:01.850885 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-edbcf02f-21a6-4d1f-aff7-1af23f29db1a tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:03.460139 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-edbcf02f-21a6-4d1f-aff7-1af23f29db1a tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:03.488976 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-edbcf02f-21a6-4d1f-aff7-1af23f29db1a tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1466 microversion: 2.1 time: 1.695486 Oct 04 20:46:03.508666 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 820/1640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:01 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1466 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:03.568968 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e0908a02-a746-4d04-b0e1-590af5b244a6 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eec97670>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-dcd9cd7f-d14b-4617-8421-08563df8bac5 tempest-InstanceActionsNegativeTestJSON-2026946522 tempest-InstanceActionsNegativeTestJSON-2026946522-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dc2edb5b-46a1-4e2c-a40f-1289fbb6c2ec) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:46:03.672323 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dc2edb5b-46a1-4e2c-a40f-1289fbb6c2ec) Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-dcd9cd7f-d14b-4617-8421-08563df8bac5 tempest-InstanceActionsNegativeTestJSON-2026946522 tempest-InstanceActionsNegativeTestJSON-2026946522-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:03.679766 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dcd9cd7f-d14b-4617-8421-08563df8bac5 tempest-InstanceActionsNegativeTestJSON-2026946522 tempest-InstanceActionsNegativeTestJSON-2026946522-project] Request method failure captured: Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 216 Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJuI8UsWHDSqhfkIilNtz9YA2R-ghwaD0LkQl3PY0WUEzPtOgfJPB_vjtaLfqj9LmrPhhjTjWmT0BW1E_qhoHxWK79JML3GPaCMLW0ugeg67Lmb3EbVcA0PO8tKOMRnjL9SXtsbHHuvqUabHECO3yYMsRG-56akVDXXlG6-FecBuq98 Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: f2c92a8a2d7b4a7f8d8374cfe5670ce1 Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2026946522 Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f2c92a8a2d7b4a7f8d8374cfe5670ce1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2c92a8a2d7b4a7f8d8374cfe5670ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2c92a8a2d7b4a7f8d8374cfe5670ce1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f2c92a8a2d7b4a7f8d8374cfe5670ce1"}]}] Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2026946522 Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: f2c92a8a2d7b4a7f8d8374cfe5670ce1 Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2026946522 Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-InstanceActionsNegativeTestJSON-2026946522-project Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: bc9151f4e9bc4274b6c75f7d44d0873e Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2026946522-project Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-718688914", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "ea295f65-b2b0-4162-9a9d-6d9b3e880cb5"}]}} Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsNegativeTestJSON-server-718688914', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'ea295f65-b2b0-4162-9a9d-6d9b3e880cb5'}]}}} Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:46:03.694631 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dc2edb5b-46a1-4e2c-a40f-1289fbb6c2ec) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:46:03.702995 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dcd9cd7f-d14b-4617-8421-08563df8bac5 tempest-InstanceActionsNegativeTestJSON-2026946522 tempest-InstanceActionsNegativeTestJSON-2026946522-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-dcd9cd7f-d14b-4617-8421-08563df8bac5 tempest-InstanceActionsNegativeTestJSON-2026946522 tempest-InstanceActionsNegativeTestJSON-2026946522-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.507301 Oct 04 20:46:03.719939 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 821/1641] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:46:01 2022] POST /compute/v2.1/servers => generated 214 bytes in 2510 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:46:05.073314 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-9760365a-4199-457d-84da-5170089c15f3 req-b1e6a9d9-ddbf-43d3-91ae-d93345df66a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568cbe45-b90d-49d4-8ed6-90923e399d49", "name": "network-vif-unplugged", "status": "completed", "tag": "46ab96a5-0e71-4267-bb4f-54da94372f8e"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:05.096747 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-9760365a-4199-457d-84da-5170089c15f3 req-b1e6a9d9-ddbf-43d3-91ae-d93345df66a3 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:05.098438 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-9760365a-4199-457d-84da-5170089c15f3 req-b1e6a9d9-ddbf-43d3-91ae-d93345df66a3 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:05.099488 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-9760365a-4199-457d-84da-5170089c15f3 req-b1e6a9d9-ddbf-43d3-91ae-d93345df66a3 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:05.127240 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-9760365a-4199-457d-84da-5170089c15f3 req-b1e6a9d9-ddbf-43d3-91ae-d93345df66a3 service nova] Creating event network-vif-unplugged:46ab96a5-0e71-4267-bb4f-54da94372f8e for instance 568cbe45-b90d-49d4-8ed6-90923e399d49 on n-h2-852085-12 Oct 04 20:46:05.143438 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-9760365a-4199-457d-84da-5170089c15f3 req-b1e6a9d9-ddbf-43d3-91ae-d93345df66a3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076627 Oct 04 20:46:05.145375 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 822/1642] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:46:07.178662 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e0908a02-a746-4d04-b0e1-590af5b244a6 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "DELETE /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68" status: 204 len: 0 microversion: 2.1 time: 3.620571 Oct 04 20:46:07.182254 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 821/1643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:03 2022] DELETE /compute/v2.1/images/a43d7ed1-f1e7-40fb-a184-8c2a18d8ea68 => generated 0 bytes in 3629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:46:07.200800 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cbfd25f8-1ca3-4568-93f2-f7884b45136b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '.version_select at 0x7f77eefd9e50>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:07.280537 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-cbfd25f8-1ca3-4568-93f2-f7884b45136b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] HTTP exception thrown: Image not found. Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cbfd25f8-1ca3-4568-93f2-f7884b45136b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Request method failure captured: Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 HTTP/1.1 Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJrHiaQDUDmcCXWfUUHPwiZ9e31Meb32b3xF1XIQ2bwIqaNBM4oWnZP-_PqR516iLwYk2vk49vaOjh6FVl2wRovEiItFDS1eCtqUzAv4Pa5NJX6MymczXGbPhGD-7N81bMGXRUA1AusWqRilOAIpf5TYM5f6BDuHHsCwsbpC_oiMrK8 Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: baa9bc0601f141e48e1b5f001769d221 Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesOneServerTestJSON-2098750367 Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_baa9bc0601f141e48e1b5f001769d221", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/baa9bc0601f141e48e1b5f001769d221"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/baa9bc0601f141e48e1b5f001769d221"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/baa9bc0601f141e48e1b5f001769d221"}]}] Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesOneServerTestJSON-2098750367 Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: baa9bc0601f141e48e1b5f001769d221 Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2098750367 Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesOneServerTestJSON-2098750367-project Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: c7677d259d034a68aaba770506475f73 Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesOneServerTestJSON-2098750367-project Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: exception: Image not found. Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '5b3f4a4d-a424-4c82-8857-620a5d66c561'} Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5b3f4a4d-a424-4c82-8857-620a5d66c561 to delete Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5b3f4a4d-a424-4c82-8857-620a5d66c561 could not be found. Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:07.286303 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cbfd25f8-1ca3-4568-93f2-f7884b45136b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Returning 404 to user: Image not found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cbfd25f8-1ca3-4568-93f2-f7884b45136b tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "DELETE /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561" status: 404 len: 62 microversion: 2.1 time: 0.102702 Oct 04 20:46:07.296706 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 823/1644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:07 2022] DELETE /compute/v2.1/images/5b3f4a4d-a424-4c82-8857-620a5d66c561 => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:46:07.311670 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fba36b05-b66c-4572-8909-f34914c49736 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:07.314324 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-fba36b05-b66c-4572-8909-f34914c49736 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:07.330046 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fba36b05-b66c-4572-8909-f34914c49736 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:07.331043 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fba36b05-b66c-4572-8909-f34914c49736 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:07.331811 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fba36b05-b66c-4572-8909-f34914c49736 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:07.333174 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fba36b05-b66c-4572-8909-f34914c49736 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:07.334203 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fba36b05-b66c-4572-8909-f34914c49736 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:07.335116 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fba36b05-b66c-4572-8909-f34914c49736 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:07.385381 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-fba36b05-b66c-4572-8909-f34914c49736 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:46:07.944493 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fba36b05-b66c-4572-8909-f34914c49736 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "DELETE /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 204 len: 0 microversion: 2.1 time: 0.638428 Oct 04 20:46:07.944493 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 822/1645] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:46:07 2022] DELETE /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:46:07.957162 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dc43271f-0132-46d1-9438-ec0da4c67840 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:07.959345 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-dc43271f-0132-46d1-9438-ec0da4c67840 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:07.982636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dc43271f-0132-46d1-9438-ec0da4c67840 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:07.984356 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dc43271f-0132-46d1-9438-ec0da4c67840 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:07.986081 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dc43271f-0132-46d1-9438-ec0da4c67840 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:07.988739 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dc43271f-0132-46d1-9438-ec0da4c67840 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:07.990074 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dc43271f-0132-46d1-9438-ec0da4c67840 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:07.991526 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-dc43271f-0132-46d1-9438-ec0da4c67840 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:09.267011 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-194e5d48-86b8-40c0-a3be-db5b83fe2ad7 tempest-ServerRescueTestJSONUnderV235-96863184 tempest-ServerRescueTestJSONUnderV235-96863184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1165381069", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:09.436997 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-194e5d48-86b8-40c0-a3be-db5b83fe2ad7 tempest-ServerRescueTestJSONUnderV235-96863184 tempest-ServerRescueTestJSONUnderV235-96863184-project] validate_networks() for [('9e32d24b-d5bc-4229-a75e-1999f71b4a0c', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:46:09.890387 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-dc43271f-0132-46d1-9438-ec0da4c67840 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:09.936045 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-dc43271f-0132-46d1-9438-ec0da4c67840 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1472 microversion: 2.1 time: 1.980007 Oct 04 20:46:09.941381 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 824/1646] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:07 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1472 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:10.989043 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d75891e0-1a4c-4824-b3df-0a07cde63f45 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:10.992192 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d75891e0-1a4c-4824-b3df-0a07cde63f45 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:11.023987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d75891e0-1a4c-4824-b3df-0a07cde63f45 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:11.024803 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d75891e0-1a4c-4824-b3df-0a07cde63f45 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:11.032468 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d75891e0-1a4c-4824-b3df-0a07cde63f45 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:11.032468 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d75891e0-1a4c-4824-b3df-0a07cde63f45 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:11.032468 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d75891e0-1a4c-4824-b3df-0a07cde63f45 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:11.032468 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d75891e0-1a4c-4824-b3df-0a07cde63f45 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-194e5d48-86b8-40c0-a3be-db5b83fe2ad7 tempest-ServerRescueTestJSONUnderV235-96863184 tempest-ServerRescueTestJSONUnderV235-96863184-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-71675f19-0125-4c18-92bb-1d515b8de9fb) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:46:11.249859 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-71675f19-0125-4c18-92bb-1d515b8de9fb) Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-194e5d48-86b8-40c0-a3be-db5b83fe2ad7 tempest-ServerRescueTestJSONUnderV235-96863184 tempest-ServerRescueTestJSONUnderV235-96863184-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:11.254995 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-194e5d48-86b8-40c0-a3be-db5b83fe2ad7 tempest-ServerRescueTestJSONUnderV235-96863184 tempest-ServerRescueTestJSONUnderV235-96863184-project] Request method failure captured: Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 247 Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJuQasZ61wRecNBhVtlZlHj4tHAaS6FxKgj853JaGYugqG5IamhQrdtWQ_jtzln59hsXjjYGgu20JzKGIkBHpbbTyh1zZIvfyQts8KWIR5cpACuGapor167adRv5ZLwTchTLJO-VX5V-yFYbEa5IxdV3mOXuTzK4i-_BjTIUMk0Ypwc Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 62b8092f95334c3181e1703fd8d161fb Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-96863184 Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_62b8092f95334c3181e1703fd8d161fb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/62b8092f95334c3181e1703fd8d161fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/62b8092f95334c3181e1703fd8d161fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/62b8092f95334c3181e1703fd8d161fb"}]}] Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-96863184 Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 62b8092f95334c3181e1703fd8d161fb Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-96863184 Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerRescueTestJSONUnderV235-96863184-project Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 3cf02e28f0ec45ae86d4725e4abe49fa Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-96863184-project Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1165381069", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "B6^=m&yintTgu0l", "networks": [{"uuid": "9e32d24b-d5bc-4229-a75e-1999f71b4a0c"}]}} Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueTestJSONUnderV235-server-1165381069', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'B6^=m&yintTgu0l', 'networks': [{'uuid': '9e32d24b-d5bc-4229-a75e-1999f71b4a0c'}]}}} Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:46:11.269655 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-71675f19-0125-4c18-92bb-1d515b8de9fb) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:11.279696 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-194e5d48-86b8-40c0-a3be-db5b83fe2ad7 tempest-ServerRescueTestJSONUnderV235-96863184 tempest-ServerRescueTestJSONUnderV235-96863184-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-194e5d48-86b8-40c0-a3be-db5b83fe2ad7 tempest-ServerRescueTestJSONUnderV235-96863184 tempest-ServerRescueTestJSONUnderV235-96863184-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.456923 Oct 04 20:46:11.292693 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 823/1647] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:46:08 2022] POST /compute/v2.1/servers => generated 214 bytes in 2465 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:46:12.183256 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-44237f59-645f-48ec-b90d-2a75a06f4bbe tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Action: 'create', calling method: .version_select at 0x7f77f73f6820>, body: {"keypair": {"name": "tempest-keypair-1388341529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+0J7oYcLPGI+e0NYRnRGw9EwTWrSkrZVmbgGLQgXkQQA6dlSNzB+rlA3q2bpH1lohLYW4xLUTrJpOrB9oYV1nDt1L4kLW4ufrRmnLh2HI/P9kroLS96zAQ939LUKLPlg=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:12.274926 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-44237f59-645f-48ec-b90d-2a75a06f4bbe tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Getting quotas for project 20a4ff06d4d748a7af1b5daf97fd6b39. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:12.298305 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-44237f59-645f-48ec-b90d-2a75a06f4bbe tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Getting quotas for user 2ba96f867da3438b9215039add0f4496 and project 20a4ff06d4d748a7af1b5daf97fd6b39. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:12.499441 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-44237f59-645f-48ec-b90d-2a75a06f4bbe tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.215385 Oct 04 20:46:12.500955 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 824/1648] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 4 20:46:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1219 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:46:13.281412 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d75891e0-1a4c-4824-b3df-0a07cde63f45 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:13.332362 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d75891e0-1a4c-4824-b3df-0a07cde63f45 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1472 microversion: 2.1 time: 2.354145 Oct 04 20:46:13.349652 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 825/1649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:10 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1472 bytes in 2373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:14.404833 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cc530982-e1bc-4306-945a-3e68c0a1b8ba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:14.404833 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-cc530982-e1bc-4306-945a-3e68c0a1b8ba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:14.442146 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cc530982-e1bc-4306-945a-3e68c0a1b8ba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:14.443404 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cc530982-e1bc-4306-945a-3e68c0a1b8ba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:14.444218 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cc530982-e1bc-4306-945a-3e68c0a1b8ba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:14.445674 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cc530982-e1bc-4306-945a-3e68c0a1b8ba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:14.446949 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cc530982-e1bc-4306-945a-3e68c0a1b8ba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:14.448089 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-cc530982-e1bc-4306-945a-3e68c0a1b8ba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:17.742000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-cc530982-e1bc-4306-945a-3e68c0a1b8ba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:17.775256 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cc530982-e1bc-4306-945a-3e68c0a1b8ba tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1472 microversion: 2.1 time: 3.386383 Oct 04 20:46:17.779826 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 825/1650] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:14 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1472 bytes in 3392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:18.313982 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-9bcc23de-c870-4d16-8a0a-ba08250b3aa4 req-146a79d2-a858-4d48-a1e4-2d4442008ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568cbe45-b90d-49d4-8ed6-90923e399d49", "name": "network-vif-deleted", "tag": "46ab96a5-0e71-4267-bb4f-54da94372f8e"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:18.360620 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-9bcc23de-c870-4d16-8a0a-ba08250b3aa4 req-146a79d2-a858-4d48-a1e4-2d4442008ae1 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:18.374629 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-9bcc23de-c870-4d16-8a0a-ba08250b3aa4 req-146a79d2-a858-4d48-a1e4-2d4442008ae1 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:18.378316 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-9bcc23de-c870-4d16-8a0a-ba08250b3aa4 req-146a79d2-a858-4d48-a1e4-2d4442008ae1 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:18.445768 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-9bcc23de-c870-4d16-8a0a-ba08250b3aa4 req-146a79d2-a858-4d48-a1e4-2d4442008ae1 service nova] Creating event network-vif-deleted:46ab96a5-0e71-4267-bb4f-54da94372f8e for instance 568cbe45-b90d-49d4-8ed6-90923e399d49 on n-h2-852085-12 Oct 04 20:46:18.464989 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-9bcc23de-c870-4d16-8a0a-ba08250b3aa4 req-146a79d2-a858-4d48-a1e4-2d4442008ae1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156449 Oct 04 20:46:18.467568 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 826/1651] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:18.835427 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6202f562-22aa-44ac-a64a-164a6dcba37c tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:18.840580 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-6202f562-22aa-44ac-a64a-164a6dcba37c tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:18.870297 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6202f562-22aa-44ac-a64a-164a6dcba37c tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:18.871992 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6202f562-22aa-44ac-a64a-164a6dcba37c tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:18.873507 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6202f562-22aa-44ac-a64a-164a6dcba37c tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:18.875867 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6202f562-22aa-44ac-a64a-164a6dcba37c tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:18.877689 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6202f562-22aa-44ac-a64a-164a6dcba37c tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:18.878847 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6202f562-22aa-44ac-a64a-164a6dcba37c tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:19.259551 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-6202f562-22aa-44ac-a64a-164a6dcba37c tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:19.281580 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6202f562-22aa-44ac-a64a-164a6dcba37c tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1302 microversion: 2.1 time: 0.457074 Oct 04 20:46:19.284076 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 826/1652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:18 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1302 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:20.003220 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-deb51839-a798-4071-88f8-727e3251c465 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.032339 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-deb51839-a798-4071-88f8-727e3251c465 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.448446 Oct 04 20:46:20.046722 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 827/1653] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:46:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:20.063287 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dd79997a-f21b-45bd-9f0b-cc060a272d50 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.159366 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-dd79997a-f21b-45bd-9f0b-cc060a272d50 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.102971 Oct 04 20:46:20.176930 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 827/1654] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:20.193122 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b7d1a365-c3ad-4855-beec-8345580b18ac tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.217483 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b7d1a365-c3ad-4855-beec-8345580b18ac tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032037 Oct 04 20:46:20.232982 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 828/1655] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:20.247615 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-973737fe-0828-4a53-9571-7c2961cfca6b tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.276377 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-973737fe-0828-4a53-9571-7c2961cfca6b tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035723 Oct 04 20:46:20.302694 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 828/1656] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:20.304611 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-41bfd526-1d47-49a7-95be-5c9b620ecdef tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.329704 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.332848 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:20.362748 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.368109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.369470 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:20.371219 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.375431 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.379048 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:20.440381 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-41bfd526-1d47-49a7-95be-5c9b620ecdef tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.145680 Oct 04 20:46:20.463872 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 829/1657] 10.222.0.78 () {58 vars in 1165 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:20.515241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1e64a5f2-dd6f-495c-bde0-9a9b6e39653c tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.546961 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1e64a5f2-dd6f-495c-bde0-9a9b6e39653c tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.059928 Oct 04 20:46:20.562842 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 830/1658] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:20.581669 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8104b7d7-62b3-4ff2-8efe-77533a577513 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.589087 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.590422 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.591284 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:20.596387 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lazy-loading 'fault' on Instance uuid 568cbe45-b90d-49d4-8ed6-90923e399d49 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:46:20.670728 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8104b7d7-62b3-4ff2-8efe-77533a577513 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.103607 Oct 04 20:46:20.671902 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 831/1659] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:20.708506 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-593c7a82-8f30-4149-be36-2ee4d8c87069 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.740053 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-593c7a82-8f30-4149-be36-2ee4d8c87069 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.040084 Oct 04 20:46:20.745877 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 832/1660] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:46:20.768111 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4c9767ab-10a7-49be-89e1-7c4892853488 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.787106 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4c9767ab-10a7-49be-89e1-7c4892853488 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026718 Oct 04 20:46:20.801823 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 833/1661] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:46:20.813238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-19beeb94-6965-4888-85a3-260a7346a700 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.905954 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-19beeb94-6965-4888-85a3-260a7346a700 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.101562 Oct 04 20:46:20.919749 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 834/1662] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:20.941924 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8ac39ccd-c995-4eef-a96a-5955150deddf tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.958307 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8ac39ccd-c995-4eef-a96a-5955150deddf tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024583 Oct 04 20:46:20.964144 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 835/1663] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:20.982623 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bd348354-e03a-4b99-8e3a-03a496e13985 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:21.038778 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bd348354-e03a-4b99-8e3a-03a496e13985 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.063864 Oct 04 20:46:21.061861 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 836/1664] 10.222.0.78 () {58 vars in 1144 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:21.075483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-61fe0a5f-7198-4e07-be4e-2ee1bf45eaa1 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:21.092043 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-61fe0a5f-7198-4e07-be4e-2ee1bf45eaa1 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027122 Oct 04 20:46:21.094388 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 837/1665] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:46:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:21.117618 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-11b27e6f-1ec2-491f-91e1-1fe3938dc766 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:21.159015 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-11b27e6f-1ec2-491f-91e1-1fe3938dc766 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.049565 Oct 04 20:46:21.173325 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 838/1666] 10.222.0.78 () {58 vars in 1148 bytes} [Tue Oct 4 20:46:21 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:21.211337 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-189ab664-fccc-4acc-ac15-d9b32184373d tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:21.266096 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-189ab664-fccc-4acc-ac15-d9b32184373d tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.079594 Oct 04 20:46:21.273373 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 839/1667] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Oct 4 20:46:21 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:21.299663 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-65a7d1f3-cab7-4520-b6de-959a3ad15d0c tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:21.322537 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-65a7d1f3-cab7-4520-b6de-959a3ad15d0c tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032619 Oct 04 20:46:21.324928 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 840/1668] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:46:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:21.363946 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e476c1b6-c515-4413-9c4e-ff99b5535df8 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:21.469642 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e476c1b6-c515-4413-9c4e-ff99b5535df8 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.125490 Oct 04 20:46:21.483188 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 841/1669] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:46:21 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:21.508821 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-82f9573e-9edd-4c9a-9f7e-1f3d5418170f tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:21.538021 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7677d259d034a68aaba770506475f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa9bc0601f141e48e1b5f001769d221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:21.584782 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c39460fd-2e1b-44ff-affe-5db378feebd8 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 200 len: 1307 microversion: 2.1 time: 1.263321 Oct 04 20:46:21.595497 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 829/1670] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 1307 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:21.636544 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-82f9573e-9edd-4c9a-9f7e-1f3d5418170f tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.137211 Oct 04 20:46:21.641747 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 842/1671] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:46:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:21.691337 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0a680b90-f7c5-4ccb-9cf1-2ae8bfda45f5 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:21.714805 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0a680b90-f7c5-4ccb-9cf1-2ae8bfda45f5 tempest-FlavorsV2TestJSON-202799836 tempest-FlavorsV2TestJSON-202799836-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032263 Oct 04 20:46:21.728787 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 830/1672] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:46:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:22.653620 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-60d43c44-ee20-4e71-a6de-0e8e750e0048 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:22.658140 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-60d43c44-ee20-4e71-a6de-0e8e750e0048 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] [instance: 568cbe45-b90d-49d4-8ed6-90923e399d49] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:22.683127 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-60d43c44-ee20-4e71-a6de-0e8e750e0048 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:22.684560 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-60d43c44-ee20-4e71-a6de-0e8e750e0048 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:22.687267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-60d43c44-ee20-4e71-a6de-0e8e750e0048 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:22.687267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-60d43c44-ee20-4e71-a6de-0e8e750e0048 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:22.690875 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-60d43c44-ee20-4e71-a6de-0e8e750e0048 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:22.695018 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-60d43c44-ee20-4e71-a6de-0e8e750e0048 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:22.768403 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-60d43c44-ee20-4e71-a6de-0e8e750e0048 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] HTTP exception thrown: Instance 568cbe45-b90d-49d4-8ed6-90923e399d49 could not be found. Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-60d43c44-ee20-4e71-a6de-0e8e750e0048 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Request method failure captured: Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 HTTP/1.1 Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJrHiaQDUDmcCXWfUUHPwiZ9e31Meb32b3xF1XIQ2bwIqaNBM4oWnZP-_PqR516iLwYk2vk49vaOjh6FVl2wRovEiItFDS1eCtqUzAv4Pa5NJX6MymczXGbPhGD-7N81bMGXRUA1AusWqRilOAIpf5TYM5f6BDuHHsCwsbpC_oiMrK8 Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: baa9bc0601f141e48e1b5f001769d221 Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesOneServerTestJSON-2098750367 Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_baa9bc0601f141e48e1b5f001769d221", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/baa9bc0601f141e48e1b5f001769d221"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/baa9bc0601f141e48e1b5f001769d221"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/baa9bc0601f141e48e1b5f001769d221"}]}] Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesOneServerTestJSON-2098750367 Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: baa9bc0601f141e48e1b5f001769d221 Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2098750367 Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesOneServerTestJSON-2098750367-project Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: c7677d259d034a68aaba770506475f73 Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesOneServerTestJSON-2098750367-project Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 568cbe45-b90d-49d4-8ed6-90923e399d49 could not be found. Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '568cbe45-b90d-49d4-8ed6-90923e399d49'} Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 568cbe45-b90d-49d4-8ed6-90923e399d49 could not be found. Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 568cbe45-b90d-49d4-8ed6-90923e399d49 could not be found. Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:22.772808 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:22.781820 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:22.781820 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:22.781820 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:22.781820 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:22.781820 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:22.781820 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 568cbe45-b90d-49d4-8ed6-90923e399d49 could not be found. Oct 04 20:46:22.781820 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:22.781820 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-60d43c44-ee20-4e71-a6de-0e8e750e0048 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] Returning 404 to user: Instance 568cbe45-b90d-49d4-8ed6-90923e399d49 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:22.783900 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-60d43c44-ee20-4e71-a6de-0e8e750e0048 tempest-ImagesOneServerTestJSON-2098750367 tempest-ImagesOneServerTestJSON-2098750367-project] 10.222.0.78 "GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49" status: 404 len: 111 microversion: 2.1 time: 0.136047 Oct 04 20:46:22.785026 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 843/1673] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:22 2022] GET /compute/v2.1/servers/568cbe45-b90d-49d4-8ed6-90923e399d49 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:46:29.556318 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6fb401cf-c266-49fb-bbfb-24a0ea8d086e tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-354029728", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "becb2bb8-4aa1-4ce8-843c-ef0a82d766a9"}], "security_groups": [{"name": "tempest-securitygroup--286793502"}], "key_name": "tempest-keypair-1388341529", "user_data": "}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:29.615797 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:29.617829 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:30.316986 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-6fb401cf-c266-49fb-bbfb-24a0ea8d086e tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] validate_networks() for [('becb2bb8-4aa1-4ce8-843c-ef0a82d766a9', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-6fb401cf-c266-49fb-bbfb-24a0ea8d086e tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-526df826-b3e2-4760-9eb7-a46800409e86) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:46:31.407314 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-526df826-b3e2-4760-9eb7-a46800409e86) Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-6fb401cf-c266-49fb-bbfb-24a0ea8d086e tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6fb401cf-c266-49fb-bbfb-24a0ea8d086e tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Request method failure captured: Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 490 Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJuSBdMtfOPl72E6oatxN6yPoZEvXEf5lqTTGV97KwlxOvljBtWRzTCZPJ6EfP-wbxHDxvELkw-bt2nKTMb9NNux1wi4SIM6DoKBtARZumIHAjsSP4vhcPUbz6QAcZnPsexmlpKt70PyttIZI4lA7LePkb-aEZlQbNsZ5ik7Zu_2G3Y Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 20a4ff06d4d748a7af1b5daf97fd6b39 Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-635005537 Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_20a4ff06d4d748a7af1b5daf97fd6b39", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/20a4ff06d4d748a7af1b5daf97fd6b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/20a4ff06d4d748a7af1b5daf97fd6b39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/20a4ff06d4d748a7af1b5daf97fd6b39"}]}] Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-635005537 Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 20a4ff06d4d748a7af1b5daf97fd6b39 Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-635005537 Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AttachVolumeShelveTestJSON-635005537-project Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 2ba96f867da3438b9215039add0f4496 Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-635005537-project Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-354029728", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "becb2bb8-4aa1-4ce8-843c-ef0a82d766a9"}], "security_groups": [{"name": "tempest-securitygroup--286793502"}], "key_name": "tempest-keypair-1388341529", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:46:31.416709 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeShelveTestJSON-server-354029728', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'becb2bb8-4aa1-4ce8-843c-ef0a82d766a9'}], 'security_groups': [{'name': 'tempest-securitygroup--286793502'}], 'key_name': 'tempest-keypair-1388341529', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:46:31.435069 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-526df826-b3e2-4760-9eb7-a46800409e86) Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6fb401cf-c266-49fb-bbfb-24a0ea8d086e tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6fb401cf-c266-49fb-bbfb-24a0ea8d086e tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.20 time: 1.874410 Oct 04 20:46:31.453172 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 831/1674] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:46:29 2022] POST /compute/v2.1/servers => generated 214 bytes in 1878 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 04 20:46:31.468590 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-29195a72-4b5b-4128-a5f4-429fcde2168a tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Calling method '.version_select at 0x7f77eefcaca0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:31.493663 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=47 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:31.647753 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-29195a72-4b5b-4128-a5f4-429fcde2168a tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388341529" status: 204 len: 0 microversion: 2.20 time: 0.200749 Oct 04 20:46:31.656693 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 844/1675] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:46:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388341529 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:46:33.974312 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:35.107781 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=18 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:35.550301 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-59a35fd4-54c4-47aa-aeee-18e03136b26d tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] Calling method '.version_select at 0x7f77f74c5c10>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:35.650163 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59a35fd4-54c4-47aa-aeee-18e03136b26d tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.657981 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59a35fd4-54c4-47aa-aeee-18e03136b26d tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.659433 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59a35fd4-54c4-47aa-aeee-18e03136b26d tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.664677 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59a35fd4-54c4-47aa-aeee-18e03136b26d tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.669575 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59a35fd4-54c4-47aa-aeee-18e03136b26d tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.673059 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-59a35fd4-54c4-47aa-aeee-18e03136b26d tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.794465 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1046681296", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": "none"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:35.835341 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-59a35fd4-54c4-47aa-aeee-18e03136b26d tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] 10.222.0.78 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 1.862067 Oct 04 20:46:35.853562 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 832/1676] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:33 2022] GET /compute/v2.1/limits => generated 511 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:36.003796 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3bfc670b-e63d-4b65-8e04-00ee5c9bf22b tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1128108489", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:36.910097 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-3bfc670b-e63d-4b65-8e04-00ee5c9bf22b tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:46:36.924233 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:46:36.925048 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:46:36.925917 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:46:36.926680 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:46:36.952668 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:46:37.010210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.013163 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.014902 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.021409 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.025532 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.027587 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.116177 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Getting quotas for project 0bda882a4cd446619c42073bf0aec919. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:37.131099 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Getting quotas for user 06009ef2882e401f82f8858e5b816f4a and project 0bda882a4cd446619c42073bf0aec919. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:37.169463 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:46:37.177802 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 9019f887-5690-4833-b69b-879c91f3e6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:46:37.475095 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d14087fa-26f4-4466-9280-5bc673b53812 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 2.369814 Oct 04 20:46:37.481622 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 845/1677] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:46:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2379 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:46:37.504839 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1f71e165-0aec-487d-90ec-5849c493712c tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Calling method '.version_select at 0x7f77eefd51f0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:37.669452 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1f71e165-0aec-487d-90ec-5849c493712c tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1" status: 200 len: 636 microversion: 2.1 time: 0.159296 Oct 04 20:46:37.676879 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 846/1678] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:37 2022] GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1 => generated 636 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:37.700400 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fad34191-9166-4eb0-865e-23d55774205e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:37.704692 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-fad34191-9166-4eb0-865e-23d55774205e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 9019f887-5690-4833-b69b-879c91f3e6c1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:37.831508 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-3bfc670b-e63d-4b65-8e04-00ee5c9bf22b tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] Getting quotas for project e82f7c37d2584e16b55273fcd62d6cb2. Resources: dict_keys(['metadata_items']) {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:37.869350 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-3bfc670b-e63d-4b65-8e04-00ee5c9bf22b tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] Getting quotas for user 9230cf6673344abc861153e01ab4da92 and project e82f7c37d2584e16b55273fcd62d6cb2. Resources: dict_keys(['metadata_items']) {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:37.930942 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-3bfc670b-e63d-4b65-8e04-00ee5c9bf22b tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 04 20:46:37.942278 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-fad34191-9166-4eb0-865e-23d55774205e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3bfc670b-e63d-4b65-8e04-00ee5c9bf22b tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] Request method failure captured: Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 1752 Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJupNSUvBOTK-sYcI1DwM0CLFT6cK_clcGsYA4KFL1OQh8q9fiUkMzRjXwUW2VrWDrF9xWNCbyTmU1CfHMelqwICekEVByGW0_heyZk7AXh3S_oWDwKHQzNw88NPbH3K2x3F93C4HxhtiyqRGlIMSKcYp20NyJz5gM_4Eyb0sBDJ7VQ Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: e82f7c37d2584e16b55273fcd62d6cb2 Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-351205928 Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e82f7c37d2584e16b55273fcd62d6cb2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e82f7c37d2584e16b55273fcd62d6cb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e82f7c37d2584e16b55273fcd62d6cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e82f7c37d2584e16b55273fcd62d6cb2"}]}] Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-351205928 Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: e82f7c37d2584e16b55273fcd62d6cb2 Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-351205928 Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-351205928-project Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 9230cf6673344abc861153e01ab4da92 Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-351205928-project Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1128108489", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:46:37.954959 n-d-852085-12 devstack@n-api.service[123540]: exception: Maximum number of metadata items exceeds 128 Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1128108489', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:37.959178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 04 20:46:37.970512 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:37.979880 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3bfc670b-e63d-4b65-8e04-00ee5c9bf22b tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:37.985215 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3bfc670b-e63d-4b65-8e04-00ee5c9bf22b tempest-AbsoluteLimitsNegativeTestJSON-351205928 tempest-AbsoluteLimitsNegativeTestJSON-351205928-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.989668 Oct 04 20:46:37.985648 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 833/1679] 10.222.0.78 () {60 vars in 1148 bytes} [Tue Oct 4 20:46:35 2022] POST /compute/v2.1/servers => generated 87 bytes in 1992 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:46:37.998361 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-46018998-9f36-4e83-8662-03248e70fe02 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Action: 'update_all', calling method: .version_select at 0x7f77f74c5430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:38.008632 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-fad34191-9166-4eb0-865e-23d55774205e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:38.025064 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-fad34191-9166-4eb0-865e-23d55774205e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:38.028009 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fad34191-9166-4eb0-865e-23d55774205e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1" status: 200 len: 1278 microversion: 2.47 time: 0.348597 Oct 04 20:46:38.029202 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 847/1680] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:37 2022] GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1 => generated 1278 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:38.181112 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-46018998-9f36-4e83-8662-03248e70fe02 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:38.193108 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-46018998-9f36-4e83-8662-03248e70fe02 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for user 012d4505c0a74ee286d4359926302d68 and project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:38.652082 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1550888068", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": "none"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:38.900701 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:46:38.900701 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:46:38.901968 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:46:38.905492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:46:38.914008 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:46:38.965261 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.972917 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.975688 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.983435 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.986913 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.988484 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:39.043417 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Getting quotas for project 0bda882a4cd446619c42073bf0aec919. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:39.072598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Getting quotas for user 06009ef2882e401f82f8858e5b816f4a and project 0bda882a4cd446619c42073bf0aec919. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:39.135869 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:46:39.146740 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:46:39.428766 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-46018998-9f36-4e83-8662-03248e70fe02 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 61 microversion: 2.1 time: 1.441190 Oct 04 20:46:39.439390 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 834/1681] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:46:37 2022] PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 61 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:39.457174 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-be4528a8-d000-409b-88c2-6b87464d1e1e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.819778 Oct 04 20:46:39.459087 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 848/1682] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:46:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 20:46:39.472377 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2b68e44f-1150-43ca-8986-3ef3ada8c1a1 tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Action: 'create', calling method: .version_select at 0x7f77eec90dc0>, body: {"keypair": {"name": "tempest-keypair-540237634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhjl6yQxhssl4M8UA7VpMYr6HagYzbCOHVr5v1Vsg45mNTy+chAonFKPDDFdmAYwSqhAr1pLPDQSsxcwiwBgDpI3itlTSAkCiw/11C5j7zcCCPsWCuCf2KR3eKt691FtQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:39.474849 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5971d743-db74-450c-b708-ebbc281cc949 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Calling method '.version_select at 0x7f77ef13a8b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:39.557968 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-2b68e44f-1150-43ca-8986-3ef3ada8c1a1 tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Getting quotas for project 20a4ff06d4d748a7af1b5daf97fd6b39. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:39.570611 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-2b68e44f-1150-43ca-8986-3ef3ada8c1a1 tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Getting quotas for user 2ba96f867da3438b9215039add0f4496 and project 20a4ff06d4d748a7af1b5daf97fd6b39. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:39.848304 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2b68e44f-1150-43ca-8986-3ef3ada8c1a1 tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.415771 Oct 04 20:46:39.849555 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 835/1683] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 4 20:46:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 419 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:46:39.895835 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-486239f7-bba3-4839-8a7b-fe0ab3ba467d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:39.927411 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-486239f7-bba3-4839-8a7b-fe0ab3ba467d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:40.084277 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-486239f7-bba3-4839-8a7b-fe0ab3ba467d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "PUT /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 992 microversion: 2.47 time: 0.232445 Oct 04 20:46:40.085899 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 836/1684] 10.222.0.78 () {62 vars in 1297 bytes} [Tue Oct 4 20:46:39 2022] PUT /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 992 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:46:40.126687 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-edc89dbd-3b3c-4c76-b3e7-eae91205edf2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:40.130953 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-edc89dbd-3b3c-4c76-b3e7-eae91205edf2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:40.378995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-edc89dbd-3b3c-4c76-b3e7-eae91205edf2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:40.422226 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-edc89dbd-3b3c-4c76-b3e7-eae91205edf2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:40.427033 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-edc89dbd-3b3c-4c76-b3e7-eae91205edf2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:40.438389 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-edc89dbd-3b3c-4c76-b3e7-eae91205edf2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1278 microversion: 2.47 time: 0.318553 Oct 04 20:46:40.445298 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 837/1685] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:40 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1278 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:40.507912 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5971d743-db74-450c-b708-ebbc281cc949 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "DELETE /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 1.036894 Oct 04 20:46:40.512672 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 849/1686] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Oct 4 20:46:39 2022] DELETE /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata/os_version => generated 0 bytes in 1053 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:46:40.529889 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b8357f93-3fdc-464c-8e76-9c4076a0fb63 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Calling method '.version_select at 0x7f77f73f6ca0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:40.686451 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b8357f93-3fdc-464c-8e76-9c4076a0fb63 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 37 microversion: 2.1 time: 0.165849 Oct 04 20:46:40.697287 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 838/1687] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:46:40 2022] GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 37 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:40.708874 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c80cd32f-44ad-41bd-9981-9634fdad730a tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Action: 'update_all', calling method: .version_select at 0x7f77eee763a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:40.915098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-c80cd32f-44ad-41bd-9981-9634fdad730a tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:40.935977 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-c80cd32f-44ad-41bd-9981-9634fdad730a tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for user 012d4505c0a74ee286d4359926302d68 and project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:41.525633 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-504f3109-d3cd-4241-9e29-5af28fe9a626 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:41.532493 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-504f3109-d3cd-4241-9e29-5af28fe9a626 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:41.978542 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-504f3109-d3cd-4241-9e29-5af28fe9a626 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:42.010246 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-504f3109-d3cd-4241-9e29-5af28fe9a626 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:42.015277 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-504f3109-d3cd-4241-9e29-5af28fe9a626 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:42.018458 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-504f3109-d3cd-4241-9e29-5af28fe9a626 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1278 microversion: 2.47 time: 0.510809 Oct 04 20:46:42.021515 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 839/1688] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:41 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1278 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:42.214697 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c80cd32f-44ad-41bd-9981-9634fdad730a tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 61 microversion: 2.1 time: 1.509149 Oct 04 20:46:42.225386 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 850/1689] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:46:40 2022] PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 61 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:42.274317 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-69e1e967-8074-481a-a6bc-19a3ce27ed78 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Calling method '.version_select at 0x7f77ef6b9c10>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:42.387243 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-69e1e967-8074-481a-a6bc-19a3ce27ed78 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.157157 Oct 04 20:46:42.388323 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 851/1690] 10.222.0.78 () {58 vars in 1290 bytes} [Tue Oct 4 20:46:42 2022] GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata/os_distro => generated 33 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:42.410065 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-14febf64-f193-4b7f-8450-3c79bc5035ba tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Action: 'update_all', calling method: .version_select at 0x7f77eefca040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:42.509593 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-14febf64-f193-4b7f-8450-3c79bc5035ba tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:42.523301 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-14febf64-f193-4b7f-8450-3c79bc5035ba tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for user 012d4505c0a74ee286d4359926302d68 and project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:42.548648 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9f513f81-e9d9-485f-bec3-97b2157a9dfe tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1654987639", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "f901d054-56d5-4cbc-a133-05325e8ffd94"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:42.855448 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-9f513f81-e9d9-485f-bec3-97b2157a9dfe tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] validate_networks() for [('f901d054-56d5-4cbc-a133-05325e8ffd94', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:46:43.284400 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-14febf64-f193-4b7f-8450-3c79bc5035ba tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.882135 Oct 04 20:46:43.288824 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 852/1691] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:46:42 2022] PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 61 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:43.315483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3b3c53c0-0499-4862-924a-c03f1bded7fe tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:43.324656 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3b3c53c0-0499-4862-924a-c03f1bded7fe tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:43.673119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3b3c53c0-0499-4862-924a-c03f1bded7fe tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-9f513f81-e9d9-485f-bec3-97b2157a9dfe tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fcac8481-ac51-4533-95c7-73f6c66b0c44) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:46:43.692333 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fcac8481-ac51-4533-95c7-73f6c66b0c44) Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-9f513f81-e9d9-485f-bec3-97b2157a9dfe tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:43.710279 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:43.720974 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3b3c53c0-0499-4862-924a-c03f1bded7fe tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:43.720974 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3b3c53c0-0499-4862-924a-c03f1bded7fe tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9f513f81-e9d9-485f-bec3-97b2157a9dfe tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Request method failure captured: Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 208 Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJuxTAY80fNYlEcFBRly4FvDYoECRq8GuLgLpm2hpiD3o8NXdjC3eo3BDcioubUmPIEfhON2nNX3W2elmnMyuV7pCvJW_Qk45lLUdNF4MR6ZX7B4ZKboVxlQEHTTZ9yRbecXSlfxuYh14eM-n-IiCF-XCB5KYp8CLowgfl1247aux6Y Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 0320ad4639f0459295c6b219ed5668c8 Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ImagesNegativeTestJSON-494549152 Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0320ad4639f0459295c6b219ed5668c8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0320ad4639f0459295c6b219ed5668c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0320ad4639f0459295c6b219ed5668c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0320ad4639f0459295c6b219ed5668c8"}]}] Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ImagesNegativeTestJSON-494549152 Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 0320ad4639f0459295c6b219ed5668c8 Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-494549152 Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ImagesNegativeTestJSON-494549152-project Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: fd92f4e1d7e44ef0b5d4ea851149e117 Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ImagesNegativeTestJSON-494549152-project Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1654987639", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "f901d054-56d5-4cbc-a133-05325e8ffd94"}]}} Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ImagesNegativeTestJSON-server-1654987639', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'f901d054-56d5-4cbc-a133-05325e8ffd94'}]}}} Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:46:43.722390 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fcac8481-ac51-4533-95c7-73f6c66b0c44) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:46:43.754433 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9f513f81-e9d9-485f-bec3-97b2157a9dfe tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9f513f81-e9d9-485f-bec3-97b2157a9dfe tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.538917 Oct 04 20:46:43.776059 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 840/1692] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:46:42 2022] POST /compute/v2.1/servers => generated 214 bytes in 1544 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:46:43.781940 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3b3c53c0-0499-4862-924a-c03f1bded7fe tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1278 microversion: 2.47 time: 0.436177 Oct 04 20:46:43.781940 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 853/1693] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:43 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1278 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:43.783307 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0bf675d2-183c-46e8-aebb-fa7a652ad139 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Calling method '.version_select at 0x7f77f7331940>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:43.907816 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0bf675d2-183c-46e8-aebb-fa7a652ad139 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.190047 Oct 04 20:46:43.910310 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 841/1694] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:46:43 2022] GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 61 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a50dcc9e-a568-4acd-98b0-ba8fce4ce40c tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2015136787", "metadata": {"image_type": "test"}}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a50dcc9e-a568-4acd-98b0-ba8fce4ce40c tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Failed to fetch instance by id tempest-invalid-1802307124 {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-a50dcc9e-a568-4acd-98b0-ba8fce4ce40c tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] HTTP exception thrown: Instance tempest-invalid-1802307124 could not be found. Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a50dcc9e-a568-4acd-98b0-ba8fce4ce40c tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Request method failure captured: Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers/tempest-invalid-1802307124/action HTTP/1.1 Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 112 Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJuxTAY80fNYlEcFBRly4FvDYoECRq8GuLgLpm2hpiD3o8NXdjC3eo3BDcioubUmPIEfhON2nNX3W2elmnMyuV7pCvJW_Qk45lLUdNF4MR6ZX7B4ZKboVxlQEHTTZ9yRbecXSlfxuYh14eM-n-IiCF-XCB5KYp8CLowgfl1247aux6Y Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 0320ad4639f0459295c6b219ed5668c8 Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ImagesNegativeTestJSON-494549152 Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0320ad4639f0459295c6b219ed5668c8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0320ad4639f0459295c6b219ed5668c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0320ad4639f0459295c6b219ed5668c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0320ad4639f0459295c6b219ed5668c8"}]}] Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ImagesNegativeTestJSON-494549152 Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 0320ad4639f0459295c6b219ed5668c8 Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-494549152 Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ImagesNegativeTestJSON-494549152-project Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: fd92f4e1d7e44ef0b5d4ea851149e117 Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ImagesNegativeTestJSON-494549152-project Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2015136787", "metadata": {"image_type": "test"}}} Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance tempest-invalid-1802307124 could not be found. Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'tempest-invalid-1802307124', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2015136787', 'metadata': {'image_type': 'test'}}}} Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1802307124 could not be found. Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:43.926312 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1802307124 could not be found. Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1802307124 could not be found. Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a50dcc9e-a568-4acd-98b0-ba8fce4ce40c tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Returning 404 to user: Instance tempest-invalid-1802307124 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a50dcc9e-a568-4acd-98b0-ba8fce4ce40c tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] 10.222.0.78 "POST /compute/v2.1/servers/tempest-invalid-1802307124/action" status: 404 len: 101 microversion: 2.1 time: 0.011074 Oct 04 20:46:43.934038 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 842/1695] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:46:43 2022] POST /compute/v2.1/servers/tempest-invalid-1802307124/action => generated 101 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:46:43.937400 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9ced8ce2-3035-40e0-b03b-74f24c1458fa tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Action: 'update_all', calling method: .version_select at 0x7f77eec97550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:44.044473 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-9ced8ce2-3035-40e0-b03b-74f24c1458fa tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:44.060254 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-9ced8ce2-3035-40e0-b03b-74f24c1458fa tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for user 012d4505c0a74ee286d4359926302d68 and project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:44.349287 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1472400736", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": "none"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:44.583231 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:46:44.584019 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:46:44.584927 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:46:44.585692 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:46:44.586463 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:46:44.635342 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.636233 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.637060 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.638613 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.639430 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.640232 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.666648 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9ced8ce2-3035-40e0-b03b-74f24c1458fa tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.737346 Oct 04 20:46:44.675319 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 843/1696] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:46:43 2022] PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 61 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:46:44.680980 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5eecfacf-9179-42c2-ad41-d08722dec1dc tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-725098426"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:44.697343 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-5eecfacf-9179-42c2-ad41-d08722dec1dc tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:46:44.698440 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-5eecfacf-9179-42c2-ad41-d08722dec1dc tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5eecfacf-9179-42c2-ad41-d08722dec1dc tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Request method failure captured: Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 56 Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJuxTAY80fNYlEcFBRly4FvDYoECRq8GuLgLpm2hpiD3o8NXdjC3eo3BDcioubUmPIEfhON2nNX3W2elmnMyuV7pCvJW_Qk45lLUdNF4MR6ZX7B4ZKboVxlQEHTTZ9yRbecXSlfxuYh14eM-n-IiCF-XCB5KYp8CLowgfl1247aux6Y Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 0320ad4639f0459295c6b219ed5668c8 Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ImagesNegativeTestJSON-494549152 Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0320ad4639f0459295c6b219ed5668c8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0320ad4639f0459295c6b219ed5668c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0320ad4639f0459295c6b219ed5668c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0320ad4639f0459295c6b219ed5668c8"}]}] Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ImagesNegativeTestJSON-494549152 Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 0320ad4639f0459295c6b219ed5668c8 Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-494549152 Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ImagesNegativeTestJSON-494549152-project Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: fd92f4e1d7e44ef0b5d4ea851149e117 Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ImagesNegativeTestJSON-494549152-project Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: {"createImage": {"name": "tempest-test-snap-725098426"}} Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-725098426'}}} Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:46:44.703870 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:44.711879 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:44.711879 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:44.711879 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:44.711879 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:44.711879 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:44.711879 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:44.711879 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:44.711879 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:46:44.711879 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:44.724791 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5eecfacf-9179-42c2-ad41-d08722dec1dc tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:44.726877 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5eecfacf-9179-42c2-ad41-d08722dec1dc tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] 10.222.0.78 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.056504 Oct 04 20:46:44.736647 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 844/1697] 10.222.0.78 () {60 vars in 1275 bytes} [Tue Oct 4 20:46:44 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:46:44.748662 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-378801ff-31e4-4db8-b988-75d6a30b8e19 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Action: 'update_all', calling method: .version_select at 0x7f77f73e79d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:44.767592 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Getting quotas for project 6eaee4910b0c4b3ba89057bcc76771ff. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:44.813048 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Getting quotas for user 9d65ad24790c45de95ef1e772d24fbe9 and project 6eaee4910b0c4b3ba89057bcc76771ff. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:44.915098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:46:44.920284 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:46:44.947951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-378801ff-31e4-4db8-b988-75d6a30b8e19 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:44.973870 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-378801ff-31e4-4db8-b988-75d6a30b8e19 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for user 012d4505c0a74ee286d4359926302d68 and project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:45.306732 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-38890ef2-8404-496d-8964-fa0a8fbb1bf3 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.574100 Oct 04 20:46:45.308634 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 854/1698] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:46:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:46:45.355826 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fb0b9aa2-0b9f-456f-810b-1903414d0590 tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1597542694"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:45.364353 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-fb0b9aa2-0b9f-456f-810b-1903414d0590 tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:46:45.365839 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-fb0b9aa2-0b9f-456f-810b-1903414d0590 tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fb0b9aa2-0b9f-456f-810b-1903414d0590 tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Request method failure captured: Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 57 Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJuxTAY80fNYlEcFBRly4FvDYoECRq8GuLgLpm2hpiD3o8NXdjC3eo3BDcioubUmPIEfhON2nNX3W2elmnMyuV7pCvJW_Qk45lLUdNF4MR6ZX7B4ZKboVxlQEHTTZ9yRbecXSlfxuYh14eM-n-IiCF-XCB5KYp8CLowgfl1247aux6Y Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 0320ad4639f0459295c6b219ed5668c8 Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesNegativeTestJSON-494549152 Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0320ad4639f0459295c6b219ed5668c8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0320ad4639f0459295c6b219ed5668c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0320ad4639f0459295c6b219ed5668c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0320ad4639f0459295c6b219ed5668c8"}]}] Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesNegativeTestJSON-494549152 Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 0320ad4639f0459295c6b219ed5668c8 Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-494549152 Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesNegativeTestJSON-494549152-project Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: fd92f4e1d7e44ef0b5d4ea851149e117 Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesNegativeTestJSON-494549152-project Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: {"createImage": {"name": "tempest-test-snap-1597542694"}} Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1597542694'}}} Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:46:45.370076 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:45.379515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:45.379515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:45.379515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:45.379515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:45.379515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:45.379515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:45.379515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:45.379515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:46:45.379515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:46:45.393430 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fb0b9aa2-0b9f-456f-810b-1903414d0590 tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:45.393430 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fb0b9aa2-0b9f-456f-810b-1903414d0590 tempest-ImagesNegativeTestJSON-494549152 tempest-ImagesNegativeTestJSON-494549152-project] 10.222.0.78 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.071603 Oct 04 20:46:45.393430 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 855/1699] 10.222.0.78 () {60 vars in 1281 bytes} [Tue Oct 4 20:46:45 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:46:45.397180 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3c64e1a2-1461-4a70-b805-361967deba27 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:45.398811 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3c64e1a2-1461-4a70-b805-361967deba27 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:45.415817 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3c64e1a2-1461-4a70-b805-361967deba27 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:45.416999 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3c64e1a2-1461-4a70-b805-361967deba27 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:45.418148 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3c64e1a2-1461-4a70-b805-361967deba27 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:45.419938 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3c64e1a2-1461-4a70-b805-361967deba27 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:45.421075 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3c64e1a2-1461-4a70-b805-361967deba27 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:45.422080 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3c64e1a2-1461-4a70-b805-361967deba27 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:45.748623 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:45.750069 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:45.829993 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3c64e1a2-1461-4a70-b805-361967deba27 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:45.861761 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3c64e1a2-1461-4a70-b805-361967deba27 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:45.878557 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3c64e1a2-1461-4a70-b805-361967deba27 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:45.881262 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3c64e1a2-1461-4a70-b805-361967deba27 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1330 microversion: 2.47 time: 0.494012 Oct 04 20:46:45.903639 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 856/1700] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:45 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1330 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:45.947925 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-536ff937-ee0d-450f-ad80-3628d61da204 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:45.949408 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-536ff937-ee0d-450f-ad80-3628d61da204 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:46.150454 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-536ff937-ee0d-450f-ad80-3628d61da204 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:46.171162 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-536ff937-ee0d-450f-ad80-3628d61da204 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:46.174960 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-536ff937-ee0d-450f-ad80-3628d61da204 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:46.177355 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-536ff937-ee0d-450f-ad80-3628d61da204 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1281 microversion: 2.47 time: 0.271443 Oct 04 20:46:46.178497 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 857/1701] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:45 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1281 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:46.544643 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-378801ff-31e4-4db8-b988-75d6a30b8e19 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 64 microversion: 2.1 time: 1.814166 Oct 04 20:46:46.546049 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 845/1702] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:46:44 2022] PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 64 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:46.572344 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fc64a72b-b797-46f5-94de-a8150577f01a tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Calling method '.version_select at 0x7f77ef139550>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:46.790545 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fc64a72b-b797-46f5-94de-a8150577f01a tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.229566 Oct 04 20:46:46.793309 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 858/1703] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:46:46 2022] GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 64 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:46:46.812308 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8c46b408-2435-4c2a-a392-5c48d8f5c95c tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Action: 'update_all', calling method: .version_select at 0x7f77eecc1670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:46.944893 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-8c46b408-2435-4c2a-a392-5c48d8f5c95c tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:46.957853 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-8c46b408-2435-4c2a-a392-5c48d8f5c95c tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for user 012d4505c0a74ee286d4359926302d68 and project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:46.959576 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-04b575dd-57be-4651-ba91-32be431b8bc6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:46.960661 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-04b575dd-57be-4651-ba91-32be431b8bc6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:46.978286 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-04b575dd-57be-4651-ba91-32be431b8bc6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:47.013508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-04b575dd-57be-4651-ba91-32be431b8bc6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:47.013508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-04b575dd-57be-4651-ba91-32be431b8bc6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:47.013508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-04b575dd-57be-4651-ba91-32be431b8bc6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:47.013508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-04b575dd-57be-4651-ba91-32be431b8bc6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:47.013508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-04b575dd-57be-4651-ba91-32be431b8bc6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:47.886034 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-04b575dd-57be-4651-ba91-32be431b8bc6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:47.952848 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-04b575dd-57be-4651-ba91-32be431b8bc6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:47.967161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-04b575dd-57be-4651-ba91-32be431b8bc6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:47.985606 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-04b575dd-57be-4651-ba91-32be431b8bc6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1330 microversion: 2.47 time: 1.030020 Oct 04 20:46:47.986742 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 859/1704] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:46 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1330 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:48.046214 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d4c25292-ad30-4ba5-a07e-62573beedaf5 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:48.052449 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d4c25292-ad30-4ba5-a07e-62573beedaf5 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:48.399788 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d4c25292-ad30-4ba5-a07e-62573beedaf5 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:48.475432 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d4c25292-ad30-4ba5-a07e-62573beedaf5 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:48.500521 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d4c25292-ad30-4ba5-a07e-62573beedaf5 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:48.511031 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d4c25292-ad30-4ba5-a07e-62573beedaf5 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1281 microversion: 2.47 time: 0.501501 Oct 04 20:46:48.515446 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 860/1705] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:47 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1281 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:48.590054 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8c46b408-2435-4c2a-a392-5c48d8f5c95c tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 61 microversion: 2.1 time: 1.785836 Oct 04 20:46:48.596048 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 846/1706] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:46:46 2022] PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 61 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:48.614905 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-922b5daa-d0a7-41bd-b587-8d2eb8fe191d tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Action: 'update', calling method: .version_select at 0x7f77ef1393a0>, body: {"meta": {"os_version": "alt"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:48.913810 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-922b5daa-d0a7-41bd-b587-8d2eb8fe191d tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:48.958760 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-922b5daa-d0a7-41bd-b587-8d2eb8fe191d tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for user 012d4505c0a74ee286d4359926302d68 and project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:49.056670 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-16af415d-eb47-490b-8168-ca359e0f896f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:49.062868 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-16af415d-eb47-490b-8168-ca359e0f896f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:49.103661 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-16af415d-eb47-490b-8168-ca359e0f896f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:49.108466 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-16af415d-eb47-490b-8168-ca359e0f896f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:49.113918 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-16af415d-eb47-490b-8168-ca359e0f896f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:49.124693 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-16af415d-eb47-490b-8168-ca359e0f896f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:49.127033 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-16af415d-eb47-490b-8168-ca359e0f896f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:49.129938 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-16af415d-eb47-490b-8168-ca359e0f896f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:49.564988 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-16af415d-eb47-490b-8168-ca359e0f896f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:49.599378 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-16af415d-eb47-490b-8168-ca359e0f896f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:49.610911 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-16af415d-eb47-490b-8168-ca359e0f896f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:49.621694 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-16af415d-eb47-490b-8168-ca359e0f896f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1348 microversion: 2.47 time: 0.584461 Oct 04 20:46:49.625048 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 847/1707] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:49 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1348 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:49.649378 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c6157534-a696-4e67-b5e6-a1b81417856a tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:49.651126 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c6157534-a696-4e67-b5e6-a1b81417856a tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:49.706172 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c6157534-a696-4e67-b5e6-a1b81417856a tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:49.707210 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c6157534-a696-4e67-b5e6-a1b81417856a tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:49.707930 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c6157534-a696-4e67-b5e6-a1b81417856a tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:49.709251 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c6157534-a696-4e67-b5e6-a1b81417856a tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:49.710104 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c6157534-a696-4e67-b5e6-a1b81417856a tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:49.710915 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c6157534-a696-4e67-b5e6-a1b81417856a tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:50.088425 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c6157534-a696-4e67-b5e6-a1b81417856a tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:50.118764 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c6157534-a696-4e67-b5e6-a1b81417856a tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:50.129933 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c6157534-a696-4e67-b5e6-a1b81417856a tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:50.136279 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c6157534-a696-4e67-b5e6-a1b81417856a tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1277 microversion: 2.47 time: 0.505700 Oct 04 20:46:50.137857 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 848/1708] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:49 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1277 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:50.157902 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-274307d4-60ef-4713-bb2a-2caae5dec760 tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1200586087", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "becb2bb8-4aa1-4ce8-843c-ef0a82d766a9"}], "security_groups": [{"name": "tempest-securitygroup--1154056546"}], "key_name": "tempest-keypair-540237634", "user_data": "}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:50.424976 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-922b5daa-d0a7-41bd-b587-8d2eb8fe191d tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.819796 Oct 04 20:46:50.428666 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 861/1709] 10.222.0.78 () {60 vars in 1313 bytes} [Tue Oct 4 20:46:48 2022] PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata/os_version => generated 31 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:50.458087 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-abface4d-9150-4617-9864-881c1b184737 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Calling method '.version_select at 0x7f77eeed1d30>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:50.609722 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-abface4d-9150-4617-9864-881c1b184737 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 58 microversion: 2.1 time: 0.160752 Oct 04 20:46:50.619092 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 862/1710] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:46:50 2022] GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 58 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:50.669919 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ccf949d0-e95d-46e6-9268-3991df5d3cb4 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Action: 'update_all', calling method: .version_select at 0x7f77eef01f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:50.883258 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-ccf949d0-e95d-46e6-9268-3991df5d3cb4 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:50.913228 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-ccf949d0-e95d-46e6-9268-3991df5d3cb4 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for user 012d4505c0a74ee286d4359926302d68 and project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:50.932631 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:50.949801 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-274307d4-60ef-4713-bb2a-2caae5dec760 tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] validate_networks() for [('becb2bb8-4aa1-4ce8-843c-ef0a82d766a9', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-274307d4-60ef-4713-bb2a-2caae5dec760 tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8b371d23-e0b6-463a-a941-28786b9b7847) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:46:51.907251 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8b371d23-e0b6-463a-a941-28786b9b7847) Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-274307d4-60ef-4713-bb2a-2caae5dec760 tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:51.914037 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-274307d4-60ef-4713-bb2a-2caae5dec760 tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Request method failure captured: Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 491 Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJuSBdMtfOPl72E6oatxN6yPoZEvXEf5lqTTGV97KwlxOvljBtWRzTCZPJ6EfP-wbxHDxvELkw-bt2nKTMb9NNux1wi4SIM6DoKBtARZumIHAjsSP4vhcPUbz6QAcZnPsexmlpKt70PyttIZI4lA7LePkb-aEZlQbNsZ5ik7Zu_2G3Y Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 20a4ff06d4d748a7af1b5daf97fd6b39 Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-635005537 Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_20a4ff06d4d748a7af1b5daf97fd6b39", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/20a4ff06d4d748a7af1b5daf97fd6b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/20a4ff06d4d748a7af1b5daf97fd6b39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/20a4ff06d4d748a7af1b5daf97fd6b39"}]}] Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-635005537 Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 20a4ff06d4d748a7af1b5daf97fd6b39 Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-635005537 Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AttachVolumeShelveTestJSON-635005537-project Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 2ba96f867da3438b9215039add0f4496 Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-635005537-project Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1200586087", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "becb2bb8-4aa1-4ce8-843c-ef0a82d766a9"}], "security_groups": [{"name": "tempest-securitygroup--1154056546"}], "key_name": "tempest-keypair-540237634", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeShelveTestJSON-server-1200586087', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'becb2bb8-4aa1-4ce8-843c-ef0a82d766a9'}], 'security_groups': [{'name': 'tempest-securitygroup--1154056546'}], 'key_name': 'tempest-keypair-540237634', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:46:51.916610 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8b371d23-e0b6-463a-a941-28786b9b7847) Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:51.927335 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-274307d4-60ef-4713-bb2a-2caae5dec760 tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:51.936915 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-274307d4-60ef-4713-bb2a-2caae5dec760 tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.20 time: 1.782093 Oct 04 20:46:51.944864 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 849/1711] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:46:50 2022] POST /compute/v2.1/servers => generated 214 bytes in 1806 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 04 20:46:51.955044 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-56b19f14-e8c6-4dcc-afbf-fd614bcb84bc tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:51.956437 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-56b19f14-e8c6-4dcc-afbf-fd614bcb84bc tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:51.968084 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56b19f14-e8c6-4dcc-afbf-fd614bcb84bc tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:51.969134 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56b19f14-e8c6-4dcc-afbf-fd614bcb84bc tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:51.970038 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56b19f14-e8c6-4dcc-afbf-fd614bcb84bc tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:51.971701 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56b19f14-e8c6-4dcc-afbf-fd614bcb84bc tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:51.972505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56b19f14-e8c6-4dcc-afbf-fd614bcb84bc tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:51.973575 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56b19f14-e8c6-4dcc-afbf-fd614bcb84bc tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:52.050438 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ccf949d0-e95d-46e6-9268-3991df5d3cb4 tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 61 microversion: 2.1 time: 1.424655 Oct 04 20:46:52.061054 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 863/1712] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:46:50 2022] PUT /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 61 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:52.073601 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3ed3a117-8ed2-4b16-b75a-87fb5d71654b tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:52.075664 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3ed3a117-8ed2-4b16-b75a-87fb5d71654b tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:52.089052 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3ed3a117-8ed2-4b16-b75a-87fb5d71654b tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:52.092804 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3ed3a117-8ed2-4b16-b75a-87fb5d71654b tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:52.094082 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3ed3a117-8ed2-4b16-b75a-87fb5d71654b tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:52.095823 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3ed3a117-8ed2-4b16-b75a-87fb5d71654b tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:52.097267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3ed3a117-8ed2-4b16-b75a-87fb5d71654b tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:52.098384 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3ed3a117-8ed2-4b16-b75a-87fb5d71654b tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:52.274904 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-56b19f14-e8c6-4dcc-afbf-fd614bcb84bc tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:52.300473 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-56b19f14-e8c6-4dcc-afbf-fd614bcb84bc tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:52.310053 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-56b19f14-e8c6-4dcc-afbf-fd614bcb84bc tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:52.310053 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-56b19f14-e8c6-4dcc-afbf-fd614bcb84bc tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1336 microversion: 2.47 time: 0.359971 Oct 04 20:46:52.310053 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 850/1713] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:51 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1336 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:52.332171 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-175426f4-b7f6-40c4-8006-dafd208e9dbd tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] Calling method '.version_select at 0x7f77eecc13a0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:52.438999 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3ed3a117-8ed2-4b16-b75a-87fb5d71654b tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:52.463275 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3ed3a117-8ed2-4b16-b75a-87fb5d71654b tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:52.483809 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3ed3a117-8ed2-4b16-b75a-87fb5d71654b tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:52.489554 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3ed3a117-8ed2-4b16-b75a-87fb5d71654b tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1341 microversion: 2.47 time: 0.424251 Oct 04 20:46:52.524796 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-175426f4-b7f6-40c4-8006-dafd208e9dbd tempest-AttachVolumeShelveTestJSON-635005537 tempest-AttachVolumeShelveTestJSON-635005537-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-540237634" status: 204 len: 0 microversion: 2.20 time: 0.212064 Oct 04 20:46:52.529220 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 851/1714] 10.222.0.78 () {60 vars in 1259 bytes} [Tue Oct 4 20:46:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-540237634 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:46:52.535032 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 864/1715] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:52 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1341 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:52.551907 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4800a82e-6eee-4f4d-9442-c039116671ec tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Action: 'create', calling method: .version_select at 0x7f77f73f6820>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:52.833461 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-4800a82e-6eee-4f4d-9442-c039116671ec tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:52.874901 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-4800a82e-6eee-4f4d-9442-c039116671ec tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Getting quotas for user 012d4505c0a74ee286d4359926302d68 and project d0f1de86b29c47899f3a04f3fb5b9108. Resources: dict_keys(['metadata_items']) {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:52.894145 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:53.397403 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bcb56f09-fba3-4fb2-bba7-89a39aeea7f7 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:53.399161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-bcb56f09-fba3-4fb2-bba7-89a39aeea7f7 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:53.440395 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bcb56f09-fba3-4fb2-bba7-89a39aeea7f7 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.441283 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bcb56f09-fba3-4fb2-bba7-89a39aeea7f7 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.442120 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bcb56f09-fba3-4fb2-bba7-89a39aeea7f7 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.443484 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bcb56f09-fba3-4fb2-bba7-89a39aeea7f7 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.444351 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bcb56f09-fba3-4fb2-bba7-89a39aeea7f7 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.445138 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bcb56f09-fba3-4fb2-bba7-89a39aeea7f7 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.019128 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4800a82e-6eee-4f4d-9442-c039116671ec tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "POST /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 85 microversion: 2.1 time: 1.487576 Oct 04 20:46:54.021489 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 852/1716] 10.222.0.78 () {60 vars in 1281 bytes} [Tue Oct 4 20:46:52 2022] POST /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 85 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:54.053185 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3c010299-56ca-460b-9baf-98d303a57c93 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:54.055614 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3c010299-56ca-460b-9baf-98d303a57c93 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:54.086801 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c010299-56ca-460b-9baf-98d303a57c93 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.088938 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c010299-56ca-460b-9baf-98d303a57c93 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.090396 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c010299-56ca-460b-9baf-98d303a57c93 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.092064 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c010299-56ca-460b-9baf-98d303a57c93 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.093368 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c010299-56ca-460b-9baf-98d303a57c93 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.094981 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c010299-56ca-460b-9baf-98d303a57c93 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.106966 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bcb56f09-fba3-4fb2-bba7-89a39aeea7f7 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.139107 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bcb56f09-fba3-4fb2-bba7-89a39aeea7f7 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.142959 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bcb56f09-fba3-4fb2-bba7-89a39aeea7f7 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.146188 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bcb56f09-fba3-4fb2-bba7-89a39aeea7f7 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1336 microversion: 2.47 time: 0.772885 Oct 04 20:46:54.148273 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 865/1717] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:53 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1336 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:54.157479 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-67f26c54-e583-4d1c-8daa-21ad5009190b tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] Calling method '.version_select at 0x7f77eee31940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:54.312427 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-67f26c54-e583-4d1c-8daa-21ad5009190b tempest-ImagesMetadataTestJSON-1963545379 tempest-ImagesMetadataTestJSON-1963545379-project] 10.222.0.78 "GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.161753 Oct 04 20:46:54.316189 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 866/1718] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:46:54 2022] GET /compute/v2.1/images/fc7296c2-94eb-41da-a849-f1a291f095e1/metadata => generated 85 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:46:54.451927 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3c010299-56ca-460b-9baf-98d303a57c93 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.484051 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3c010299-56ca-460b-9baf-98d303a57c93 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.493624 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3c010299-56ca-460b-9baf-98d303a57c93 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.497786 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3c010299-56ca-460b-9baf-98d303a57c93 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1339 microversion: 2.47 time: 0.473863 Oct 04 20:46:54.502765 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 853/1719] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:54 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1339 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:55.200493 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=6 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:55.211235 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8e6cf27b-edc1-4417-aea7-44add8334f40 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:55.216117 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8e6cf27b-edc1-4417-aea7-44add8334f40 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:55.233720 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8e6cf27b-edc1-4417-aea7-44add8334f40 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.235756 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8e6cf27b-edc1-4417-aea7-44add8334f40 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.236870 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8e6cf27b-edc1-4417-aea7-44add8334f40 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.239035 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8e6cf27b-edc1-4417-aea7-44add8334f40 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.242075 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8e6cf27b-edc1-4417-aea7-44add8334f40 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.243481 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8e6cf27b-edc1-4417-aea7-44add8334f40 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.557501 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8e6cf27b-edc1-4417-aea7-44add8334f40 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:55.573852 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3c5f2f1a-27ae-4bdc-b5b9-82bf39a8ede0 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:55.576250 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3c5f2f1a-27ae-4bdc-b5b9-82bf39a8ede0 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:55.586136 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8e6cf27b-edc1-4417-aea7-44add8334f40 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:55.601660 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c5f2f1a-27ae-4bdc-b5b9-82bf39a8ede0 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.609346 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c5f2f1a-27ae-4bdc-b5b9-82bf39a8ede0 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.611585 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c5f2f1a-27ae-4bdc-b5b9-82bf39a8ede0 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.614098 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c5f2f1a-27ae-4bdc-b5b9-82bf39a8ede0 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.615389 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c5f2f1a-27ae-4bdc-b5b9-82bf39a8ede0 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.617046 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c5f2f1a-27ae-4bdc-b5b9-82bf39a8ede0 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.629484 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8e6cf27b-edc1-4417-aea7-44add8334f40 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:55.636573 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8e6cf27b-edc1-4417-aea7-44add8334f40 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1336 microversion: 2.47 time: 0.438712 Oct 04 20:46:55.642872 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 867/1720] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:55 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1336 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:56.085414 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3c5f2f1a-27ae-4bdc-b5b9-82bf39a8ede0 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:56.128631 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3c5f2f1a-27ae-4bdc-b5b9-82bf39a8ede0 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:56.132139 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3c5f2f1a-27ae-4bdc-b5b9-82bf39a8ede0 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:56.134480 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3c5f2f1a-27ae-4bdc-b5b9-82bf39a8ede0 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1339 microversion: 2.47 time: 0.577733 Oct 04 20:46:56.144903 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 854/1721] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:55 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1339 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:56.703509 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-893e0c91-8f01-4e66-998d-2741b466d1c5 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:56.711907 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-893e0c91-8f01-4e66-998d-2741b466d1c5 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:56.751377 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-893e0c91-8f01-4e66-998d-2741b466d1c5 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.752215 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-893e0c91-8f01-4e66-998d-2741b466d1c5 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.753043 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-893e0c91-8f01-4e66-998d-2741b466d1c5 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.754333 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-893e0c91-8f01-4e66-998d-2741b466d1c5 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.759442 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-893e0c91-8f01-4e66-998d-2741b466d1c5 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.760386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-893e0c91-8f01-4e66-998d-2741b466d1c5 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.205361 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7fc1d6ba-9f04-4c28-aa9f-9129a24a1e8e tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:57.213954 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7fc1d6ba-9f04-4c28-aa9f-9129a24a1e8e tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:57.247984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7fc1d6ba-9f04-4c28-aa9f-9129a24a1e8e tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.254498 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7fc1d6ba-9f04-4c28-aa9f-9129a24a1e8e tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.258303 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7fc1d6ba-9f04-4c28-aa9f-9129a24a1e8e tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.260217 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7fc1d6ba-9f04-4c28-aa9f-9129a24a1e8e tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.261124 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7fc1d6ba-9f04-4c28-aa9f-9129a24a1e8e tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.264483 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7fc1d6ba-9f04-4c28-aa9f-9129a24a1e8e tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.354546 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-893e0c91-8f01-4e66-998d-2741b466d1c5 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:57.407891 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-893e0c91-8f01-4e66-998d-2741b466d1c5 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:57.411170 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-893e0c91-8f01-4e66-998d-2741b466d1c5 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:57.419701 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-893e0c91-8f01-4e66-998d-2741b466d1c5 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1357 microversion: 2.47 time: 0.724447 Oct 04 20:46:57.436183 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 868/1722] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:56 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1357 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:57.498184 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:57.504573 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:57.551080 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.553072 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.555099 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.558313 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.565927 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.571196 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.678050 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7fc1d6ba-9f04-4c28-aa9f-9129a24a1e8e tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:57.724827 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7fc1d6ba-9f04-4c28-aa9f-9129a24a1e8e tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:57.743907 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7fc1d6ba-9f04-4c28-aa9f-9129a24a1e8e tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:57.747569 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7fc1d6ba-9f04-4c28-aa9f-9129a24a1e8e tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1339 microversion: 2.47 time: 0.560416 Oct 04 20:46:57.760783 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 855/1723] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1339 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:58.059383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:46:58.059383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:46:58.059383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:46:58.059383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:46:58.059383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:46:58.554663 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:58.596005 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.598329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.600548 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.603731 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.605042 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.607654 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.685564 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c13541e2-9f7d-4fd1-93cd-20133173a280 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "POST /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697/action" status: 202 len: 1079 microversion: 2.47 time: 1.208791 Oct 04 20:46:58.687304 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 869/1724] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 4 20:46:57 2022] POST /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697/action => generated 1079 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 20:46:58.732659 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-56c6dcfb-27e0-4def-bb9c-547220c44473 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:58.735457 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-56c6dcfb-27e0-4def-bb9c-547220c44473 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:58.791585 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56c6dcfb-27e0-4def-bb9c-547220c44473 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.791585 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56c6dcfb-27e0-4def-bb9c-547220c44473 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.794265 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56c6dcfb-27e0-4def-bb9c-547220c44473 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.796293 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56c6dcfb-27e0-4def-bb9c-547220c44473 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.797632 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56c6dcfb-27e0-4def-bb9c-547220c44473 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.799056 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-56c6dcfb-27e0-4def-bb9c-547220c44473 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.816473 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-96e762b6-b55c-4ddf-9b9c-e4c9e1462ef2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:58.829424 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-96e762b6-b55c-4ddf-9b9c-e4c9e1462ef2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:58.884402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-96e762b6-b55c-4ddf-9b9c-e4c9e1462ef2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.884402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-96e762b6-b55c-4ddf-9b9c-e4c9e1462ef2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.884402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-96e762b6-b55c-4ddf-9b9c-e4c9e1462ef2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.884402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-96e762b6-b55c-4ddf-9b9c-e4c9e1462ef2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.884402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-96e762b6-b55c-4ddf-9b9c-e4c9e1462ef2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.884402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-96e762b6-b55c-4ddf-9b9c-e4c9e1462ef2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.314803 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-56c6dcfb-27e0-4def-bb9c-547220c44473 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.345668 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-56c6dcfb-27e0-4def-bb9c-547220c44473 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.351567 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-56c6dcfb-27e0-4def-bb9c-547220c44473 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.357191 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-56c6dcfb-27e0-4def-bb9c-547220c44473 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.630703 Oct 04 20:46:59.358608 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 856/1725] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:58 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:59.366394 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-96e762b6-b55c-4ddf-9b9c-e4c9e1462ef2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.404732 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-96e762b6-b55c-4ddf-9b9c-e4c9e1462ef2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.408904 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-96e762b6-b55c-4ddf-9b9c-e4c9e1462ef2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.412577 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-96e762b6-b55c-4ddf-9b9c-e4c9e1462ef2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1360 microversion: 2.47 time: 0.607397 Oct 04 20:46:59.417506 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 870/1726] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:58 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1360 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:59.485413 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9f6bf6f7-b363-40ff-b38c-ff9a179036a2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1631845864"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:59.496505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9f6bf6f7-b363-40ff-b38c-ff9a179036a2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:59.510420 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9f6bf6f7-b363-40ff-b38c-ff9a179036a2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.512056 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9f6bf6f7-b363-40ff-b38c-ff9a179036a2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.514531 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9f6bf6f7-b363-40ff-b38c-ff9a179036a2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.516593 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9f6bf6f7-b363-40ff-b38c-ff9a179036a2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.517934 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9f6bf6f7-b363-40ff-b38c-ff9a179036a2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.519168 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9f6bf6f7-b363-40ff-b38c-ff9a179036a2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.418564 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c4e4f811-1611-4734-bed8-b401f55a30c3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:00.419882 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c4e4f811-1611-4734-bed8-b401f55a30c3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:00.454832 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c4e4f811-1611-4734-bed8-b401f55a30c3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.456158 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c4e4f811-1611-4734-bed8-b401f55a30c3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.457331 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c4e4f811-1611-4734-bed8-b401f55a30c3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.459091 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c4e4f811-1611-4734-bed8-b401f55a30c3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.468662 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c4e4f811-1611-4734-bed8-b401f55a30c3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.470012 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c4e4f811-1611-4734-bed8-b401f55a30c3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.531482 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9f6bf6f7-b363-40ff-b38c-ff9a179036a2 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "POST /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba/action" status: 202 len: 52 microversion: 2.47 time: 1.063708 Oct 04 20:47:00.547613 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 857/1727] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Oct 4 20:46:59 2022] POST /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba/action => generated 52 bytes in 1078 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:47:00.581771 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d5dfbec3-ae56-41b2-b916-a2be55bad00f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:00.583736 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d5dfbec3-ae56-41b2-b916-a2be55bad00f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:00.614751 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5dfbec3-ae56-41b2-b916-a2be55bad00f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.616658 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5dfbec3-ae56-41b2-b916-a2be55bad00f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.621181 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5dfbec3-ae56-41b2-b916-a2be55bad00f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.626590 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5dfbec3-ae56-41b2-b916-a2be55bad00f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.634821 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5dfbec3-ae56-41b2-b916-a2be55bad00f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.636853 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5dfbec3-ae56-41b2-b916-a2be55bad00f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.772040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d5dfbec3-ae56-41b2-b916-a2be55bad00f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:00.932394 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=42 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:01.057553 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c4e4f811-1611-4734-bed8-b401f55a30c3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:01.132971 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c4e4f811-1611-4734-bed8-b401f55a30c3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:01.147999 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c4e4f811-1611-4734-bed8-b401f55a30c3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:01.150559 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c4e4f811-1611-4734-bed8-b401f55a30c3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.740707 Oct 04 20:47:01.152731 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 871/1728] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:00 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:01.752157 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d5dfbec3-ae56-41b2-b916-a2be55bad00f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 204 len: 0 microversion: 2.47 time: 1.200440 Oct 04 20:47:01.754493 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 858/1729] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:47:00 2022] DELETE /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 0 bytes in 1208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:47:01.780240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9eac7045-15e6-4ee8-a939-d3da65fb5624 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:01.790323 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9eac7045-15e6-4ee8-a939-d3da65fb5624 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:01.830757 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9eac7045-15e6-4ee8-a939-d3da65fb5624 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.832492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9eac7045-15e6-4ee8-a939-d3da65fb5624 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.833997 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9eac7045-15e6-4ee8-a939-d3da65fb5624 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.837579 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9eac7045-15e6-4ee8-a939-d3da65fb5624 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.838828 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9eac7045-15e6-4ee8-a939-d3da65fb5624 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.839996 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9eac7045-15e6-4ee8-a939-d3da65fb5624 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.211544 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-83f2f09f-9d1f-4e24-8457-715eae7c9e3a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:02.212810 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-83f2f09f-9d1f-4e24-8457-715eae7c9e3a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:02.243679 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83f2f09f-9d1f-4e24-8457-715eae7c9e3a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.244977 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83f2f09f-9d1f-4e24-8457-715eae7c9e3a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.246141 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83f2f09f-9d1f-4e24-8457-715eae7c9e3a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.247949 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83f2f09f-9d1f-4e24-8457-715eae7c9e3a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.260532 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83f2f09f-9d1f-4e24-8457-715eae7c9e3a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.261765 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-83f2f09f-9d1f-4e24-8457-715eae7c9e3a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.342132 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9eac7045-15e6-4ee8-a939-d3da65fb5624 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:02.397413 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9eac7045-15e6-4ee8-a939-d3da65fb5624 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:02.406966 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9eac7045-15e6-4ee8-a939-d3da65fb5624 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:02.410078 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9eac7045-15e6-4ee8-a939-d3da65fb5624 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1366 microversion: 2.47 time: 0.648417 Oct 04 20:47:02.418439 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 872/1730] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:01 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1366 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:02.692541 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-83f2f09f-9d1f-4e24-8457-715eae7c9e3a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:02.714958 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-83f2f09f-9d1f-4e24-8457-715eae7c9e3a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:02.718229 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-83f2f09f-9d1f-4e24-8457-715eae7c9e3a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:02.726681 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-83f2f09f-9d1f-4e24-8457-715eae7c9e3a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.523945 Oct 04 20:47:02.729940 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 859/1731] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:02 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:03.478722 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b47d17e5-1c29-488d-a566-9efbdc15914f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:03.481026 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b47d17e5-1c29-488d-a566-9efbdc15914f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:03.521127 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b47d17e5-1c29-488d-a566-9efbdc15914f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:03.529880 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b47d17e5-1c29-488d-a566-9efbdc15914f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:03.529880 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b47d17e5-1c29-488d-a566-9efbdc15914f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:03.532168 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b47d17e5-1c29-488d-a566-9efbdc15914f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:03.535474 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b47d17e5-1c29-488d-a566-9efbdc15914f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:03.536840 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b47d17e5-1c29-488d-a566-9efbdc15914f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:03.782148 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8024ed13-0921-4b36-9c35-d95655271dc9 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:03.787395 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8024ed13-0921-4b36-9c35-d95655271dc9 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:03.802955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=34 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:03.807232 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8024ed13-0921-4b36-9c35-d95655271dc9 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:03.808445 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8024ed13-0921-4b36-9c35-d95655271dc9 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:03.809781 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8024ed13-0921-4b36-9c35-d95655271dc9 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:03.811583 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8024ed13-0921-4b36-9c35-d95655271dc9 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:03.813404 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8024ed13-0921-4b36-9c35-d95655271dc9 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:03.814506 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8024ed13-0921-4b36-9c35-d95655271dc9 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.410947 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b47d17e5-1c29-488d-a566-9efbdc15914f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.438411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b47d17e5-1c29-488d-a566-9efbdc15914f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.444539 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b47d17e5-1c29-488d-a566-9efbdc15914f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.454370 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b47d17e5-1c29-488d-a566-9efbdc15914f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1366 microversion: 2.47 time: 0.984764 Oct 04 20:47:04.456148 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 873/1732] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:03 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1366 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:04.478466 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8024ed13-0921-4b36-9c35-d95655271dc9 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.507076 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8024ed13-0921-4b36-9c35-d95655271dc9 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.511678 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8024ed13-0921-4b36-9c35-d95655271dc9 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.518369 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8024ed13-0921-4b36-9c35-d95655271dc9 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.746446 Oct 04 20:47:04.532720 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 860/1733] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:03 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:05.183593 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6177908a-2e67-4629-adce-29ce99e859f9 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Calling method '.version_select at 0x7f77ef4beca0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.246199 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-6177908a-2e67-4629-adce-29ce99e859f9 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] HTTP exception thrown: Image not found. Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6177908a-2e67-4629-adce-29ce99e859f9 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Request method failure captured: Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/images/d801f9a2-035e-44c6-84fa-23b31c156216/metadata/os_distro HTTP/1.1 Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJvI40tNSUtHhcCI_Rq2RwqK4xqWjasBhrRNrPXyDRiKDe5welv4hTY_j1-p-sJfOyJf01c3CGJdaWTzmgAXjDG5YjKGoYlmbM72sJTbtnYNeY80FMsxjttBOS6jNpeZUq6uVQ689Ay5CvgYCUUcH4jMZjS3WynGvn3aKkjWy4AiJ-k Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 2ef7f47c67d54d6aa7dbc5165d7addaf Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2ef7f47c67d54d6aa7dbc5165d7addaf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}] Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 2ef7f47c67d54d6aa7dbc5165d7addaf Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesMetadataNegativeTestJSON-2087147329-project Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: c14511a8912e435aae83d33db7645926 Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329-project Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: exception: Image not found. Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'image_id': 'd801f9a2-035e-44c6-84fa-23b31c156216', 'id': 'os_distro'} Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d801f9a2-035e-44c6-84fa-23b31c156216 Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:47:05.257664 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d801f9a2-035e-44c6-84fa-23b31c156216 could not be found. Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:47:05.266518 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.276873 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6177908a-2e67-4629-adce-29ce99e859f9 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Returning 404 to user: Image not found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:05.276873 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6177908a-2e67-4629-adce-29ce99e859f9 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] 10.222.0.78 "DELETE /compute/v2.1/images/d801f9a2-035e-44c6-84fa-23b31c156216/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.563183 Oct 04 20:47:05.278506 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 874/1734] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 4 20:47:04 2022] DELETE /compute/v2.1/images/d801f9a2-035e-44c6-84fa-23b31c156216/metadata/os_distro => generated 62 bytes in 568 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:47:05.296142 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-884b78b4-2c5a-44d9-bd7f-419aba76015d tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Calling method '.version_select at 0x7f77f7331c10>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.350670 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-884b78b4-2c5a-44d9-bd7f-419aba76015d tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] HTTP exception thrown: Image not found. Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-884b78b4-2c5a-44d9-bd7f-419aba76015d tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Request method failure captured: Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/images/c8e044d1-c77c-476f-be38-dba7e0e8b4dc/metadata/os_version HTTP/1.1 Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJvI40tNSUtHhcCI_Rq2RwqK4xqWjasBhrRNrPXyDRiKDe5welv4hTY_j1-p-sJfOyJf01c3CGJdaWTzmgAXjDG5YjKGoYlmbM72sJTbtnYNeY80FMsxjttBOS6jNpeZUq6uVQ689Ay5CvgYCUUcH4jMZjS3WynGvn3aKkjWy4AiJ-k Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 2ef7f47c67d54d6aa7dbc5165d7addaf Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2ef7f47c67d54d6aa7dbc5165d7addaf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}] Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 2ef7f47c67d54d6aa7dbc5165d7addaf Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ImagesMetadataNegativeTestJSON-2087147329-project Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: c14511a8912e435aae83d33db7645926 Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329-project Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: exception: Image not found. Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'image_id': 'c8e044d1-c77c-476f-be38-dba7e0e8b4dc', 'id': 'os_version'} Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c8e044d1-c77c-476f-be38-dba7e0e8b4dc Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:47:05.356320 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c8e044d1-c77c-476f-be38-dba7e0e8b4dc could not be found. Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:47:05.366508 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.376976 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-884b78b4-2c5a-44d9-bd7f-419aba76015d tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Returning 404 to user: Image not found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:05.378520 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-884b78b4-2c5a-44d9-bd7f-419aba76015d tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] 10.222.0.78 "GET /compute/v2.1/images/c8e044d1-c77c-476f-be38-dba7e0e8b4dc/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.083722 Oct 04 20:47:05.380080 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 861/1735] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/images/c8e044d1-c77c-476f-be38-dba7e0e8b4dc/metadata/os_version => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:47:05.405510 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-93c06989-333e-4204-9a7e-7acd0f66b427 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Calling method '.version_select at 0x7f77ef13aaf0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.459014 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-93c06989-333e-4204-9a7e-7acd0f66b427 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] HTTP exception thrown: Image not found. Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-93c06989-333e-4204-9a7e-7acd0f66b427 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Request method failure captured: Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/images/e895a980-4d7d-47f7-a2f4-a466d43a9c13/metadata HTTP/1.1 Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJvI40tNSUtHhcCI_Rq2RwqK4xqWjasBhrRNrPXyDRiKDe5welv4hTY_j1-p-sJfOyJf01c3CGJdaWTzmgAXjDG5YjKGoYlmbM72sJTbtnYNeY80FMsxjttBOS6jNpeZUq6uVQ689Ay5CvgYCUUcH4jMZjS3WynGvn3aKkjWy4AiJ-k Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 2ef7f47c67d54d6aa7dbc5165d7addaf Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2ef7f47c67d54d6aa7dbc5165d7addaf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}] Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 2ef7f47c67d54d6aa7dbc5165d7addaf Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesMetadataNegativeTestJSON-2087147329-project Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: c14511a8912e435aae83d33db7645926 Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329-project Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: exception: Image not found. Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'image_id': 'e895a980-4d7d-47f7-a2f4-a466d43a9c13'} Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e895a980-4d7d-47f7-a2f4-a466d43a9c13 Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:47:05.466802 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e895a980-4d7d-47f7-a2f4-a466d43a9c13 could not be found. Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:47:05.478796 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.488858 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-93c06989-333e-4204-9a7e-7acd0f66b427 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Returning 404 to user: Image not found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:05.509327 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-50366808-c0d0-4e79-83be-e06d16478fe6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.512661 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-50366808-c0d0-4e79-83be-e06d16478fe6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:05.524874 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-93c06989-333e-4204-9a7e-7acd0f66b427 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] 10.222.0.78 "GET /compute/v2.1/images/e895a980-4d7d-47f7-a2f4-a466d43a9c13/metadata" status: 404 len: 62 microversion: 2.1 time: 0.125170 Oct 04 20:47:05.526635 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 875/1736] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/images/e895a980-4d7d-47f7-a2f4-a466d43a9c13/metadata => generated 62 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:47:05.539887 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-50366808-c0d0-4e79-83be-e06d16478fe6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.539887 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-50366808-c0d0-4e79-83be-e06d16478fe6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.539887 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-50366808-c0d0-4e79-83be-e06d16478fe6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.543553 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-50366808-c0d0-4e79-83be-e06d16478fe6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.548951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-50366808-c0d0-4e79-83be-e06d16478fe6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.550231 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-50366808-c0d0-4e79-83be-e06d16478fe6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.569384 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-35619109-8337-419e-a0b5-41795ce1d030 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Action: 'update_all', calling method: .version_select at 0x7f77eeed1dc0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:05.662046 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-35619109-8337-419e-a0b5-41795ce1d030 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] HTTP exception thrown: Image not found. Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-35619109-8337-419e-a0b5-41795ce1d030 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Request method failure captured: Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: request: PUT /compute/v2.1/images/9d64b99e-d12f-4933-9085-809af160727b/metadata HTTP/1.1 Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 57 Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJvI40tNSUtHhcCI_Rq2RwqK4xqWjasBhrRNrPXyDRiKDe5welv4hTY_j1-p-sJfOyJf01c3CGJdaWTzmgAXjDG5YjKGoYlmbM72sJTbtnYNeY80FMsxjttBOS6jNpeZUq6uVQ689Ay5CvgYCUUcH4jMZjS3WynGvn3aKkjWy4AiJ-k Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 2ef7f47c67d54d6aa7dbc5165d7addaf Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2ef7f47c67d54d6aa7dbc5165d7addaf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}] Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 2ef7f47c67d54d6aa7dbc5165d7addaf Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ImagesMetadataNegativeTestJSON-2087147329-project Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: c14511a8912e435aae83d33db7645926 Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329-project Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: exception: Image not found. Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'image_id': '9d64b99e-d12f-4933-9085-809af160727b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9d64b99e-d12f-4933-9085-809af160727b Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:47:05.667538 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9d64b99e-d12f-4933-9085-809af160727b could not be found. Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-35619109-8337-419e-a0b5-41795ce1d030 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Returning 404 to user: Image not found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:05.678257 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-35619109-8337-419e-a0b5-41795ce1d030 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] 10.222.0.78 "PUT /compute/v2.1/images/9d64b99e-d12f-4933-9085-809af160727b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.122152 Oct 04 20:47:05.692836 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 876/1737] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:47:05 2022] PUT /compute/v2.1/images/9d64b99e-d12f-4933-9085-809af160727b/metadata => generated 62 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:47:05.706234 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bbb6c6c8-9fae-4603-a252-ac86dcf96272 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.707476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-bbb6c6c8-9fae-4603-a252-ac86dcf96272 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:05.760019 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bbb6c6c8-9fae-4603-a252-ac86dcf96272 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.762515 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bbb6c6c8-9fae-4603-a252-ac86dcf96272 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.763489 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bbb6c6c8-9fae-4603-a252-ac86dcf96272 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.765225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bbb6c6c8-9fae-4603-a252-ac86dcf96272 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.767418 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bbb6c6c8-9fae-4603-a252-ac86dcf96272 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.769392 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bbb6c6c8-9fae-4603-a252-ac86dcf96272 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.804570 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:05.844577 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-50366808-c0d0-4e79-83be-e06d16478fe6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:05.889619 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-50366808-c0d0-4e79-83be-e06d16478fe6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:05.894228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-50366808-c0d0-4e79-83be-e06d16478fe6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:05.897434 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-50366808-c0d0-4e79-83be-e06d16478fe6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1366 microversion: 2.47 time: 0.395343 Oct 04 20:47:05.899678 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 862/1738] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:05.910142 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3b21a560-b71f-475b-ad67-35625d104da6 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Action: 'update', calling method: .version_select at 0x7f77f7331940>, body: {"meta": {"os_distro": "alt"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:05.962024 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-3b21a560-b71f-475b-ad67-35625d104da6 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] HTTP exception thrown: Image not found. Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3b21a560-b71f-475b-ad67-35625d104da6 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Request method failure captured: Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: request: PUT /compute/v2.1/images/31f01b52-ea97-4932-bc8f-6243e4b91530/metadata/os_distro HTTP/1.1 Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 30 Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJvI40tNSUtHhcCI_Rq2RwqK4xqWjasBhrRNrPXyDRiKDe5welv4hTY_j1-p-sJfOyJf01c3CGJdaWTzmgAXjDG5YjKGoYlmbM72sJTbtnYNeY80FMsxjttBOS6jNpeZUq6uVQ689Ay5CvgYCUUcH4jMZjS3WynGvn3aKkjWy4AiJ-k Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 2ef7f47c67d54d6aa7dbc5165d7addaf Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2ef7f47c67d54d6aa7dbc5165d7addaf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}] Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 2ef7f47c67d54d6aa7dbc5165d7addaf Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ImagesMetadataNegativeTestJSON-2087147329-project Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: c14511a8912e435aae83d33db7645926 Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329-project Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: {"meta": {"os_distro": "alt"}} Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: exception: Image not found. Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'image_id': '31f01b52-ea97-4932-bc8f-6243e4b91530', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 31f01b52-ea97-4932-bc8f-6243e4b91530 Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:47:05.982154 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 31f01b52-ea97-4932-bc8f-6243e4b91530 could not be found. Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3b21a560-b71f-475b-ad67-35625d104da6 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Returning 404 to user: Image not found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:06.004494 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3b21a560-b71f-475b-ad67-35625d104da6 tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] 10.222.0.78 "PUT /compute/v2.1/images/31f01b52-ea97-4932-bc8f-6243e4b91530/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.091276 Oct 04 20:47:06.019826 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 863/1739] 10.222.0.78 () {60 vars in 1310 bytes} [Tue Oct 4 20:47:05 2022] PUT /compute/v2.1/images/31f01b52-ea97-4932-bc8f-6243e4b91530/metadata/os_distro => generated 62 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:47:06.041973 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-470b0985-31a1-4fb2-a288-f4e49de90bbb tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Action: 'create', calling method: .version_select at 0x7f77f73e7670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:06.117652 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-470b0985-31a1-4fb2-a288-f4e49de90bbb tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] HTTP exception thrown: Image not found. Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-470b0985-31a1-4fb2-a288-f4e49de90bbb tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Request method failure captured: Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/images/47c03731-7870-4f44-bb3b-13036158b345/metadata HTTP/1.1 Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 57 Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJvI40tNSUtHhcCI_Rq2RwqK4xqWjasBhrRNrPXyDRiKDe5welv4hTY_j1-p-sJfOyJf01c3CGJdaWTzmgAXjDG5YjKGoYlmbM72sJTbtnYNeY80FMsxjttBOS6jNpeZUq6uVQ689Ay5CvgYCUUcH4jMZjS3WynGvn3aKkjWy4AiJ-k Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 2ef7f47c67d54d6aa7dbc5165d7addaf Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2ef7f47c67d54d6aa7dbc5165d7addaf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2ef7f47c67d54d6aa7dbc5165d7addaf"}]}] Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 2ef7f47c67d54d6aa7dbc5165d7addaf Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329 Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ImagesMetadataNegativeTestJSON-2087147329-project Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: c14511a8912e435aae83d33db7645926 Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2087147329-project Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: exception: Image not found. Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'image_id': '47c03731-7870-4f44-bb3b-13036158b345', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 47c03731-7870-4f44-bb3b-13036158b345 Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:47:06.122550 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 47c03731-7870-4f44-bb3b-13036158b345 could not be found. Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:06.131617 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-470b0985-31a1-4fb2-a288-f4e49de90bbb tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] Returning 404 to user: Image not found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:06.139292 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-470b0985-31a1-4fb2-a288-f4e49de90bbb tempest-ImagesMetadataNegativeTestJSON-2087147329 tempest-ImagesMetadataNegativeTestJSON-2087147329-project] 10.222.0.78 "POST /compute/v2.1/images/47c03731-7870-4f44-bb3b-13036158b345/metadata" status: 404 len: 62 microversion: 2.1 time: 0.110149 Oct 04 20:47:06.146079 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 864/1740] 10.222.0.78 () {60 vars in 1281 bytes} [Tue Oct 4 20:47:06 2022] POST /compute/v2.1/images/47c03731-7870-4f44-bb3b-13036158b345/metadata => generated 62 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:47:06.221430 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bbb6c6c8-9fae-4603-a252-ac86dcf96272 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:06.281713 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bbb6c6c8-9fae-4603-a252-ac86dcf96272 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:06.308898 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bbb6c6c8-9fae-4603-a252-ac86dcf96272 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:06.312260 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bbb6c6c8-9fae-4603-a252-ac86dcf96272 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.617707 Oct 04 20:47:06.348777 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 877/1741] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:06.953919 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8d18b6b3-72db-4649-8d12-951d3c42eaef tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:06.962916 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8d18b6b3-72db-4649-8d12-951d3c42eaef tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:06.980357 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8d18b6b3-72db-4649-8d12-951d3c42eaef tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.981626 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8d18b6b3-72db-4649-8d12-951d3c42eaef tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.982708 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8d18b6b3-72db-4649-8d12-951d3c42eaef tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:06.985109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8d18b6b3-72db-4649-8d12-951d3c42eaef tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.986853 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8d18b6b3-72db-4649-8d12-951d3c42eaef tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.988545 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8d18b6b3-72db-4649-8d12-951d3c42eaef tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:07.213407 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8d18b6b3-72db-4649-8d12-951d3c42eaef tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.240533 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8d18b6b3-72db-4649-8d12-951d3c42eaef tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.245506 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8d18b6b3-72db-4649-8d12-951d3c42eaef tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.250649 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8d18b6b3-72db-4649-8d12-951d3c42eaef tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1366 microversion: 2.47 time: 0.303317 Oct 04 20:47:07.263213 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 865/1742] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:06 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:07.385007 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7d22e1ed-8279-4e69-99fd-0619fcdb13ec tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:07.385007 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7d22e1ed-8279-4e69-99fd-0619fcdb13ec tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:07.407558 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7d22e1ed-8279-4e69-99fd-0619fcdb13ec tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:07.409072 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7d22e1ed-8279-4e69-99fd-0619fcdb13ec tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:07.410353 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7d22e1ed-8279-4e69-99fd-0619fcdb13ec tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:07.412117 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7d22e1ed-8279-4e69-99fd-0619fcdb13ec tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:07.414019 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7d22e1ed-8279-4e69-99fd-0619fcdb13ec tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:07.416080 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7d22e1ed-8279-4e69-99fd-0619fcdb13ec tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:07.625992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7d22e1ed-8279-4e69-99fd-0619fcdb13ec tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.642709 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7d22e1ed-8279-4e69-99fd-0619fcdb13ec tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.646679 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7d22e1ed-8279-4e69-99fd-0619fcdb13ec tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.650077 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7d22e1ed-8279-4e69-99fd-0619fcdb13ec tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.279526 Oct 04 20:47:07.652115 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 878/1743] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:07 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:08.321291 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:08.324214 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:08.350784 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:08.351793 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:08.352593 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:08.359439 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:08.360382 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:08.362430 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:08.435895 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:08.474299 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:08.480923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:08.482187 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:08.495320 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lazy-loading 'fault' on Instance uuid a0608ad0-bdbd-4b39-b216-b01cff9cddba {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:08.707940 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f823ff06-c673-4baf-857b-6e9db2823eab tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:08.710201 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f823ff06-c673-4baf-857b-6e9db2823eab tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:08.727242 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f823ff06-c673-4baf-857b-6e9db2823eab tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:08.728640 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f823ff06-c673-4baf-857b-6e9db2823eab tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:08.730125 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f823ff06-c673-4baf-857b-6e9db2823eab tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:08.731875 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f823ff06-c673-4baf-857b-6e9db2823eab tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:08.733049 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f823ff06-c673-4baf-857b-6e9db2823eab tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:08.737613 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f823ff06-c673-4baf-857b-6e9db2823eab tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:08.820896 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:08.851423 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:08.857505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d65ad24790c45de95ef1e772d24fbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaee4910b0c4b3ba89057bcc76771ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:08.862453 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3d7465ae-0836-417e-b7b1-06553fdd889f tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 200 len: 1371 microversion: 2.47 time: 0.560762 Oct 04 20:47:08.880363 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 866/1744] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:08 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 1371 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:09.057329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f823ff06-c673-4baf-857b-6e9db2823eab tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:09.092363 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f823ff06-c673-4baf-857b-6e9db2823eab tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:09.099266 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f823ff06-c673-4baf-857b-6e9db2823eab tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:09.105891 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f823ff06-c673-4baf-857b-6e9db2823eab tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.412854 Oct 04 20:47:09.132304 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 879/1745] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:08 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:09.937744 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fceca48c-d764-4c44-a692-6f74d8402ee6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:09.947784 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-fceca48c-d764-4c44-a692-6f74d8402ee6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] [instance: a0608ad0-bdbd-4b39-b216-b01cff9cddba] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:09.998457 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fceca48c-d764-4c44-a692-6f74d8402ee6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.008848 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fceca48c-d764-4c44-a692-6f74d8402ee6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.014894 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fceca48c-d764-4c44-a692-6f74d8402ee6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.021696 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fceca48c-d764-4c44-a692-6f74d8402ee6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.044104 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fceca48c-d764-4c44-a692-6f74d8402ee6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.047034 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-fceca48c-d764-4c44-a692-6f74d8402ee6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.145169 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-fceca48c-d764-4c44-a692-6f74d8402ee6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] HTTP exception thrown: Instance a0608ad0-bdbd-4b39-b216-b01cff9cddba could not be found. Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fceca48c-d764-4c44-a692-6f74d8402ee6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Request method failure captured: Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba HTTP/1.1 Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJuyTlkVLBTSbxfHc8h3GVi28O6n_k1Q5aYzaRNzR51Y56KitTzEs-wAE_mwD2q8BUhtRljpfP7a66t94wk0R9c9ptnJqtF-byWp-swBMU9S2ausn8P1KmkOCUpkwSFNr-Cy-xMrmRII821wtGPg-fC3nNqaU_Y0sREcURN5yM85KlU Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 6eaee4910b0c4b3ba89057bcc76771ff Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersAaction247Test-1698006710 Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6eaee4910b0c4b3ba89057bcc76771ff", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6eaee4910b0c4b3ba89057bcc76771ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6eaee4910b0c4b3ba89057bcc76771ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6eaee4910b0c4b3ba89057bcc76771ff"}]}] Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersAaction247Test-1698006710 Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 6eaee4910b0c4b3ba89057bcc76771ff Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersAaction247Test-1698006710 Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersAaction247Test-1698006710-project Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 9d65ad24790c45de95ef1e772d24fbe9 Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersAaction247Test-1698006710-project Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance a0608ad0-bdbd-4b39-b216-b01cff9cddba could not be found. Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'a0608ad0-bdbd-4b39-b216-b01cff9cddba'} Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0608ad0-bdbd-4b39-b216-b01cff9cddba could not be found. Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0608ad0-bdbd-4b39-b216-b01cff9cddba could not be found. Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:10.158538 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:10.167944 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:10.167944 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:10.167944 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:10.167944 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:10.167944 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:10.167944 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:10.167944 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0608ad0-bdbd-4b39-b216-b01cff9cddba could not be found. Oct 04 20:47:10.167944 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:10.182819 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fceca48c-d764-4c44-a692-6f74d8402ee6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] Returning 404 to user: Instance a0608ad0-bdbd-4b39-b216-b01cff9cddba could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:10.185079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-feee0be2-f70e-4776-b85c-c143d297ac47 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:10.189259 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fceca48c-d764-4c44-a692-6f74d8402ee6 tempest-ServersAaction247Test-1698006710 tempest-ServersAaction247Test-1698006710-project] 10.222.0.78 "GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba" status: 404 len: 111 microversion: 2.47 time: 0.270755 Oct 04 20:47:10.190151 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-feee0be2-f70e-4776-b85c-c143d297ac47 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:10.199573 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 867/1746] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:09 2022] GET /compute/v2.1/servers/a0608ad0-bdbd-4b39-b216-b01cff9cddba => generated 111 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:47:10.234982 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-feee0be2-f70e-4776-b85c-c143d297ac47 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.238512 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-feee0be2-f70e-4776-b85c-c143d297ac47 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.242362 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-feee0be2-f70e-4776-b85c-c143d297ac47 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.250423 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-feee0be2-f70e-4776-b85c-c143d297ac47 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.250423 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-feee0be2-f70e-4776-b85c-c143d297ac47 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.250423 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-feee0be2-f70e-4776-b85c-c143d297ac47 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.577239 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-feee0be2-f70e-4776-b85c-c143d297ac47 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:10.609786 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-feee0be2-f70e-4776-b85c-c143d297ac47 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:10.617531 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-feee0be2-f70e-4776-b85c-c143d297ac47 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:10.634413 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-feee0be2-f70e-4776-b85c-c143d297ac47 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.456367 Oct 04 20:47:10.635562 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 880/1747] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:10 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:11.700604 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-104dc8c7-35ee-462d-856f-6a713c72bc7a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:11.701901 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-104dc8c7-35ee-462d-856f-6a713c72bc7a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:11.735978 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-104dc8c7-35ee-462d-856f-6a713c72bc7a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:11.737096 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-104dc8c7-35ee-462d-856f-6a713c72bc7a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:11.737879 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-104dc8c7-35ee-462d-856f-6a713c72bc7a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:11.739562 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-104dc8c7-35ee-462d-856f-6a713c72bc7a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:11.740435 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-104dc8c7-35ee-462d-856f-6a713c72bc7a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:11.760254 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-104dc8c7-35ee-462d-856f-6a713c72bc7a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:12.853787 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-104dc8c7-35ee-462d-856f-6a713c72bc7a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:12.885780 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-104dc8c7-35ee-462d-856f-6a713c72bc7a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:12.895760 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-104dc8c7-35ee-462d-856f-6a713c72bc7a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:12.902137 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-104dc8c7-35ee-462d-856f-6a713c72bc7a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 1.208116 Oct 04 20:47:12.908801 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 868/1748] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:11 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:13.967992 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9d9b8d4c-a728-4f09-aaee-f7eacac0b124 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:13.969278 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-9d9b8d4c-a728-4f09-aaee-f7eacac0b124 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:14.036354 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d9b8d4c-a728-4f09-aaee-f7eacac0b124 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:14.037387 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d9b8d4c-a728-4f09-aaee-f7eacac0b124 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:14.038120 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d9b8d4c-a728-4f09-aaee-f7eacac0b124 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:14.045616 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d9b8d4c-a728-4f09-aaee-f7eacac0b124 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:14.050118 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d9b8d4c-a728-4f09-aaee-f7eacac0b124 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:14.055239 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-9d9b8d4c-a728-4f09-aaee-f7eacac0b124 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:14.401916 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9d9b8d4c-a728-4f09-aaee-f7eacac0b124 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:14.430094 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9d9b8d4c-a728-4f09-aaee-f7eacac0b124 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:14.433393 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-9d9b8d4c-a728-4f09-aaee-f7eacac0b124 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:14.446018 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9d9b8d4c-a728-4f09-aaee-f7eacac0b124 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.485965 Oct 04 20:47:14.447626 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 881/1749] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:13 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:15.509489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-09d588bc-8e01-45f2-8b3a-5fd9d989919c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:15.510792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-09d588bc-8e01-45f2-8b3a-5fd9d989919c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:15.550774 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-09d588bc-8e01-45f2-8b3a-5fd9d989919c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.574942 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-09d588bc-8e01-45f2-8b3a-5fd9d989919c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.578880 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-09d588bc-8e01-45f2-8b3a-5fd9d989919c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:15.581239 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-09d588bc-8e01-45f2-8b3a-5fd9d989919c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.602141 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-09d588bc-8e01-45f2-8b3a-5fd9d989919c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.603740 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-09d588bc-8e01-45f2-8b3a-5fd9d989919c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:16.018032 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-09d588bc-8e01-45f2-8b3a-5fd9d989919c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:16.048349 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-09d588bc-8e01-45f2-8b3a-5fd9d989919c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:16.051987 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-09d588bc-8e01-45f2-8b3a-5fd9d989919c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:16.054807 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-09d588bc-8e01-45f2-8b3a-5fd9d989919c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.553361 Oct 04 20:47:16.063640 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 869/1750] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:15 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:17.139727 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e5180ac0-b0d2-408e-a1fa-c7f385577342 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:17.142986 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e5180ac0-b0d2-408e-a1fa-c7f385577342 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:17.170459 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e5180ac0-b0d2-408e-a1fa-c7f385577342 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:17.173697 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e5180ac0-b0d2-408e-a1fa-c7f385577342 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:17.175736 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e5180ac0-b0d2-408e-a1fa-c7f385577342 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:17.190321 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e5180ac0-b0d2-408e-a1fa-c7f385577342 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:17.191417 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e5180ac0-b0d2-408e-a1fa-c7f385577342 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:17.199210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e5180ac0-b0d2-408e-a1fa-c7f385577342 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:17.587598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e5180ac0-b0d2-408e-a1fa-c7f385577342 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:17.638178 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e5180ac0-b0d2-408e-a1fa-c7f385577342 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:17.663742 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e5180ac0-b0d2-408e-a1fa-c7f385577342 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:17.667269 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e5180ac0-b0d2-408e-a1fa-c7f385577342 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.555621 Oct 04 20:47:17.671326 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 882/1751] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:17 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:18.746605 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8a5aa7ed-52c5-4d79-8995-c3fe79ad1c95 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:18.747964 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8a5aa7ed-52c5-4d79-8995-c3fe79ad1c95 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:18.797079 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a5aa7ed-52c5-4d79-8995-c3fe79ad1c95 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:18.798063 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a5aa7ed-52c5-4d79-8995-c3fe79ad1c95 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:18.798877 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a5aa7ed-52c5-4d79-8995-c3fe79ad1c95 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:18.800278 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a5aa7ed-52c5-4d79-8995-c3fe79ad1c95 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:18.801155 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a5aa7ed-52c5-4d79-8995-c3fe79ad1c95 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:18.815047 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8a5aa7ed-52c5-4d79-8995-c3fe79ad1c95 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.266260 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8a5aa7ed-52c5-4d79-8995-c3fe79ad1c95 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:20.301287 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8a5aa7ed-52c5-4d79-8995-c3fe79ad1c95 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:20.307521 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8a5aa7ed-52c5-4d79-8995-c3fe79ad1c95 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:20.318310 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8a5aa7ed-52c5-4d79-8995-c3fe79ad1c95 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 1.586791 Oct 04 20:47:20.321074 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 870/1752] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:18 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:21.381509 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d8755d78-3d5b-484b-b1b9-a2a6babfa582 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:21.384987 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d8755d78-3d5b-484b-b1b9-a2a6babfa582 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:21.411580 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d8755d78-3d5b-484b-b1b9-a2a6babfa582 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:21.413029 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d8755d78-3d5b-484b-b1b9-a2a6babfa582 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:21.414363 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d8755d78-3d5b-484b-b1b9-a2a6babfa582 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:21.427160 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d8755d78-3d5b-484b-b1b9-a2a6babfa582 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:21.428644 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d8755d78-3d5b-484b-b1b9-a2a6babfa582 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:21.435829 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d8755d78-3d5b-484b-b1b9-a2a6babfa582 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:21.773252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d8755d78-3d5b-484b-b1b9-a2a6babfa582 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:21.826028 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d8755d78-3d5b-484b-b1b9-a2a6babfa582 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:21.837721 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d8755d78-3d5b-484b-b1b9-a2a6babfa582 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:21.848710 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d8755d78-3d5b-484b-b1b9-a2a6babfa582 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.475396 Oct 04 20:47:21.862718 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 883/1753] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:21 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:22.649295 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-58b0ee7a-9003-4619-b41f-5e7f606c13a0 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] Action: 'create', calling method: .version_select at 0x7f77eec291f0>, body: {"keypair": {"name": "tempest-keypair-2010384805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/NvepOb2CfMQ/idURew6hdZPBJZYnQZxNdS+vh57fUy6lrZVqJau/ioKf6x2EIE2bfdGAfBLUnva5jEtQK+2+KIzO3sqjw4LjNJTIlEF3WUkre98p15ObNy6Pxb0INDA=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:22.718803 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-58b0ee7a-9003-4619-b41f-5e7f606c13a0 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] Getting quotas for project 2afc6ef8dc874ff5ad52048c0ea409e2. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:22.731517 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-58b0ee7a-9003-4619-b41f-5e7f606c13a0 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] Getting quotas for user 3b15e8c511234609ac4c8549a748f73b and project 2afc6ef8dc874ff5ad52048c0ea409e2. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:22.923839 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e88a8460-d87e-40ee-b118-678002e2e041 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:22.925101 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e88a8460-d87e-40ee-b118-678002e2e041 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:22.938946 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-58b0ee7a-9003-4619-b41f-5e7f606c13a0 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.385661 Oct 04 20:47:22.951832 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 871/1754] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:47:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:47:22.991407 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e88a8460-d87e-40ee-b118-678002e2e041 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:22.992384 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e88a8460-d87e-40ee-b118-678002e2e041 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:22.993671 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e88a8460-d87e-40ee-b118-678002e2e041 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.995092 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e88a8460-d87e-40ee-b118-678002e2e041 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.000100 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e88a8460-d87e-40ee-b118-678002e2e041 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.001434 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e88a8460-d87e-40ee-b118-678002e2e041 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.374908 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e88a8460-d87e-40ee-b118-678002e2e041 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:23.405052 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e88a8460-d87e-40ee-b118-678002e2e041 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:23.408466 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e88a8460-d87e-40ee-b118-678002e2e041 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:23.411024 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e88a8460-d87e-40ee-b118-678002e2e041 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.495874 Oct 04 20:47:23.435202 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 884/1755] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:22 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:24.483129 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-89ddace8-6cbe-4236-b128-5de08faa3ae6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:24.486832 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-89ddace8-6cbe-4236-b128-5de08faa3ae6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:24.508962 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=42 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:24.530125 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-89ddace8-6cbe-4236-b128-5de08faa3ae6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.532530 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-89ddace8-6cbe-4236-b128-5de08faa3ae6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.536495 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-89ddace8-6cbe-4236-b128-5de08faa3ae6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.536495 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-89ddace8-6cbe-4236-b128-5de08faa3ae6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.537249 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-89ddace8-6cbe-4236-b128-5de08faa3ae6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.538473 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-89ddace8-6cbe-4236-b128-5de08faa3ae6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.740048 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f2010864-2d23-4195-93a3-650fbc010c97 tempest-ListServersNegativeTestJSON-381937197 tempest-ListServersNegativeTestJSON-381937197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-887569190", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7a0a3681-b4b5-4ca7-a8da-a06e2256c63b"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:24.898147 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-f2010864-2d23-4195-93a3-650fbc010c97 tempest-ListServersNegativeTestJSON-381937197 tempest-ListServersNegativeTestJSON-381937197-project] validate_networks() for [('7a0a3681-b4b5-4ca7-a8da-a06e2256c63b', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:47:24.984824 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-89ddace8-6cbe-4236-b128-5de08faa3ae6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:25.004857 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-89ddace8-6cbe-4236-b128-5de08faa3ae6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:25.009325 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-89ddace8-6cbe-4236-b128-5de08faa3ae6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:25.012586 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-89ddace8-6cbe-4236-b128-5de08faa3ae6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.544075 Oct 04 20:47:25.015671 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 885/1756] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:24 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-f2010864-2d23-4195-93a3-650fbc010c97 tempest-ListServersNegativeTestJSON-381937197 tempest-ListServersNegativeTestJSON-381937197-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-558affd5-cb73-4086-a9d3-40e73eeb7bd2) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:47:26.024593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-558affd5-cb73-4086-a9d3-40e73eeb7bd2) Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-f2010864-2d23-4195-93a3-650fbc010c97 tempest-ListServersNegativeTestJSON-381937197 tempest-ListServersNegativeTestJSON-381937197-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f2010864-2d23-4195-93a3-650fbc010c97 tempest-ListServersNegativeTestJSON-381937197 tempest-ListServersNegativeTestJSON-381937197-project] Request method failure captured: Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 228 Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJvb-m87AFqZaLJ7TB_VT7vk7xmW9nMBejBzSoHIRaNmscLXeOjCf0a2CY77Nzue_Owc2rRN-olMX0xIARwVtDvnTw4z-R8xwsz3RUCA-oOOJ5aGz6niZPBlTf_jhrUSEPZV-5pV698ALVCN8eLZgKzZZ4z0CemWI_QgEC7bnpQ53RU Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 5452397c0d2c44f2a98d71701462dcfd Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ListServersNegativeTestJSON-381937197 Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5452397c0d2c44f2a98d71701462dcfd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5452397c0d2c44f2a98d71701462dcfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5452397c0d2c44f2a98d71701462dcfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5452397c0d2c44f2a98d71701462dcfd"}]}] Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ListServersNegativeTestJSON-381937197 Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 5452397c0d2c44f2a98d71701462dcfd Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-381937197 Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ListServersNegativeTestJSON-381937197-project Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: f233341383994ae29d0b661faf734d82 Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ListServersNegativeTestJSON-381937197-project Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-887569190", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7a0a3681-b4b5-4ca7-a8da-a06e2256c63b"}]}} Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:47:26.039833 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ListServersNegativeTestJSON-server-887569190', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'min_count': 3, 'networks': [{'uuid': '7a0a3681-b4b5-4ca7-a8da-a06e2256c63b'}]}}} Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:47:26.049416 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-558affd5-cb73-4086-a9d3-40e73eeb7bd2) Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f2010864-2d23-4195-93a3-650fbc010c97 tempest-ListServersNegativeTestJSON-381937197 tempest-ListServersNegativeTestJSON-381937197-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f2010864-2d23-4195-93a3-650fbc010c97 tempest-ListServersNegativeTestJSON-381937197 tempest-ListServersNegativeTestJSON-381937197-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.707773 Oct 04 20:47:26.063997 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 872/1757] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:47:24 2022] POST /compute/v2.1/servers => generated 214 bytes in 1722 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:47:26.074582 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7e6371b9-ab12-4eb1-be01-f9b12bdd622d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:26.075739 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7e6371b9-ab12-4eb1-be01-f9b12bdd622d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:26.101125 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7e6371b9-ab12-4eb1-be01-f9b12bdd622d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:26.112769 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7e6371b9-ab12-4eb1-be01-f9b12bdd622d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:26.114003 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7e6371b9-ab12-4eb1-be01-f9b12bdd622d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:26.115447 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7e6371b9-ab12-4eb1-be01-f9b12bdd622d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:26.116363 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7e6371b9-ab12-4eb1-be01-f9b12bdd622d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:26.117201 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7e6371b9-ab12-4eb1-be01-f9b12bdd622d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:26.380155 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7e6371b9-ab12-4eb1-be01-f9b12bdd622d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:26.404733 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7e6371b9-ab12-4eb1-be01-f9b12bdd622d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:26.408173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7e6371b9-ab12-4eb1-be01-f9b12bdd622d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:26.421418 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7e6371b9-ab12-4eb1-be01-f9b12bdd622d tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1366 microversion: 2.47 time: 0.354227 Oct 04 20:47:26.430429 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 886/1758] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:26 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:27.500138 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c1f0e6bc-e893-4661-88bc-6871ba6cd337 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:27.501353 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c1f0e6bc-e893-4661-88bc-6871ba6cd337 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:27.555563 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:27.558251 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c1f0e6bc-e893-4661-88bc-6871ba6cd337 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:27.559756 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c1f0e6bc-e893-4661-88bc-6871ba6cd337 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:27.560849 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c1f0e6bc-e893-4661-88bc-6871ba6cd337 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:27.562584 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c1f0e6bc-e893-4661-88bc-6871ba6cd337 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:27.564159 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c1f0e6bc-e893-4661-88bc-6871ba6cd337 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:27.565191 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c1f0e6bc-e893-4661-88bc-6871ba6cd337 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:28.218329 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c1f0e6bc-e893-4661-88bc-6871ba6cd337 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:28.255798 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c1f0e6bc-e893-4661-88bc-6871ba6cd337 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:28.267228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c1f0e6bc-e893-4661-88bc-6871ba6cd337 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:28.274651 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c1f0e6bc-e893-4661-88bc-6871ba6cd337 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1372 microversion: 2.47 time: 0.779867 Oct 04 20:47:28.300169 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 873/1759] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:27 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1372 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:29.355886 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f048d7ab-5e65-4aac-976e-b7ecf65f419f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:29.357623 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f048d7ab-5e65-4aac-976e-b7ecf65f419f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:29.377137 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f048d7ab-5e65-4aac-976e-b7ecf65f419f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:29.394877 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f048d7ab-5e65-4aac-976e-b7ecf65f419f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:29.394877 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f048d7ab-5e65-4aac-976e-b7ecf65f419f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:29.397286 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f048d7ab-5e65-4aac-976e-b7ecf65f419f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:29.399185 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f048d7ab-5e65-4aac-976e-b7ecf65f419f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:29.400629 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f048d7ab-5e65-4aac-976e-b7ecf65f419f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:30.953415 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f048d7ab-5e65-4aac-976e-b7ecf65f419f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:31.000916 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f048d7ab-5e65-4aac-976e-b7ecf65f419f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:31.021509 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f048d7ab-5e65-4aac-976e-b7ecf65f419f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:31.032739 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f048d7ab-5e65-4aac-976e-b7ecf65f419f tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1372 microversion: 2.47 time: 1.703730 Oct 04 20:47:31.039600 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 887/1760] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:29 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1372 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:32.104455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-23b62a73-e64b-4ae1-a48f-6fa22c10bc41 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:32.109501 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-23b62a73-e64b-4ae1-a48f-6fa22c10bc41 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:32.166450 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-23b62a73-e64b-4ae1-a48f-6fa22c10bc41 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:32.169592 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-23b62a73-e64b-4ae1-a48f-6fa22c10bc41 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:32.170717 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-23b62a73-e64b-4ae1-a48f-6fa22c10bc41 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:32.172767 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-23b62a73-e64b-4ae1-a48f-6fa22c10bc41 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:32.177063 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-23b62a73-e64b-4ae1-a48f-6fa22c10bc41 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:32.177974 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-23b62a73-e64b-4ae1-a48f-6fa22c10bc41 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:32.496517 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-23b62a73-e64b-4ae1-a48f-6fa22c10bc41 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:32.525049 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-23b62a73-e64b-4ae1-a48f-6fa22c10bc41 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:32.528459 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-23b62a73-e64b-4ae1-a48f-6fa22c10bc41 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:32.530934 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-23b62a73-e64b-4ae1-a48f-6fa22c10bc41 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1372 microversion: 2.47 time: 0.443784 Oct 04 20:47:32.547755 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 874/1761] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:32 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1372 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:33.626758 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b1bb942f-a1c6-4d18-a71b-647adc48ab0c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:33.630855 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b1bb942f-a1c6-4d18-a71b-647adc48ab0c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:33.670129 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b1bb942f-a1c6-4d18-a71b-647adc48ab0c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.689270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b1bb942f-a1c6-4d18-a71b-647adc48ab0c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.689270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b1bb942f-a1c6-4d18-a71b-647adc48ab0c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.689270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b1bb942f-a1c6-4d18-a71b-647adc48ab0c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.691694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b1bb942f-a1c6-4d18-a71b-647adc48ab0c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.691694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b1bb942f-a1c6-4d18-a71b-647adc48ab0c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.343559 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b1bb942f-a1c6-4d18-a71b-647adc48ab0c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:35.388482 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b1bb942f-a1c6-4d18-a71b-647adc48ab0c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:35.392922 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b1bb942f-a1c6-4d18-a71b-647adc48ab0c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:35.405764 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b1bb942f-a1c6-4d18-a71b-647adc48ab0c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1357 microversion: 2.47 time: 1.814680 Oct 04 20:47:35.418208 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 888/1762] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:33 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1357 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:35.501864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:35.568562 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:35.572441 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Searching by: {'deleted': False, 'project_id': '0bda882a4cd446619c42073bf0aec919'} {{(pid=123540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:47:35.582472 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:35.587527 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.588977 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.590102 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.609180 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.610625 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.611798 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:36.134619 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.multi_cell_list [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:47:36.554165 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:36.587285 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:36.589042 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:36.590535 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:36.646441 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:36.651771 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:36.973612 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f8329938-dca6-450a-9e0a-def3c4dbde74 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 1.493066 Oct 04 20:47:37.008709 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 875/1763] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Oct 4 20:47:35 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:37.050336 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-728403ac-0268-43d5-a9e0-00698c3cf3f6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:37.052303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-728403ac-0268-43d5-a9e0-00698c3cf3f6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:37.067280 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-728403ac-0268-43d5-a9e0-00698c3cf3f6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.068923 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-728403ac-0268-43d5-a9e0-00698c3cf3f6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.070600 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-728403ac-0268-43d5-a9e0-00698c3cf3f6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.074584 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-728403ac-0268-43d5-a9e0-00698c3cf3f6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.076573 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-728403ac-0268-43d5-a9e0-00698c3cf3f6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.079663 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-728403ac-0268-43d5-a9e0-00698c3cf3f6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.088041 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=72 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:37.155558 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-728403ac-0268-43d5-a9e0-00698c3cf3f6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:38.400319 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-728403ac-0268-43d5-a9e0-00698c3cf3f6 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 204 len: 0 microversion: 2.47 time: 1.364275 Oct 04 20:47:38.401706 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 889/1764] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:47:37 2022] DELETE /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 0 bytes in 1368 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:47:38.420656 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-295fc8cd-f486-4fff-bc91-7b8c6c2a067a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:38.423611 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-295fc8cd-f486-4fff-bc91-7b8c6c2a067a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:38.439074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-295fc8cd-f486-4fff-bc91-7b8c6c2a067a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:38.440483 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-295fc8cd-f486-4fff-bc91-7b8c6c2a067a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:38.441560 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-295fc8cd-f486-4fff-bc91-7b8c6c2a067a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:38.443274 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-295fc8cd-f486-4fff-bc91-7b8c6c2a067a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:38.444616 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-295fc8cd-f486-4fff-bc91-7b8c6c2a067a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:38.447395 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-295fc8cd-f486-4fff-bc91-7b8c6c2a067a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:38.770387 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-295fc8cd-f486-4fff-bc91-7b8c6c2a067a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:38.808536 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-295fc8cd-f486-4fff-bc91-7b8c6c2a067a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:38.815774 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-295fc8cd-f486-4fff-bc91-7b8c6c2a067a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:38.826000 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-295fc8cd-f486-4fff-bc91-7b8c6c2a067a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1363 microversion: 2.47 time: 0.416399 Oct 04 20:47:38.830671 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 876/1765] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:38 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:39.888382 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8b1931ad-5788-4d29-baa4-9d6e6e85b2a8 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:39.894893 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8b1931ad-5788-4d29-baa4-9d6e6e85b2a8 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:39.915500 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8b1931ad-5788-4d29-baa4-9d6e6e85b2a8 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.917036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8b1931ad-5788-4d29-baa4-9d6e6e85b2a8 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.918028 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8b1931ad-5788-4d29-baa4-9d6e6e85b2a8 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.922192 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8b1931ad-5788-4d29-baa4-9d6e6e85b2a8 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.923227 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8b1931ad-5788-4d29-baa4-9d6e6e85b2a8 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.924488 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8b1931ad-5788-4d29-baa4-9d6e6e85b2a8 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:41.350178 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8b1931ad-5788-4d29-baa4-9d6e6e85b2a8 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:41.399649 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8b1931ad-5788-4d29-baa4-9d6e6e85b2a8 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:41.412310 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8b1931ad-5788-4d29-baa4-9d6e6e85b2a8 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:41.419693 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8b1931ad-5788-4d29-baa4-9d6e6e85b2a8 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1363 microversion: 2.47 time: 1.538125 Oct 04 20:47:41.420579 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 890/1766] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:39 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1363 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:41.554412 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-109a9289-55ad-464f-bc52-20dfea1c35b9 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1223664916", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5eb8650f-28b1-4a3f-b09a-60bc7b73dc5d"}], "security_groups": [{"name": "tempest-securitygroup--2009966976"}], "key_name": "tempest-keypair-2010384805", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:42.043478 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:47:42.043889 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 20:47:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 20:47:42.401169 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-109a9289-55ad-464f-bc52-20dfea1c35b9 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] validate_networks() for [('5eb8650f-28b1-4a3f-b09a-60bc7b73dc5d', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:47:42.485188 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8651a139-fe77-4825-be12-b6f55543bf8c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:42.486044 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8651a139-fe77-4825-be12-b6f55543bf8c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:42.512995 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8651a139-fe77-4825-be12-b6f55543bf8c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.513646 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8651a139-fe77-4825-be12-b6f55543bf8c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.514347 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8651a139-fe77-4825-be12-b6f55543bf8c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.515183 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8651a139-fe77-4825-be12-b6f55543bf8c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.523681 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8651a139-fe77-4825-be12-b6f55543bf8c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.524494 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8651a139-fe77-4825-be12-b6f55543bf8c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.315005 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8651a139-fe77-4825-be12-b6f55543bf8c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:43.348107 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8651a139-fe77-4825-be12-b6f55543bf8c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:43.377178 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8651a139-fe77-4825-be12-b6f55543bf8c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:43.381692 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8651a139-fe77-4825-be12-b6f55543bf8c tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 200 len: 1363 microversion: 2.47 time: 0.900936 Oct 04 20:47:43.402588 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 891/1767] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:42 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 1363 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-109a9289-55ad-464f-bc52-20dfea1c35b9 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de7a6fc6-299d-48d1-92ae-1cd34155b4a5) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:47:44.160823 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de7a6fc6-299d-48d1-92ae-1cd34155b4a5) Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-109a9289-55ad-464f-bc52-20dfea1c35b9 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:47:44.167883 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-109a9289-55ad-464f-bc52-20dfea1c35b9 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] Request method failure captured: Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 641 Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJvZS1fbiEF7aBFxG1Q3o6P72TGJOUfzMlU_vAHxmwePXOVZIxiN2wdlxT7EqmiABrEs0509Knv0f9B15ZQa08fjLp_Q5L6wslkbUwcYfvPZfXjtnH3s_5EQ58K7UWTXHXx7dnZJU7ilF1U0NMxN8lagYMmwti-7QFU4oHi_Tng8INg Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 2afc6ef8dc874ff5ad52048c0ea409e2 Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersTestManualDisk-928586094 Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2afc6ef8dc874ff5ad52048c0ea409e2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2afc6ef8dc874ff5ad52048c0ea409e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2afc6ef8dc874ff5ad52048c0ea409e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2afc6ef8dc874ff5ad52048c0ea409e2"}]}] Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersTestManualDisk-928586094 Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 2afc6ef8dc874ff5ad52048c0ea409e2 Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersTestManualDisk-928586094 Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersTestManualDisk-928586094-project Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 3b15e8c511234609ac4c8549a748f73b Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersTestManualDisk-928586094-project Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServersTestManualDisk-server-1223664916", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "D1_LFLkC9pMgK4b", "networks": [{"uuid": "5eb8650f-28b1-4a3f-b09a-60bc7b73dc5d"}], "security_groups": [{"name": "tempest-securitygroup--2009966976"}], "key_name": "tempest-keypair-2010384805", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "MANUAL"}} Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServersTestManualDisk-server-1223664916', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'D1_LFLkC9pMgK4b', 'networks': [{'uuid': '5eb8650f-28b1-4a3f-b09a-60bc7b73dc5d'}], 'security_groups': [{'name': 'tempest-securitygroup--2009966976'}], 'key_name': 'tempest-keypair-2010384805', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:47:44.171663 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de7a6fc6-299d-48d1-92ae-1cd34155b4a5) Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.177536 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.184701 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.204580 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-109a9289-55ad-464f-bc52-20dfea1c35b9 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:47:44.204580 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:44.209148 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-109a9289-55ad-464f-bc52-20dfea1c35b9 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.671303 Oct 04 20:47:44.213222 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 877/1768] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:47:41 2022] POST /compute/v2.1/servers => generated 214 bytes in 2677 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:47:44.229922 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-63acb4f0-06dd-416f-b01e-8e9612087342 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] Calling method '.version_select at 0x7f77eefd9940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:44.411363 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-63acb4f0-06dd-416f-b01e-8e9612087342 tempest-ServersTestManualDisk-928586094 tempest-ServersTestManualDisk-928586094-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010384805" status: 202 len: 0 microversion: 2.1 time: 0.190342 Oct 04 20:47:44.412963 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 892/1769] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010384805 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:47:44.441115 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-479695e4-9649-4565-b62a-fc5a9caa9f67 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:44.442079 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-479695e4-9649-4565-b62a-fc5a9caa9f67 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 7372fc97-e79b-446c-85ce-95b39f56b697] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:44.465333 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-479695e4-9649-4565-b62a-fc5a9caa9f67 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.466786 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-479695e4-9649-4565-b62a-fc5a9caa9f67 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.467938 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-479695e4-9649-4565-b62a-fc5a9caa9f67 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.469804 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-479695e4-9649-4565-b62a-fc5a9caa9f67 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.474187 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-479695e4-9649-4565-b62a-fc5a9caa9f67 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.475298 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-479695e4-9649-4565-b62a-fc5a9caa9f67 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.484999 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=53 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:44.530033 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-479695e4-9649-4565-b62a-fc5a9caa9f67 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] HTTP exception thrown: Instance 7372fc97-e79b-446c-85ce-95b39f56b697 could not be found. Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-479695e4-9649-4565-b62a-fc5a9caa9f67 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Request method failure captured: Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 HTTP/1.1 Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJuqnRwnBsnp7vDPb57G3Cl1SfkPbR1k3pEK0hQASFXKioUvERCSb4XXKkuh9FBgJryeCny69rfloYRP8QaL3fkBnBY9oeV9mOrDpdAqERwygyXdoZ6blxgKMo3F9_jXAONHU2Lv33PYEnZ7d1fhnexrSHeHPJZcRRo8nUI0qp_utHo Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 0bda882a4cd446619c42073bf0aec919 Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerShowV247Test-279755118 Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0bda882a4cd446619c42073bf0aec919", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0bda882a4cd446619c42073bf0aec919"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0bda882a4cd446619c42073bf0aec919"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0bda882a4cd446619c42073bf0aec919"}]}] Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerShowV247Test-279755118 Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 0bda882a4cd446619c42073bf0aec919 Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerShowV247Test-279755118 Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerShowV247Test-279755118-project Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 06009ef2882e401f82f8858e5b816f4a Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerShowV247Test-279755118-project Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 7372fc97-e79b-446c-85ce-95b39f56b697 could not be found. Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '7372fc97-e79b-446c-85ce-95b39f56b697'} Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7372fc97-e79b-446c-85ce-95b39f56b697 could not be found. Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7372fc97-e79b-446c-85ce-95b39f56b697 could not be found. Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:44.539585 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.555606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:44.555606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:44.555606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:44.555606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:44.555606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:44.555606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7372fc97-e79b-446c-85ce-95b39f56b697 could not be found. Oct 04 20:47:44.555606 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:44.560317 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-479695e4-9649-4565-b62a-fc5a9caa9f67 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Returning 404 to user: Instance 7372fc97-e79b-446c-85ce-95b39f56b697 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:44.563433 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-479695e4-9649-4565-b62a-fc5a9caa9f67 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697" status: 404 len: 111 microversion: 2.47 time: 0.132948 Oct 04 20:47:44.570146 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 878/1770] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:44 2022] GET /compute/v2.1/servers/7372fc97-e79b-446c-85ce-95b39f56b697 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:47:44.583282 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cff23e57-884f-47d2-a02e-d5955bbc09f2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:44.586971 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cff23e57-884f-47d2-a02e-d5955bbc09f2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 9019f887-5690-4833-b69b-879c91f3e6c1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:44.625739 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cff23e57-884f-47d2-a02e-d5955bbc09f2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.630826 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cff23e57-884f-47d2-a02e-d5955bbc09f2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.632214 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cff23e57-884f-47d2-a02e-d5955bbc09f2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.637316 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cff23e57-884f-47d2-a02e-d5955bbc09f2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.640153 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cff23e57-884f-47d2-a02e-d5955bbc09f2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.643572 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cff23e57-884f-47d2-a02e-d5955bbc09f2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.763852 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cff23e57-884f-47d2-a02e-d5955bbc09f2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 9019f887-5690-4833-b69b-879c91f3e6c1] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:45.314032 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cff23e57-884f-47d2-a02e-d5955bbc09f2 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1" status: 204 len: 0 microversion: 2.47 time: 0.736885 Oct 04 20:47:45.315177 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 893/1771] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:47:44 2022] DELETE /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 20:47:45.328794 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c6b65cc8-448e-4ab0-a634-82aa6c8699ac tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:45.331899 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c6b65cc8-448e-4ab0-a634-82aa6c8699ac tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 9019f887-5690-4833-b69b-879c91f3e6c1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:45.372126 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c6b65cc8-448e-4ab0-a634-82aa6c8699ac tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:45.377735 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c6b65cc8-448e-4ab0-a634-82aa6c8699ac tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:45.382150 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c6b65cc8-448e-4ab0-a634-82aa6c8699ac tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:45.385275 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c6b65cc8-448e-4ab0-a634-82aa6c8699ac tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:45.391087 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c6b65cc8-448e-4ab0-a634-82aa6c8699ac tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:45.394282 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c6b65cc8-448e-4ab0-a634-82aa6c8699ac tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:45.832812 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:46.081822 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c6b65cc8-448e-4ab0-a634-82aa6c8699ac tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:46.117192 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c6b65cc8-448e-4ab0-a634-82aa6c8699ac tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:46.125387 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c6b65cc8-448e-4ab0-a634-82aa6c8699ac tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:46.133398 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c6b65cc8-448e-4ab0-a634-82aa6c8699ac tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1" status: 200 len: 1363 microversion: 2.47 time: 0.811890 Oct 04 20:47:46.135076 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 879/1772] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:45 2022] GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1 => generated 1363 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:47.208706 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-20e0a7d1-89c1-4a78-90da-8589c30060f3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:47.213069 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-20e0a7d1-89c1-4a78-90da-8589c30060f3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 9019f887-5690-4833-b69b-879c91f3e6c1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:47.272323 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20e0a7d1-89c1-4a78-90da-8589c30060f3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.273830 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20e0a7d1-89c1-4a78-90da-8589c30060f3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.277557 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20e0a7d1-89c1-4a78-90da-8589c30060f3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.283694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20e0a7d1-89c1-4a78-90da-8589c30060f3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.286030 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20e0a7d1-89c1-4a78-90da-8589c30060f3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.288958 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20e0a7d1-89c1-4a78-90da-8589c30060f3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.739407 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-20e0a7d1-89c1-4a78-90da-8589c30060f3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.767707 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-20e0a7d1-89c1-4a78-90da-8589c30060f3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.774899 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-20e0a7d1-89c1-4a78-90da-8589c30060f3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.778024 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-20e0a7d1-89c1-4a78-90da-8589c30060f3 tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1" status: 200 len: 1363 microversion: 2.47 time: 0.587677 Oct 04 20:47:47.781756 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 894/1773] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:47 2022] GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1 => generated 1363 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:48.856214 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e4bdb90f-5045-461f-ab9b-e0cf5f53764a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:48.861342 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e4bdb90f-5045-461f-ab9b-e0cf5f53764a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 9019f887-5690-4833-b69b-879c91f3e6c1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:48.890727 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:48.901153 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e4bdb90f-5045-461f-ab9b-e0cf5f53764a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.902375 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e4bdb90f-5045-461f-ab9b-e0cf5f53764a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.903570 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e4bdb90f-5045-461f-ab9b-e0cf5f53764a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.910357 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e4bdb90f-5045-461f-ab9b-e0cf5f53764a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.923300 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e4bdb90f-5045-461f-ab9b-e0cf5f53764a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.924562 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e4bdb90f-5045-461f-ab9b-e0cf5f53764a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:49.389373 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e4bdb90f-5045-461f-ab9b-e0cf5f53764a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:49.434432 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e4bdb90f-5045-461f-ab9b-e0cf5f53764a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:49.448385 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e4bdb90f-5045-461f-ab9b-e0cf5f53764a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:49.450826 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e4bdb90f-5045-461f-ab9b-e0cf5f53764a tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1" status: 200 len: 1363 microversion: 2.47 time: 0.619564 Oct 04 20:47:49.479234 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 880/1774] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:48 2022] GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1 => generated 1363 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:50.532884 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:50.540280 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 9019f887-5690-4833-b69b-879c91f3e6c1] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:50.615324 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.623685 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.624622 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.626097 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.631848 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.632803 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.966822 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.976807 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.977809 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.980971 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lazy-loading 'fault' on Instance uuid 9019f887-5690-4833-b69b-879c91f3e6c1 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:51.690642 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:51.747397 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:51.755801 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06009ef2882e401f82f8858e5b816f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bda882a4cd446619c42073bf0aec919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:51.765624 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-152afa78-6ce4-4739-9238-cb829f12f5af tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1" status: 200 len: 1368 microversion: 2.47 time: 1.247278 Oct 04 20:47:51.773671 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 895/1775] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:50 2022] GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1 => generated 1368 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:52.838052 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4eb05ad4-e855-4182-af01-ff0038dd7d2e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:52.841674 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4eb05ad4-e855-4182-af01-ff0038dd7d2e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] [instance: 9019f887-5690-4833-b69b-879c91f3e6c1] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:52.867284 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4eb05ad4-e855-4182-af01-ff0038dd7d2e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.868147 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4eb05ad4-e855-4182-af01-ff0038dd7d2e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.868953 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4eb05ad4-e855-4182-af01-ff0038dd7d2e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.871325 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4eb05ad4-e855-4182-af01-ff0038dd7d2e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.880948 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4eb05ad4-e855-4182-af01-ff0038dd7d2e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.882219 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4eb05ad4-e855-4182-af01-ff0038dd7d2e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.925328 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-4eb05ad4-e855-4182-af01-ff0038dd7d2e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] HTTP exception thrown: Instance 9019f887-5690-4833-b69b-879c91f3e6c1 could not be found. Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4eb05ad4-e855-4182-af01-ff0038dd7d2e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Request method failure captured: Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1 HTTP/1.1 Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJuqnRwnBsnp7vDPb57G3Cl1SfkPbR1k3pEK0hQASFXKioUvERCSb4XXKkuh9FBgJryeCny69rfloYRP8QaL3fkBnBY9oeV9mOrDpdAqERwygyXdoZ6blxgKMo3F9_jXAONHU2Lv33PYEnZ7d1fhnexrSHeHPJZcRRo8nUI0qp_utHo Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 0bda882a4cd446619c42073bf0aec919 Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerShowV247Test-279755118 Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0bda882a4cd446619c42073bf0aec919", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0bda882a4cd446619c42073bf0aec919"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0bda882a4cd446619c42073bf0aec919"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0bda882a4cd446619c42073bf0aec919"}]}] Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerShowV247Test-279755118 Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 0bda882a4cd446619c42073bf0aec919 Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerShowV247Test-279755118 Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerShowV247Test-279755118-project Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 06009ef2882e401f82f8858e5b816f4a Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerShowV247Test-279755118-project Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 9019f887-5690-4833-b69b-879c91f3e6c1 could not be found. Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '9019f887-5690-4833-b69b-879c91f3e6c1'} Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9019f887-5690-4833-b69b-879c91f3e6c1 could not be found. Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9019f887-5690-4833-b69b-879c91f3e6c1 could not be found. Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:52.929099 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:52.937773 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:52.937773 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:52.937773 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:52.937773 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:52.937773 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:52.937773 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9019f887-5690-4833-b69b-879c91f3e6c1 could not be found. Oct 04 20:47:52.937773 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:47:52.940294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4eb05ad4-e855-4182-af01-ff0038dd7d2e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] Returning 404 to user: Instance 9019f887-5690-4833-b69b-879c91f3e6c1 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:52.942341 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4eb05ad4-e855-4182-af01-ff0038dd7d2e tempest-ServerShowV247Test-279755118 tempest-ServerShowV247Test-279755118-project] 10.222.0.78 "GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1" status: 404 len: 111 microversion: 2.47 time: 0.111746 Oct 04 20:47:52.948845 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 881/1776] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:52 2022] GET /compute/v2.1/servers/9019f887-5690-4833-b69b-879c91f3e6c1 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:47:56.726383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ea94a31a-01dd-4893-9f10-d25373fec900 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] Action: 'create', calling method: .version_select at 0x7f77eefd53a0>, body: {"keypair": {"name": "tempest-keypair-1499190480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASUHfnArNMEq3PdD5y+GAAcNYZH0pX/GFTUaSxtJCP+ejH2n/ndHjHAoGRO5vO7L6eMNJ6JJJlS4V8ShUy0gvkvhWoNLtx6nlCAq+j1Ael95QykbT5D+NmZtlfVqwA+5g=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:56.758565 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:56.834002 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-ea94a31a-01dd-4893-9f10-d25373fec900 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] Getting quotas for project cfa8bdf2eb414417a0ee4e64f7932019. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:56.849074 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-ea94a31a-01dd-4893-9f10-d25373fec900 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] Getting quotas for user 895545f1707940e4a10fbfc84253d705 and project cfa8bdf2eb414417a0ee4e64f7932019. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:56.990507 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ea94a31a-01dd-4893-9f10-d25373fec900 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.665191 Oct 04 20:47:57.015741 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 896/1777] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:47:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:59.307690 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-388dbd7b-9028-4945-b9e6-6a6f392b11ae tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77eebc88b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1257594268", "description": "tempest-description-1624896974"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:01.224836 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-388dbd7b-9028-4945-b9e6-6a6f392b11ae tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 2.306581 Oct 04 20:48:01.226062 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 882/1778] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:47:58 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 2309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:48:01.265279 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-41761d11-a831-4c6c-98bd-22cbab2d6e83 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77ef162dc0>, body: {"security_group_rule": {"parent_group_id": "79d64924-8f9c-406d-8ab2-243692f331dd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:01.718530 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:03.481573 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-41761d11-a831-4c6c-98bd-22cbab2d6e83 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.227750 Oct 04 20:48:03.485036 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 897/1779] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:48:01 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:48:03.514079 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-58573282-323f-4f77-b832-56d38230b28b tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77f74c50d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1189776917", "description": "tempest-description-229635045"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:03.560234 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=21 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:03.582955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=15 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:06.308877 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-58573282-323f-4f77-b832-56d38230b28b tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.805796 Oct 04 20:48:06.317682 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 883/1780] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:06.346864 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-80244cf6-d6d7-45be-aabc-70a429f30a7d tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77eef7fe50>, body: {"security_group_rule": {"parent_group_id": "9fca0543-5be4-4728-b28b-c49181800804", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:06.907832 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:07.435487 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a226772e-168c-4522-bb04-a7561798e354 tempest-ServerAddressesTestJSON-392328723 tempest-ServerAddressesTestJSON-392328723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-6442476", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "ff423222-41b0-48ee-a580-97808d89e865"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:07.746256 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-a226772e-168c-4522-bb04-a7561798e354 tempest-ServerAddressesTestJSON-392328723 tempest-ServerAddressesTestJSON-392328723-project] validate_networks() for [('ff423222-41b0-48ee-a580-97808d89e865', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:48:10.567761 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-80244cf6-d6d7-45be-aabc-70a429f30a7d tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 4.232689 Oct 04 20:48:10.579277 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 898/1781] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:48:06 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 4237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:10.596156 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a229302f-03c1-40f1-a96c-59362ec36bd8 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77ef15c280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1572618405", "description": "tempest-description-95227566"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-a226772e-168c-4522-bb04-a7561798e354 tempest-ServerAddressesTestJSON-392328723 tempest-ServerAddressesTestJSON-392328723-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-af567394-3f1d-462d-b773-63423989151a) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:48:11.047949 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-af567394-3f1d-462d-b773-63423989151a) Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-a226772e-168c-4522-bb04-a7561798e354 tempest-ServerAddressesTestJSON-392328723 tempest-ServerAddressesTestJSON-392328723-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a226772e-168c-4522-bb04-a7561798e354 tempest-ServerAddressesTestJSON-392328723 tempest-ServerAddressesTestJSON-392328723-project] Request method failure captured: Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 206 Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJwFM8XbJzS5O-GLfzzw0MH6HrUFHXtofXqRrEAe7yjwGFo0vQU9hmYZl5jZzxteygF6cGql63m7p08N26kKWKxJ6wJsLTW17gn83yyorKzatAyAiHwi4q5MrfmJcYzAN8NnOqqWMBs8mL_QfcncGz4B70u0yUcOWGfHGBSWkovqgtA Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: ce3823a32e454504b467aa845688fc46 Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerAddressesTestJSON-392328723 Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ce3823a32e454504b467aa845688fc46", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ce3823a32e454504b467aa845688fc46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ce3823a32e454504b467aa845688fc46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ce3823a32e454504b467aa845688fc46"}]}] Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerAddressesTestJSON-392328723 Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: ce3823a32e454504b467aa845688fc46 Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerAddressesTestJSON-392328723 Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerAddressesTestJSON-392328723-project Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 806303426c474dbda5f6d91022dce7cb Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerAddressesTestJSON-392328723-project Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServerAddressesTestJSON-server-6442476", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "ff423222-41b0-48ee-a580-97808d89e865"}]}} Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServerAddressesTestJSON-server-6442476', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'ff423222-41b0-48ee-a580-97808d89e865'}]}}} Oct 04 20:48:11.056845 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:48:11.069835 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-af567394-3f1d-462d-b773-63423989151a) Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a226772e-168c-4522-bb04-a7561798e354 tempest-ServerAddressesTestJSON-392328723 tempest-ServerAddressesTestJSON-392328723-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a226772e-168c-4522-bb04-a7561798e354 tempest-ServerAddressesTestJSON-392328723 tempest-ServerAddressesTestJSON-392328723-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 4.517081 Oct 04 20:48:11.083300 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 884/1782] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:48:06 2022] POST /compute/v2.1/servers => generated 214 bytes in 4520 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:48:11.338790 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:13.044412 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a229302f-03c1-40f1-a96c-59362ec36bd8 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 2.453519 Oct 04 20:48:13.044412 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 899/1783] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:10 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 2456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:13.063955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fd40cfec-cdce-4176-93e2-68edbc75dea9 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77eec975e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1336978250", "description": "tempest-description-1962528522"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:14.570761 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fd40cfec-cdce-4176-93e2-68edbc75dea9 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.512855 Oct 04 20:48:14.577732 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 885/1784] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:13 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:14.598435 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f4ec9102-77f6-4788-b5f4-9ca88fe4b908 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77ef162af0>, body: {"security_group_rule": {"parent_group_id": "8877ad4f-cdca-4f74-aabb-d860aef0ce89", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "199bc653-37bf-4555-a2da-7688e88168d5"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:17.181610 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f4ec9102-77f6-4788-b5f4-9ca88fe4b908 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 2.587156 Oct 04 20:48:17.194126 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 900/1785] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:48:14 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 2601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:17.214882 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-228cb360-c143-4789-912e-bb681ea5030a tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77eeb0f8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2107630295", "description": "tempest-description-771791058"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:17.587174 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:18.764560 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-228cb360-c143-4789-912e-bb681ea5030a tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.563238 Oct 04 20:48:18.782855 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 886/1786] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:17 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:18.786655 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-17395e74-4cf6-433a-a0c3-3616aff9d7cb tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77eee760d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-455272013", "description": "tempest-description-455025358"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:21.640187 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-17395e74-4cf6-433a-a0c3-3616aff9d7cb tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 2.862012 Oct 04 20:48:21.642520 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 901/1787] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:18 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 2866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:21.668924 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d3815f6e-98e6-4c19-a873-837ae99579f7 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77f7331040>, body: {"security_group_rule": {"parent_group_id": "1aed740b-a268-487c-b4f3-df02991ddbcc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "6ceef318-ae40-4d84-bb52-19926e472aef"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:24.478883 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d3815f6e-98e6-4c19-a873-837ae99579f7 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 2.818401 Oct 04 20:48:24.482488 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 887/1788] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:48:21 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 2825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:24.525451 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-adb0ae82-ffdf-4ff2-b543-c25f6bd048d2 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Calling method '.version_select at 0x7f77eef7f9d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:26.171969 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-adb0ae82-ffdf-4ff2-b543-c25f6bd048d2 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/6ceef318-ae40-4d84-bb52-19926e472aef" status: 202 len: 0 microversion: 2.1 time: 1.673205 Oct 04 20:48:26.178758 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 902/1789] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:24 2022] DELETE /compute/v2.1/os-security-groups/6ceef318-ae40-4d84-bb52-19926e472aef => generated 0 bytes in 1677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:26.189834 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e568f7a7-41fe-476b-a312-1413a18b08bf tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Calling method '.version_select at 0x7f77f73f6f70>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:26.927932 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e568f7a7-41fe-476b-a312-1413a18b08bf tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/1aed740b-a268-487c-b4f3-df02991ddbcc" status: 200 len: 247 microversion: 2.1 time: 0.746021 Oct 04 20:48:26.929932 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 888/1790] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:48:26 2022] GET /compute/v2.1/os-security-groups/1aed740b-a268-487c-b4f3-df02991ddbcc => generated 247 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:26.972901 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a63f653d-20e7-4d72-8916-da16f0cb80b2 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77ef162430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-941025707", "description": "tempest-description-1445401268"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:29.011455 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a63f653d-20e7-4d72-8916-da16f0cb80b2 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.055836 Oct 04 20:48:29.011455 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 903/1791] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:26 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:29.033006 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-25c99d25-19ae-47ac-ab42-af7415ddf65a tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77eeb0f820>, body: {"security_group_rule": {"parent_group_id": "c4438861-d5c8-41cf-b804-249cab100bd8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:32.444371 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-25c99d25-19ae-47ac-ab42-af7415ddf65a tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 3.418072 Oct 04 20:48:32.447275 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 889/1792] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:48:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 3421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:32.472174 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-75795366-6f9d-457b-abb9-a209a72510e3 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Action: 'create', calling method: .version_select at 0x7f77eef63f70>, body: {"security_group_rule": {"parent_group_id": "c4438861-d5c8-41cf-b804-249cab100bd8", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:36.038928 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-75795366-6f9d-457b-abb9-a209a72510e3 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 3.575036 Oct 04 20:48:36.051587 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 904/1793] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Oct 4 20:48:32 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 3588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:36.073572 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cf007583-26b2-4323-9c9d-b5d4da7fb6e5 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Calling method '.version_select at 0x7f77eecc1a60>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:37.140217 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cf007583-26b2-4323-9c9d-b5d4da7fb6e5 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/c4438861-d5c8-41cf-b804-249cab100bd8" status: 200 len: 664 microversion: 2.1 time: 1.085315 Oct 04 20:48:37.143209 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 890/1794] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:48:36 2022] GET /compute/v2.1/os-security-groups/c4438861-d5c8-41cf-b804-249cab100bd8 => generated 664 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:37.170014 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4376dc44-3e60-416a-b409-8719252a89d8 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Calling method '.version_select at 0x7f77eef7faf0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:38.909109 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4376dc44-3e60-416a-b409-8719252a89d8 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/bff2e047-aa5f-4700-9a34-11ec9a2b9d62" status: 202 len: 0 microversion: 2.1 time: 1.746909 Oct 04 20:48:38.923493 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 905/1795] 10.222.0.78 () {58 vars in 1287 bytes} [Tue Oct 4 20:48:37 2022] DELETE /compute/v2.1/os-security-group-rules/bff2e047-aa5f-4700-9a34-11ec9a2b9d62 => generated 0 bytes in 1763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:38.935983 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a3eca942-165f-4148-b808-bb81c66e2a1d tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Calling method '.version_select at 0x7f77ef614430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:39.333173 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b7603c3d-99e9-4333-81c1-ab3e6131f7ff tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Action: 'create', calling method: .version_select at 0x7f77eec90040>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1079401282", "policies": ["affinity"]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:39.438319 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-b7603c3d-99e9-4333-81c1-ab3e6131f7ff tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:39.494412 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-b7603c3d-99e9-4333-81c1-ab3e6131f7ff tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for user d7cd5eb1f46c402393ddbd5bcd92c1c6 and project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:39.929545 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-b7603c3d-99e9-4333-81c1-ab3e6131f7ff tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:39.972127 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-b7603c3d-99e9-4333-81c1-ab3e6131f7ff tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for user d7cd5eb1f46c402393ddbd5bcd92c1c6 and project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:40.055075 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b7603c3d-99e9-4333-81c1-ab3e6131f7ff tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 1.515484 Oct 04 20:48:40.067322 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 891/1796] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 4 20:48:38 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:40.098809 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bc5a8141-3c77-41a8-8bdb-b3492b95171c tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Action: 'create', calling method: .version_select at 0x7f77eeb0f1f0>, body: {"server_group": {"name": "tempest-server-group-160815356", "policies": ["affinity"]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:40.271508 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-bc5a8141-3c77-41a8-8bdb-b3492b95171c tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:40.295973 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-bc5a8141-3c77-41a8-8bdb-b3492b95171c tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for user d7cd5eb1f46c402393ddbd5bcd92c1c6 and project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:40.628529 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-bc5a8141-3c77-41a8-8bdb-b3492b95171c tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:40.683691 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-bc5a8141-3c77-41a8-8bdb-b3492b95171c tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for user d7cd5eb1f46c402393ddbd5bcd92c1c6 and project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:40.767390 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bc5a8141-3c77-41a8-8bdb-b3492b95171c tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.687348 Oct 04 20:48:40.780757 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 892/1797] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Oct 4 20:48:40 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:40.799612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a652830f-1e92-4d18-9988-dd51a9a0505d tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Action: 'create', calling method: .version_select at 0x7f77eec97a60>, body: {"server_group": {"name": "tempest-server-group-160815356", "policies": ["affinity"]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:40.858002 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-a652830f-1e92-4d18-9988-dd51a9a0505d tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:40.873278 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-a652830f-1e92-4d18-9988-dd51a9a0505d tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for user d7cd5eb1f46c402393ddbd5bcd92c1c6 and project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:41.105606 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a3eca942-165f-4148-b808-bb81c66e2a1d tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/c4438861-d5c8-41cf-b804-249cab100bd8" status: 202 len: 0 microversion: 2.1 time: 2.176864 Oct 04 20:48:41.105606 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 906/1798] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:38 2022] DELETE /compute/v2.1/os-security-groups/c4438861-d5c8-41cf-b804-249cab100bd8 => generated 0 bytes in 2179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:41.119760 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5ca14a76-c6af-4bff-9804-3292832826e8 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Calling method '.version_select at 0x7f77eef7f280>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:41.199225 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-a652830f-1e92-4d18-9988-dd51a9a0505d tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:41.228007 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-a652830f-1e92-4d18-9988-dd51a9a0505d tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for user d7cd5eb1f46c402393ddbd5bcd92c1c6 and project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:41.350997 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a652830f-1e92-4d18-9988-dd51a9a0505d tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.556115 Oct 04 20:48:41.363746 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 893/1799] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Oct 4 20:48:40 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:41.396225 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-eff802e9-3e4b-4d3e-ad76-f30f3f3c5992 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:41.496930 n-d-852085-12 devstack@n-api.service[123539]: DEBUG neutronclient.v2_0.client [None req-5ca14a76-c6af-4bff-9804-3292832826e8 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6ceef318-ae40-4d84-bb52-19926e472aef does not exist", "detail": ""}} {{(pid=123539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:48:41.497286 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.security_group_api [None req-5ca14a76-c6af-4bff-9804-3292832826e8 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Neutron security group 6ceef318-ae40-4d84-bb52-19926e472aef not found {{(pid=123539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:48:41.498306 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-5ca14a76-c6af-4bff-9804-3292832826e8 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] HTTP exception thrown: Security group 6ceef318-ae40-4d84-bb52-19926e472aef does not exist Oct 04 20:48:41.498306 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-176fd457-63c7-422c-bc29-5c7685cc8960'] Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5ca14a76-c6af-4bff-9804-3292832826e8 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Request method failure captured: Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/os-security-groups/6ceef318-ae40-4d84-bb52-19926e472aef HTTP/1.1 Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJv-CNoPqrq1rtD8hFJhQRLSGEW4K-4eP44PG86qzSoTUyjK4zHBcKWRd2CjGX22i_pMwlhXMNC7bZdu5eU4T3OgmZeA7BFEMJI5OcafMnjxwBEvsfZeb14S4PmlV7PMFUBSbWI8cfQozMvCVscxIu1FI2I1LHeP79TZfgOBFH-tMUs Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: e7e1ecd83e39483281a9b6b3db59648e Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-140248486 Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e7e1ecd83e39483281a9b6b3db59648e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e7e1ecd83e39483281a9b6b3db59648e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e7e1ecd83e39483281a9b6b3db59648e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e7e1ecd83e39483281a9b6b3db59648e"}]}] Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-SecurityGroupRulesTestJSON-140248486 Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: e7e1ecd83e39483281a9b6b3db59648e Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-140248486 Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-SecurityGroupRulesTestJSON-140248486-project Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 124ee4952519479f95536e976a096335 Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-SecurityGroupRulesTestJSON-140248486-project Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: exception: Security group 6ceef318-ae40-4d84-bb52-19926e472aef does not exist Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-176fd457-63c7-422c-bc29-5c7685cc8960'] Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '6ceef318-ae40-4d84-bb52-19926e472aef'} Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:48:41.503289 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6ceef318-ae40-4d84-bb52-19926e472aef does not exist Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-176fd457-63c7-422c-bc29-5c7685cc8960'] Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6ceef318-ae40-4d84-bb52-19926e472aef does not exist Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-176fd457-63c7-422c-bc29-5c7685cc8960'] Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6ceef318-ae40-4d84-bb52-19926e472aef does not exist Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-176fd457-63c7-422c-bc29-5c7685cc8960'] Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6ceef318-ae40-4d84-bb52-19926e472aef does not exist Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-176fd457-63c7-422c-bc29-5c7685cc8960'] Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5ca14a76-c6af-4bff-9804-3292832826e8 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Returning 404 to user: Security group 6ceef318-ae40-4d84-bb52-19926e472aef does not exist Oct 04 20:48:41.511807 n-d-852085-12 devstack@n-api.service[123539]: Neutron server returns request_ids: ['req-176fd457-63c7-422c-bc29-5c7685cc8960'] {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:41.520426 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5ca14a76-c6af-4bff-9804-3292832826e8 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/6ceef318-ae40-4d84-bb52-19926e472aef" status: 404 len: 194 microversion: 2.1 time: 0.395080 Oct 04 20:48:41.522963 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 907/1800] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:41 2022] DELETE /compute/v2.1/os-security-groups/6ceef318-ae40-4d84-bb52-19926e472aef => generated 194 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:41.541650 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4fdfe46b-e8c2-4e41-a5dc-623cf39d9ec9 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Calling method '.version_select at 0x7f77ef162430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:41.720869 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-eff802e9-3e4b-4d3e-ad76-f30f3f3c5992 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/db8ea963-4bb7-4fd6-95ce-b3527d42bc35" status: 204 len: 0 microversion: 2.1 time: 0.350653 Oct 04 20:48:41.722532 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 894/1801] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:48:41 2022] DELETE /compute/v2.1/os-server-groups/db8ea963-4bb7-4fd6-95ce-b3527d42bc35 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:41.748972 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4c0ea6bb-e1f8-40d5-a06f-e78cf11103d4 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:41.858151 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4c0ea6bb-e1f8-40d5-a06f-e78cf11103d4 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.127731 Oct 04 20:48:41.866893 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 895/1802] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:48:41 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:48:41.878734 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-63950547-c800-4a67-be2e-a9bd7623b143 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:42.101402 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-63950547-c800-4a67-be2e-a9bd7623b143 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/3f8c5a9e-9bc4-4686-b916-bdfd2e5a0376" status: 204 len: 0 microversion: 2.1 time: 0.228868 Oct 04 20:48:42.102457 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 896/1803] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:48:41 2022] DELETE /compute/v2.1/os-server-groups/3f8c5a9e-9bc4-4686-b916-bdfd2e5a0376 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:48:42.117177 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5234a9d8-179d-4cae-8344-1b1d979675e6 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:42.132232 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:42.150742 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5234a9d8-179d-4cae-8344-1b1d979675e6 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.040852 Oct 04 20:48:42.166098 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 897/1804] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:48:42 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:48:42.179699 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7f079095-237f-4167-ac4a-716838c4b41a tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Action: 'create', calling method: .version_select at 0x7f77eebc8310>, body: {"server_group": {"name": "tempest-server-group-315423476", "policies": ["affinity"]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:42.316674 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-7f079095-237f-4167-ac4a-716838c4b41a tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:42.353921 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-7f079095-237f-4167-ac4a-716838c4b41a tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for user d7cd5eb1f46c402393ddbd5bcd92c1c6 and project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:42.802424 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-7f079095-237f-4167-ac4a-716838c4b41a tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:42.831238 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-7f079095-237f-4167-ac4a-716838c4b41a tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for user d7cd5eb1f46c402393ddbd5bcd92c1c6 and project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:42.903781 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7f079095-237f-4167-ac4a-716838c4b41a tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.730674 Oct 04 20:48:42.920749 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 898/1805] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Oct 4 20:48:42 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:42.971038 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f02cbba5-5791-458c-bfa4-8126fcc9f194 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:43.502403 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f02cbba5-5791-458c-bfa4-8126fcc9f194 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/802bba84-3ca6-4b61-9af8-6ca2c3c906d5" status: 204 len: 0 microversion: 2.1 time: 0.578787 Oct 04 20:48:43.506153 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 899/1806] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:48:42 2022] DELETE /compute/v2.1/os-server-groups/802bba84-3ca6-4b61-9af8-6ca2c3c906d5 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:43.519166 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4fdfe46b-e8c2-4e41-a5dc-623cf39d9ec9 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/1aed740b-a268-487c-b4f3-df02991ddbcc" status: 202 len: 0 microversion: 2.1 time: 1.994020 Oct 04 20:48:43.522206 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 908/1807] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:41 2022] DELETE /compute/v2.1/os-security-groups/1aed740b-a268-487c-b4f3-df02991ddbcc => generated 0 bytes in 1998 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:43.536654 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-57f80b96-1d98-4845-8db3-0687eab030be tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:43.566357 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f2ebb75f-3d51-4f7f-920f-53c484a9bd42 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Calling method '.version_select at 0x7f77eef7fdc0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:43.600699 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-57f80b96-1d98-4845-8db3-0687eab030be tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.081968 Oct 04 20:48:43.600699 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 900/1808] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:48:43 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:43.628458 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1835f553-9b58-484f-abed-f1eebfec7a98 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Action: 'create', calling method: .version_select at 0x7f77eebc81f0>, body: {"server_group": {"name": "tempest-server-group-2077442683", "policies": ["anti-affinity"]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:43.738944 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-1835f553-9b58-484f-abed-f1eebfec7a98 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:43.798374 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-1835f553-9b58-484f-abed-f1eebfec7a98 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for user d7cd5eb1f46c402393ddbd5bcd92c1c6 and project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:44.145419 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-1835f553-9b58-484f-abed-f1eebfec7a98 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:44.173260 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-1835f553-9b58-484f-abed-f1eebfec7a98 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Getting quotas for user d7cd5eb1f46c402393ddbd5bcd92c1c6 and project 21485db3d9e240e0927cd9c3bcf0ed1f. Resources: {'server_groups'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:44.245949 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1835f553-9b58-484f-abed-f1eebfec7a98 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.627219 Oct 04 20:48:44.253339 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 901/1809] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Oct 4 20:48:43 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:48:44.285896 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7196af2b-102f-4616-87c0-5ce8f8255599 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:44.563849 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7196af2b-102f-4616-87c0-5ce8f8255599 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/95825172-2351-4f92-a40f-239c34ced78a" status: 204 len: 0 microversion: 2.1 time: 0.295959 Oct 04 20:48:44.565457 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 902/1810] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:48:44 2022] DELETE /compute/v2.1/os-server-groups/95825172-2351-4f92-a40f-239c34ced78a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:44.596432 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6e543771-3a82-460a-b9a5-bc095c55e4a0 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:44.713853 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6e543771-3a82-460a-b9a5-bc095c55e4a0 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.122513 Oct 04 20:48:44.713853 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 903/1811] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:48:44 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:48:45.494062 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e48fe804-83e6-4ea3-9893-1c42fde15855 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1790773611", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "b5eb5bea-3a79-48db-bd21-b80445c9ff3f"}]}, "os:scheduler_hints": {"group": "030d0aa7-821a-43ac-8c1f-5f311e525b6f"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:45.819474 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-e48fe804-83e6-4ea3-9893-1c42fde15855 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] validate_networks() for [('b5eb5bea-3a79-48db-bd21-b80445c9ff3f', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-e48fe804-83e6-4ea3-9893-1c42fde15855 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f3c8c739-27c4-4dfa-ba6d-b54c8cb1f374) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:48:48.656564 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f3c8c739-27c4-4dfa-ba6d-b54c8cb1f374) Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-e48fe804-83e6-4ea3-9893-1c42fde15855 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e48fe804-83e6-4ea3-9893-1c42fde15855 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Request method failure captured: Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 278 Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJwmgQds2ok7ZeurAkyuAsxnGw0Da093DWSENxWjeLCsWI0p3_VbNceirE_q-EaTJQmYBZ6B950pkMrOezTzEbV3XkQn7jNWuXK-UocD7ZnZe3swCrhxJBCTAY-OaNNNIHv2Pjct9GEFr11M1__KFoSnGpgDdLvgA9ushWQ3o_ioM88 Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 21485db3d9e240e0927cd9c3bcf0ed1f Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21485db3d9e240e0927cd9c3bcf0ed1f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21485db3d9e240e0927cd9c3bcf0ed1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21485db3d9e240e0927cd9c3bcf0ed1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21485db3d9e240e0927cd9c3bcf0ed1f"}]}] Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 21485db3d9e240e0927cd9c3bcf0ed1f Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerGroupTestJSON-850155292-project Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: d7cd5eb1f46c402393ddbd5bcd92c1c6 Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerGroupTestJSON-850155292-project Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServerGroupTestJSON-server-1790773611", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "b5eb5bea-3a79-48db-bd21-b80445c9ff3f"}]}, "os:scheduler_hints": {"group": "030d0aa7-821a-43ac-8c1f-5f311e525b6f"}} Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:48:48.673074 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServerGroupTestJSON-server-1790773611', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'b5eb5bea-3a79-48db-bd21-b80445c9ff3f'}]}, 'os:scheduler_hints': {'group': '030d0aa7-821a-43ac-8c1f-5f311e525b6f'}}} Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:48:48.684045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f3c8c739-27c4-4dfa-ba6d-b54c8cb1f374) Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:48.693862 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:48.719552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e48fe804-83e6-4ea3-9893-1c42fde15855 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:48:48.719552 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:48.729242 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e48fe804-83e6-4ea3-9893-1c42fde15855 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.238158 Oct 04 20:48:48.771373 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 904/1812] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:48:45 2022] POST /compute/v2.1/servers => generated 214 bytes in 3249 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:48:48.818381 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-40f2e31b-90c6-46cd-a018-2126c2ee65df tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:48.863828 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-40f2e31b-90c6-46cd-a018-2126c2ee65df tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.054809 Oct 04 20:48:48.865393 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 905/1813] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:48:48 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:48.886490 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5e6dabc7-8a0c-420e-8ad3-1f678fd3868d tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:48.916167 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5e6dabc7-8a0c-420e-8ad3-1f678fd3868d tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/030d0aa7-821a-43ac-8c1f-5f311e525b6f" status: 200 len: 184 microversion: 2.1 time: 0.037190 Oct 04 20:48:48.918770 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 906/1814] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:48:48 2022] GET /compute/v2.1/os-server-groups/030d0aa7-821a-43ac-8c1f-5f311e525b6f => generated 184 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:48:48.949639 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0640758a-5e15-4a35-a8a9-de3006c1b4c9 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:48.968838 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-0640758a-5e15-4a35-a8a9-de3006c1b4c9 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] HTTP exception thrown: Instance group 95825172-2351-4f92-a40f-239c34ced78a could not be found. Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0640758a-5e15-4a35-a8a9-de3006c1b4c9 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Request method failure captured: Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/os-server-groups/95825172-2351-4f92-a40f-239c34ced78a HTTP/1.1 Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJwmgQds2ok7ZeurAkyuAsxnGw0Da093DWSENxWjeLCsWI0p3_VbNceirE_q-EaTJQmYBZ6B950pkMrOezTzEbV3XkQn7jNWuXK-UocD7ZnZe3swCrhxJBCTAY-OaNNNIHv2Pjct9GEFr11M1__KFoSnGpgDdLvgA9ushWQ3o_ioM88 Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 21485db3d9e240e0927cd9c3bcf0ed1f Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21485db3d9e240e0927cd9c3bcf0ed1f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21485db3d9e240e0927cd9c3bcf0ed1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21485db3d9e240e0927cd9c3bcf0ed1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21485db3d9e240e0927cd9c3bcf0ed1f"}]}] Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 21485db3d9e240e0927cd9c3bcf0ed1f Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerGroupTestJSON-850155292-project Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: d7cd5eb1f46c402393ddbd5bcd92c1c6 Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerGroupTestJSON-850155292-project Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance group 95825172-2351-4f92-a40f-239c34ced78a could not be found. Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '95825172-2351-4f92-a40f-239c34ced78a'} Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 95825172-2351-4f92-a40f-239c34ced78a could not be found. Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 95825172-2351-4f92-a40f-239c34ced78a could not be found. Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:48.997284 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.006391 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:49.006391 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:49.006391 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:49.006391 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:49.006391 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 95825172-2351-4f92-a40f-239c34ced78a could not be found. Oct 04 20:48:49.006391 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.014193 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0640758a-5e15-4a35-a8a9-de3006c1b4c9 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Returning 404 to user: Instance group 95825172-2351-4f92-a40f-239c34ced78a could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:49.016656 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0640758a-5e15-4a35-a8a9-de3006c1b4c9 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/95825172-2351-4f92-a40f-239c34ced78a" status: 404 len: 117 microversion: 2.1 time: 0.082603 Oct 04 20:48:49.018946 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 907/1815] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:48:48 2022] DELETE /compute/v2.1/os-server-groups/95825172-2351-4f92-a40f-239c34ced78a => generated 117 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:49.058324 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-adba05c8-9b18-4a37-8ca6-cd18278499dd tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:49.108213 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-adba05c8-9b18-4a37-8ca6-cd18278499dd tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] HTTP exception thrown: Instance group 802bba84-3ca6-4b61-9af8-6ca2c3c906d5 could not be found. Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-adba05c8-9b18-4a37-8ca6-cd18278499dd tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Request method failure captured: Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/os-server-groups/802bba84-3ca6-4b61-9af8-6ca2c3c906d5 HTTP/1.1 Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJwmgQds2ok7ZeurAkyuAsxnGw0Da093DWSENxWjeLCsWI0p3_VbNceirE_q-EaTJQmYBZ6B950pkMrOezTzEbV3XkQn7jNWuXK-UocD7ZnZe3swCrhxJBCTAY-OaNNNIHv2Pjct9GEFr11M1__KFoSnGpgDdLvgA9ushWQ3o_ioM88 Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 21485db3d9e240e0927cd9c3bcf0ed1f Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21485db3d9e240e0927cd9c3bcf0ed1f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21485db3d9e240e0927cd9c3bcf0ed1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21485db3d9e240e0927cd9c3bcf0ed1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21485db3d9e240e0927cd9c3bcf0ed1f"}]}] Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 21485db3d9e240e0927cd9c3bcf0ed1f Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerGroupTestJSON-850155292-project Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: d7cd5eb1f46c402393ddbd5bcd92c1c6 Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerGroupTestJSON-850155292-project Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance group 802bba84-3ca6-4b61-9af8-6ca2c3c906d5 could not be found. Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '802bba84-3ca6-4b61-9af8-6ca2c3c906d5'} Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 802bba84-3ca6-4b61-9af8-6ca2c3c906d5 could not be found. Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 802bba84-3ca6-4b61-9af8-6ca2c3c906d5 could not be found. Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.115246 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.128166 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:49.128166 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:49.128166 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:49.128166 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:49.128166 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 802bba84-3ca6-4b61-9af8-6ca2c3c906d5 could not be found. Oct 04 20:48:49.128166 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.128166 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-adba05c8-9b18-4a37-8ca6-cd18278499dd tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Returning 404 to user: Instance group 802bba84-3ca6-4b61-9af8-6ca2c3c906d5 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:49.128166 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-adba05c8-9b18-4a37-8ca6-cd18278499dd tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/802bba84-3ca6-4b61-9af8-6ca2c3c906d5" status: 404 len: 117 microversion: 2.1 time: 0.091863 Oct 04 20:48:49.128166 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 908/1816] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:48:49 2022] DELETE /compute/v2.1/os-server-groups/802bba84-3ca6-4b61-9af8-6ca2c3c906d5 => generated 117 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:48:49.136169 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c2335f37-37a1-44b2-8f0d-f32fe4fa3316 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:49.147581 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-c2335f37-37a1-44b2-8f0d-f32fe4fa3316 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] HTTP exception thrown: Instance group 3f8c5a9e-9bc4-4686-b916-bdfd2e5a0376 could not be found. Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c2335f37-37a1-44b2-8f0d-f32fe4fa3316 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Request method failure captured: Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/os-server-groups/3f8c5a9e-9bc4-4686-b916-bdfd2e5a0376 HTTP/1.1 Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJwmgQds2ok7ZeurAkyuAsxnGw0Da093DWSENxWjeLCsWI0p3_VbNceirE_q-EaTJQmYBZ6B950pkMrOezTzEbV3XkQn7jNWuXK-UocD7ZnZe3swCrhxJBCTAY-OaNNNIHv2Pjct9GEFr11M1__KFoSnGpgDdLvgA9ushWQ3o_ioM88 Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 21485db3d9e240e0927cd9c3bcf0ed1f Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21485db3d9e240e0927cd9c3bcf0ed1f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21485db3d9e240e0927cd9c3bcf0ed1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21485db3d9e240e0927cd9c3bcf0ed1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21485db3d9e240e0927cd9c3bcf0ed1f"}]}] Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 21485db3d9e240e0927cd9c3bcf0ed1f Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerGroupTestJSON-850155292-project Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: d7cd5eb1f46c402393ddbd5bcd92c1c6 Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerGroupTestJSON-850155292-project Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance group 3f8c5a9e-9bc4-4686-b916-bdfd2e5a0376 could not be found. Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '3f8c5a9e-9bc4-4686-b916-bdfd2e5a0376'} Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3f8c5a9e-9bc4-4686-b916-bdfd2e5a0376 could not be found. Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3f8c5a9e-9bc4-4686-b916-bdfd2e5a0376 could not be found. Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.151108 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.160602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:49.160602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:49.160602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:49.160602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:49.160602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3f8c5a9e-9bc4-4686-b916-bdfd2e5a0376 could not be found. Oct 04 20:48:49.160602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.160602 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c2335f37-37a1-44b2-8f0d-f32fe4fa3316 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Returning 404 to user: Instance group 3f8c5a9e-9bc4-4686-b916-bdfd2e5a0376 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:49.160602 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c2335f37-37a1-44b2-8f0d-f32fe4fa3316 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/3f8c5a9e-9bc4-4686-b916-bdfd2e5a0376" status: 404 len: 117 microversion: 2.1 time: 0.027826 Oct 04 20:48:49.161653 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 909/1817] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:48:49 2022] DELETE /compute/v2.1/os-server-groups/3f8c5a9e-9bc4-4686-b916-bdfd2e5a0376 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:49.169854 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0991abbe-0e8a-4264-ac42-90a7e0539c2e tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:49.184574 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-0991abbe-0e8a-4264-ac42-90a7e0539c2e tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] HTTP exception thrown: Instance group db8ea963-4bb7-4fd6-95ce-b3527d42bc35 could not be found. Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0991abbe-0e8a-4264-ac42-90a7e0539c2e tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Request method failure captured: Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: request: DELETE /compute/v2.1/os-server-groups/db8ea963-4bb7-4fd6-95ce-b3527d42bc35 HTTP/1.1 Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJwmgQds2ok7ZeurAkyuAsxnGw0Da093DWSENxWjeLCsWI0p3_VbNceirE_q-EaTJQmYBZ6B950pkMrOezTzEbV3XkQn7jNWuXK-UocD7ZnZe3swCrhxJBCTAY-OaNNNIHv2Pjct9GEFr11M1__KFoSnGpgDdLvgA9ushWQ3o_ioM88 Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 21485db3d9e240e0927cd9c3bcf0ed1f Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21485db3d9e240e0927cd9c3bcf0ed1f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21485db3d9e240e0927cd9c3bcf0ed1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21485db3d9e240e0927cd9c3bcf0ed1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21485db3d9e240e0927cd9c3bcf0ed1f"}]}] Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 21485db3d9e240e0927cd9c3bcf0ed1f Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerGroupTestJSON-850155292 Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerGroupTestJSON-850155292-project Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: d7cd5eb1f46c402393ddbd5bcd92c1c6 Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerGroupTestJSON-850155292-project Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance group db8ea963-4bb7-4fd6-95ce-b3527d42bc35 could not be found. Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'db8ea963-4bb7-4fd6-95ce-b3527d42bc35'} Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group db8ea963-4bb7-4fd6-95ce-b3527d42bc35 could not be found. Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group db8ea963-4bb7-4fd6-95ce-b3527d42bc35 could not be found. Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.188178 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.195754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:49.195754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:49.195754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:49.195754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:49.195754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group db8ea963-4bb7-4fd6-95ce-b3527d42bc35 could not be found. Oct 04 20:48:49.195754 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.200842 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0991abbe-0e8a-4264-ac42-90a7e0539c2e tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Returning 404 to user: Instance group db8ea963-4bb7-4fd6-95ce-b3527d42bc35 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:49.203008 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0991abbe-0e8a-4264-ac42-90a7e0539c2e tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/db8ea963-4bb7-4fd6-95ce-b3527d42bc35" status: 404 len: 117 microversion: 2.1 time: 0.040367 Oct 04 20:48:49.204427 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 910/1818] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:48:49 2022] DELETE /compute/v2.1/os-server-groups/db8ea963-4bb7-4fd6-95ce-b3527d42bc35 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:49.221618 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1bdb3982-28fb-4a75-b398-dae4f0b48339 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:49.457875 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1bdb3982-28fb-4a75-b398-dae4f0b48339 tempest-ServerGroupTestJSON-850155292 tempest-ServerGroupTestJSON-850155292-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/030d0aa7-821a-43ac-8c1f-5f311e525b6f" status: 204 len: 0 microversion: 2.1 time: 0.245852 Oct 04 20:48:49.459496 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 911/1819] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:48:49 2022] DELETE /compute/v2.1/os-server-groups/030d0aa7-821a-43ac-8c1f-5f311e525b6f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:49.497889 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f2ebb75f-3d51-4f7f-920f-53c484a9bd42 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/199bc653-37bf-4555-a2da-7688e88168d5" status: 202 len: 0 microversion: 2.1 time: 5.967832 Oct 04 20:48:49.500314 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 909/1820] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:43 2022] DELETE /compute/v2.1/os-security-groups/199bc653-37bf-4555-a2da-7688e88168d5 => generated 0 bytes in 5972 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:49.516542 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-20b8e1a1-a0c5-48d9-a005-2996fea385d2 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Calling method '.version_select at 0x7f77eecc19d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:51.609637 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-20b8e1a1-a0c5-48d9-a005-2996fea385d2 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/8877ad4f-cdca-4f74-aabb-d860aef0ce89" status: 202 len: 0 microversion: 2.1 time: 2.103554 Oct 04 20:48:51.612812 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 912/1821] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:49 2022] DELETE /compute/v2.1/os-security-groups/8877ad4f-cdca-4f74-aabb-d860aef0ce89 => generated 0 bytes in 2108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:48:51.632044 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1271a62d-51b8-4408-9cab-3149fe5d1766 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Calling method '.version_select at 0x7f77ef43a430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.052608 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1271a62d-51b8-4408-9cab-3149fe5d1766 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/9fca0543-5be4-4728-b28b-c49181800804" status: 202 len: 0 microversion: 2.1 time: 1.432771 Oct 04 20:48:53.054255 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 910/1822] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:51 2022] DELETE /compute/v2.1/os-security-groups/9fca0543-5be4-4728-b28b-c49181800804 => generated 0 bytes in 1436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:53.069135 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c3459345-ab07-426b-b55a-b9f49cea2dd3 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] Calling method '.version_select at 0x7f77eeb0fd30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:54.219885 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=40 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:56.904375 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c3459345-ab07-426b-b55a-b9f49cea2dd3 tempest-SecurityGroupRulesTestJSON-140248486 tempest-SecurityGroupRulesTestJSON-140248486-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/79d64924-8f9c-406d-8ab2-243692f331dd" status: 202 len: 0 microversion: 2.1 time: 3.842631 Oct 04 20:48:56.910810 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 913/1823] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:53 2022] DELETE /compute/v2.1/os-security-groups/79d64924-8f9c-406d-8ab2-243692f331dd => generated 0 bytes in 3846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:23.767857 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-97549cb6-997f-4d0c-b018-0853e869609e tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-247583758", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "2abf657d-6b87-4d31-ab66-054a60025651"}, {"uuid": "a75ec7bf-5684-499b-95e5-1894ec91f3af"}, {"uuid": "2abf657d-6b87-4d31-ab66-054a60025651"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:23.846903 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:49:23.850064 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 20:49:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 20:49:24.083540 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-97549cb6-997f-4d0c-b018-0853e869609e tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] validate_networks() for [('2abf657d-6b87-4d31-ab66-054a60025651', None, None, None, None, None), ('a75ec7bf-5684-499b-95e5-1894ec91f3af', None, None, None, None, None), ('2abf657d-6b87-4d31-ab66-054a60025651', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:49:24.961803 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-97549cb6-997f-4d0c-b018-0853e869609e tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c7d8c058-94cc-4c1b-822a-c0ad4800e516) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:49:25.279785 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c7d8c058-94cc-4c1b-822a-c0ad4800e516) Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-97549cb6-997f-4d0c-b018-0853e869609e tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-97549cb6-997f-4d0c-b018-0853e869609e tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] Request method failure captured: Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 304 Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJxCmCHNDj0QijTbadpBJy1-IYeqggutF8nUpn_eXMcBgDu4t501ufGt1Pl6VSFFVHB085ALn0oiTVY4EldH5S7cwDdPdVotRsVbIc1OuJL7dbSaFpz7HTbzpFRnchSbeM8RAPMu0epCa3jMWnh7cyvQGbMiopOmnxdcKWJKUd0iJlc Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 0ab943ca7b4f4ad3ac63ee0067fa6376 Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersTestMultiNic-687384955 Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0ab943ca7b4f4ad3ac63ee0067fa6376", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ab943ca7b4f4ad3ac63ee0067fa6376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ab943ca7b4f4ad3ac63ee0067fa6376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0ab943ca7b4f4ad3ac63ee0067fa6376"}]}] Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersTestMultiNic-687384955 Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 0ab943ca7b4f4ad3ac63ee0067fa6376 Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersTestMultiNic-687384955 Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersTestMultiNic-687384955-project Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 9c7d0e3889e34fa1b24d19f7f68bc56c Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersTestMultiNic-687384955-project Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServersTestMultiNic-server-247583758", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "2abf657d-6b87-4d31-ab66-054a60025651"}, {"uuid": "a75ec7bf-5684-499b-95e5-1894ec91f3af"}, {"uuid": "2abf657d-6b87-4d31-ab66-054a60025651"}]}} Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:49:25.289019 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServersTestMultiNic-server-247583758', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '2abf657d-6b87-4d31-ab66-054a60025651'}, {'uuid': 'a75ec7bf-5684-499b-95e5-1894ec91f3af'}, {'uuid': '2abf657d-6b87-4d31-ab66-054a60025651'}]}}} Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:49:25.309982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c7d8c058-94cc-4c1b-822a-c0ad4800e516) Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-97549cb6-997f-4d0c-b018-0853e869609e tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-97549cb6-997f-4d0c-b018-0853e869609e tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.536645 Oct 04 20:49:25.330716 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 911/1824] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:23 2022] POST /compute/v2.1/servers => generated 214 bytes in 1563 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 20:49:26.199426 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e25e4b4c-ffc6-4617-bf50-b31520c49267 tempest-ServerRescueNegativeTestJSON-37175280 tempest-ServerRescueNegativeTestJSON-37175280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1053628406", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:26.348494 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-e25e4b4c-ffc6-4617-bf50-b31520c49267 tempest-ServerRescueNegativeTestJSON-37175280 tempest-ServerRescueNegativeTestJSON-37175280-project] validate_networks() for [('db71688b-3652-4732-b41d-6f2f4da2e587', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:49:26.993973 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-365799a5-23af-4460-985a-f61621a8b261 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-970456633", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e0de794a-aaf1-4696-ba55-fa056bac33b3"}], "security_groups": [{"name": "tempest-securitygroup--1991656598"}], "key_name": "tempest-keypair-1499190480", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "5ba635df-5b2a-4c86-8a8a-19206845957b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:27.572788 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-365799a5-23af-4460-985a-f61621a8b261 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] validate_networks() for [('e0de794a-aaf1-4696-ba55-fa056bac33b3', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-e25e4b4c-ffc6-4617-bf50-b31520c49267 tempest-ServerRescueNegativeTestJSON-37175280 tempest-ServerRescueNegativeTestJSON-37175280-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7b08c9e5-f070-4314-a3f6-ae9a4d1d9b7c) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:49:27.687474 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7b08c9e5-f070-4314-a3f6-ae9a4d1d9b7c) Oct 04 20:49:27.699732 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:27.712781 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-e25e4b4c-ffc6-4617-bf50-b31520c49267 tempest-ServerRescueNegativeTestJSON-37175280 tempest-ServerRescueNegativeTestJSON-37175280-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:27.712781 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e25e4b4c-ffc6-4617-bf50-b31520c49267 tempest-ServerRescueNegativeTestJSON-37175280 tempest-ServerRescueNegativeTestJSON-37175280-project] Request method failure captured: Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 246 Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJxTEmogTdkjlDBW77qeRjWLuNUv9rFOjVopQPNr0vEzu6eOm371h9dO_uvru-fW9_fufLWOVPBciCReHN9Whhww4nTnDcm-iRiAj70xuE9B3l5pYWOoU2RhWRMfdShcuS2624V0bdE2-Y5oZXyJWrXUzy-Plc2sDCujToR4zDfF4eY Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: b2e6812055b3473db24481cdd7504bd6 Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-37175280 Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2e6812055b3473db24481cdd7504bd6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2e6812055b3473db24481cdd7504bd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2e6812055b3473db24481cdd7504bd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2e6812055b3473db24481cdd7504bd6"}]}] Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerRescueNegativeTestJSON-37175280 Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: b2e6812055b3473db24481cdd7504bd6 Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-37175280 Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerRescueNegativeTestJSON-37175280-project Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 5521d99f7d6d4432acf47388c0a0c93a Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerRescueNegativeTestJSON-37175280-project Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1053628406", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "Q8~vZe3Og0Cso3J", "networks": [{"uuid": "db71688b-3652-4732-b41d-6f2f4da2e587"}]}} Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueNegativeTestJSON-server-1053628406', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'Q8~vZe3Og0Cso3J', 'networks': [{'uuid': 'db71688b-3652-4732-b41d-6f2f4da2e587'}]}}} Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:49:27.727827 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7b08c9e5-f070-4314-a3f6-ae9a4d1d9b7c) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:27.742697 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e25e4b4c-ffc6-4617-bf50-b31520c49267 tempest-ServerRescueNegativeTestJSON-37175280 tempest-ServerRescueNegativeTestJSON-37175280-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:27.760262 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:27.787681 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e25e4b4c-ffc6-4617-bf50-b31520c49267 tempest-ServerRescueNegativeTestJSON-37175280 tempest-ServerRescueNegativeTestJSON-37175280-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.813702 Oct 04 20:49:27.804366 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 914/1825] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:24 2022] POST /compute/v2.1/servers => generated 214 bytes in 2859 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-365799a5-23af-4460-985a-f61621a8b261 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-783c20ba-ec3e-4868-9cf4-0b6ff7295284) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:49:29.188185 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-783c20ba-ec3e-4868-9cf4-0b6ff7295284) Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-365799a5-23af-4460-985a-f61621a8b261 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:29.202644 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-365799a5-23af-4460-985a-f61621a8b261 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] Request method failure captured: Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 788 Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJv83pMWznHMYHB3NHejBMbWKBokXmYNS1uV43vjDOLp-bsdUmsxVoVTYOCgu2moOpTl6U10z_uMxd9MWRmgoQtXzTXLWgk9lmudXoF26O941GconKO9qhOkH4KIGafqQXG5ovcmCMy3oeqJelno5HjXG3PmcjGgU5CI2Uq2IBIqgX4 Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: cfa8bdf2eb414417a0ee4e64f7932019 Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersTestBootFromVolume-1686909715 Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cfa8bdf2eb414417a0ee4e64f7932019", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cfa8bdf2eb414417a0ee4e64f7932019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cfa8bdf2eb414417a0ee4e64f7932019"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cfa8bdf2eb414417a0ee4e64f7932019"}]}] Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersTestBootFromVolume-1686909715 Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: cfa8bdf2eb414417a0ee4e64f7932019 Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1686909715 Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersTestBootFromVolume-1686909715-project Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 895545f1707940e4a10fbfc84253d705 Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersTestBootFromVolume-1686909715-project Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServersTestBootFromVolume-server-970456633", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "F8+pgGL7MDR!LIE", "networks": [{"uuid": "e0de794a-aaf1-4696-ba55-fa056bac33b3"}], "security_groups": [{"name": "tempest-securitygroup--1991656598"}], "key_name": "tempest-keypair-1499190480", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "5ba635df-5b2a-4c86-8a8a-19206845957b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "AUTO"}} Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServersTestBootFromVolume-server-970456633', 'imageRef': '', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'F8+pgGL7MDR!LIE', 'networks': [{'uuid': 'e0de794a-aaf1-4696-ba55-fa056bac33b3'}], 'security_groups': [{'name': 'tempest-securitygroup--1991656598'}], 'key_name': 'tempest-keypair-1499190480', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '5ba635df-5b2a-4c86-8a8a-19206845957b'}]}}} Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:49:29.222377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:49:29.252504 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-783c20ba-ec3e-4868-9cf4-0b6ff7295284) Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-365799a5-23af-4460-985a-f61621a8b261 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-365799a5-23af-4460-985a-f61621a8b261 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.246939 Oct 04 20:49:29.269758 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 912/1826] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:26 2022] POST /compute/v2.1/servers => generated 214 bytes in 2273 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 20:49:29.273403 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-09dad3e3-c907-4434-a852-f49b41ac1e52 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] Calling method '.version_select at 0x7f77eecc1d30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:29.500741 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-09dad3e3-c907-4434-a852-f49b41ac1e52 tempest-ServersTestBootFromVolume-1686909715 tempest-ServersTestBootFromVolume-1686909715-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499190480" status: 202 len: 0 microversion: 2.1 time: 0.241781 Oct 04 20:49:29.506659 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 915/1827] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:49:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499190480 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:31.598634 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6f598c66-f49b-4b7d-8396-b76819c8433e tempest-AZV2TestJSON-289495705 tempest-AZV2TestJSON-289495705-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:31.609075 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6f598c66-f49b-4b7d-8396-b76819c8433e tempest-AZV2TestJSON-289495705 tempest-AZV2TestJSON-289495705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:31.611659 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6f598c66-f49b-4b7d-8396-b76819c8433e tempest-AZV2TestJSON-289495705 tempest-AZV2TestJSON-289495705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:31.615976 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6f598c66-f49b-4b7d-8396-b76819c8433e tempest-AZV2TestJSON-289495705 tempest-AZV2TestJSON-289495705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:31.619228 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6f598c66-f49b-4b7d-8396-b76819c8433e tempest-AZV2TestJSON-289495705 tempest-AZV2TestJSON-289495705-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:31.620719 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6f598c66-f49b-4b7d-8396-b76819c8433e tempest-AZV2TestJSON-289495705 tempest-AZV2TestJSON-289495705-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:31.621918 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6f598c66-f49b-4b7d-8396-b76819c8433e tempest-AZV2TestJSON-289495705 tempest-AZV2TestJSON-289495705-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:31.758146 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6f598c66-f49b-4b7d-8396-b76819c8433e tempest-AZV2TestJSON-289495705 tempest-AZV2TestJSON-289495705-project] 10.222.0.78 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.785778 Oct 04 20:49:31.771584 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 913/1828] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Oct 4 20:49:30 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:49:57.048517 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-255cf0d0-63d2-4e3a-9944-80d5292df798 tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-525942707", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "52f296b7-d20e-4477-85b1-fc4a04e7c484"}, {"uuid": "06bbf148-9e79-4b6f-a0fd-f26d618c62bc"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:57.154246 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:57.157335 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:49:57.157643 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 20:49:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 20:49:57.249520 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-255cf0d0-63d2-4e3a-9944-80d5292df798 tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] validate_networks() for [('52f296b7-d20e-4477-85b1-fc4a04e7c484', None, None, None, None, None), ('06bbf148-9e79-4b6f-a0fd-f26d618c62bc', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:49:59.184294 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6f598c66-f49b-4b7d-8396-b76819c8433e tempest-AZV2TestJSON-289495705 tempest-AZV2TestJSON-289495705-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:59.186150 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6f598c66-f49b-4b7d-8396-b76819c8433e tempest-AZV2TestJSON-289495705 tempest-AZV2TestJSON-289495705-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002295 Oct 04 20:49:59.186741 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 914/1829] 10.222.0.78 () {56 vars in 886 bytes} [Tue Oct 4 20:49:59 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-255cf0d0-63d2-4e3a-9944-80d5292df798 tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1c5476a9-80d1-4401-96a7-739498516335) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:49:59.512682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1c5476a9-80d1-4401-96a7-739498516335) Oct 04 20:49:59.521545 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.536593 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-255cf0d0-63d2-4e3a-9944-80d5292df798 tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:59.536593 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-255cf0d0-63d2-4e3a-9944-80d5292df798 tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] Request method failure captured: Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 254 Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJxCmCHNDj0QijTbadpBJy1-IYeqggutF8nUpn_eXMcBgDu4t501ufGt1Pl6VSFFVHB085ALn0oiTVY4EldH5S7cwDdPdVotRsVbIc1OuJL7dbSaFpz7HTbzpFRnchSbeM8RAPMu0epCa3jMWnh7cyvQGbMiopOmnxdcKWJKUd0iJlc Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 0ab943ca7b4f4ad3ac63ee0067fa6376 Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersTestMultiNic-687384955 Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0ab943ca7b4f4ad3ac63ee0067fa6376", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ab943ca7b4f4ad3ac63ee0067fa6376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ab943ca7b4f4ad3ac63ee0067fa6376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0ab943ca7b4f4ad3ac63ee0067fa6376"}]}] Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersTestMultiNic-687384955 Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 0ab943ca7b4f4ad3ac63ee0067fa6376 Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersTestMultiNic-687384955 Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersTestMultiNic-687384955-project Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 9c7d0e3889e34fa1b24d19f7f68bc56c Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersTestMultiNic-687384955-project Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServersTestMultiNic-server-525942707", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "52f296b7-d20e-4477-85b1-fc4a04e7c484"}, {"uuid": "06bbf148-9e79-4b6f-a0fd-f26d618c62bc"}]}} Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServersTestMultiNic-server-525942707', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '52f296b7-d20e-4477-85b1-fc4a04e7c484'}, {'uuid': '06bbf148-9e79-4b6f-a0fd-f26d618c62bc'}]}}} Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:49:59.560504 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1c5476a9-80d1-4401-96a7-739498516335) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:49:59.576006 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-255cf0d0-63d2-4e3a-9944-80d5292df798 tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:59.587682 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-255cf0d0-63d2-4e3a-9944-80d5292df798 tempest-ServersTestMultiNic-687384955 tempest-ServersTestMultiNic-687384955-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.544038 Oct 04 20:49:59.593563 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 916/1830] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:57 2022] POST /compute/v2.1/servers => generated 214 bytes in 2559 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:50:14.177803 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:14.192145 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:14.193827 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=10 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:15.355981 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-969e9803-7d52-43b0-bbdf-9708957e262d tempest-ComputeTenantNetworksTest-1100027493 tempest-ComputeTenantNetworksTest-1100027493-project] Calling method '.version_select at 0x7f77ef168700>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:16.692008 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-969e9803-7d52-43b0-bbdf-9708957e262d tempest-ComputeTenantNetworksTest-1100027493 tempest-ComputeTenantNetworksTest-1100027493-project] 10.222.0.78 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 2.522947 Oct 04 20:50:16.694814 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 915/1831] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:50:14 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 2527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:16.736062 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-deba1a38-104a-486b-bd5b-9b91ddfcbeb5 tempest-ComputeTenantNetworksTest-1100027493 tempest-ComputeTenantNetworksTest-1100027493-project] Calling method '.version_select at 0x7f77eec29e50>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:16.750219 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:18.715996 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-deba1a38-104a-486b-bd5b-9b91ddfcbeb5 tempest-ComputeTenantNetworksTest-1100027493 tempest-ComputeTenantNetworksTest-1100027493-project] 10.222.0.78 "GET /compute/v2.1/os-tenant-networks/3bb1e89f-f146-41db-8796-5f3ee73ade78" status: 200 len: 139 microversion: 2.1 time: 1.985047 Oct 04 20:50:18.718148 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 917/1832] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:50:16 2022] GET /compute/v2.1/os-tenant-networks/3bb1e89f-f146-41db-8796-5f3ee73ade78 => generated 139 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:36.644661 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7dff9c95-9daf-4ffb-8d5f-1c2122d40d18 tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] Action: 'create', calling method: .version_select at 0x7f77eedf6670>, body: {"keypair": {"name": "tempest-keypair-1539209912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYhE3TFajdhGQ+LWz9ll5nmdDTiHGOU3ZGba326PjXWp9bNif5F8TwTJCJ2SQxs39nAeLUWYpzgaPbA7TPKaOFz/QtEOmEpm5PWPXp+S/Eb9ujGyfF/Yi15SYQEGHS6Qg=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:36.749262 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-7dff9c95-9daf-4ffb-8d5f-1c2122d40d18 tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] Getting quotas for project 4387f90f1ad8429bb47aaabfe531871b. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:36.781256 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-7dff9c95-9daf-4ffb-8d5f-1c2122d40d18 tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] Getting quotas for user d22886ebf2b34276a9369ee93f9e5457 and project 4387f90f1ad8429bb47aaabfe531871b. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:36.839415 n-d-852085-12 devstack@n-api.service[123539]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7dff9c95-9daf-4ffb-8d5f-1c2122d40d18 tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] [c422e810-783e-4280-bbf8-739652fec542] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:50:37.856662 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [None req-7dff9c95-9daf-4ffb-8d5f-1c2122d40d18 tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] [c422e810-783e-4280-bbf8-739652fec542] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 51850. Oct 04 20:50:38.061308 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7dff9c95-9daf-4ffb-8d5f-1c2122d40d18 tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.885337 Oct 04 20:50:38.070316 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 916/1833] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:50:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:53.054045 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fe7134bd-dfd8-4c35-8b52-b8418024392d tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1806917552", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "43677c05-59b5-40a5-91e5-762f49280e61"}], "security_groups": [{"name": "tempest-securitygroup--2144757539"}], "key_name": "tempest-keypair-1539209912", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:53.772130 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-fe7134bd-dfd8-4c35-8b52-b8418024392d tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] validate_networks() for [('43677c05-59b5-40a5-91e5-762f49280e61', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-fe7134bd-dfd8-4c35-8b52-b8418024392d tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-245b4bee-e839-44de-8270-65107b81e989) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:50:55.736784 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-245b4bee-e839-44de-8270-65107b81e989) Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-fe7134bd-dfd8-4c35-8b52-b8418024392d tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:50:55.746045 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fe7134bd-dfd8-4c35-8b52-b8418024392d tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] Request method failure captured: Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 633 Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJyb964NKAwTvLMZJLZLCGsnTPFhNfp0LI2COIZNxKSvaHSOtkhZO27qwxqUNJ8RwTAbYVV4nk1Ho-BCDGp0NR26TE3xlPhFHXfeuT7VKVrAbnC3d-ear9Av-3Gw8zbapbgOGUem5huB3t3akniVfNw-AP46VQA-wI3HKhRDQ69LvLA Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 4387f90f1ad8429bb47aaabfe531871b Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersTestJSON-1617069239 Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4387f90f1ad8429bb47aaabfe531871b", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4387f90f1ad8429bb47aaabfe531871b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4387f90f1ad8429bb47aaabfe531871b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4387f90f1ad8429bb47aaabfe531871b"}]}] Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersTestJSON-1617069239 Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 4387f90f1ad8429bb47aaabfe531871b Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersTestJSON-1617069239 Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersTestJSON-1617069239-project Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: d22886ebf2b34276a9369ee93f9e5457 Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersTestJSON-1617069239-project Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServersTestJSON-server-1806917552", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "Y6^&=XzhmV1eGKE", "networks": [{"uuid": "43677c05-59b5-40a5-91e5-762f49280e61"}], "security_groups": [{"name": "tempest-securitygroup--2144757539"}], "key_name": "tempest-keypair-1539209912", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "AUTO"}} Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1806917552', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'Y6^&=XzhmV1eGKE', 'networks': [{'uuid': '43677c05-59b5-40a5-91e5-762f49280e61'}], 'security_groups': [{'name': 'tempest-securitygroup--2144757539'}], 'key_name': 'tempest-keypair-1539209912', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:50:55.750850 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-245b4bee-e839-44de-8270-65107b81e989) Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:50:55.760556 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fe7134bd-dfd8-4c35-8b52-b8418024392d tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:50:55.772670 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:55.779852 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fe7134bd-dfd8-4c35-8b52-b8418024392d tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.737615 Oct 04 20:50:55.787785 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 918/1834] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:50:53 2022] POST /compute/v2.1/servers => generated 214 bytes in 2751 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:50:55.800281 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a7cab883-e3db-4b25-a616-89780da8a274 tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] Calling method '.version_select at 0x7f77eee76f70>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:55.860016 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:55.860016 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:56.034048 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a7cab883-e3db-4b25-a616-89780da8a274 tempest-ServersTestJSON-1617069239 tempest-ServersTestJSON-1617069239-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539209912" status: 202 len: 0 microversion: 2.1 time: 0.248284 Oct 04 20:50:56.035406 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 917/1835] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:50:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539209912 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:51:06.432205 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:51:06.433462 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 20:51:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 20:51:06.440513 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:07.097111 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8c6c70d8-8708-4e20-8bb0-b214f637dad4 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Action: 'create', calling method: .version_select at 0x7f77eecc1ee0>, body: {"keypair": {"name": "tempest-keypair-1695132637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQMHEuWGG+DCseZOaMBYglH3vh75AoHr3xQbQdRNEEVtzdWqJrf4gBaqLOlgQau3qlyliuIuCQeiCnoSS2DYg6ear8Fk2T9H+slEjlIy6+kQgctUDB+d5/uThVWpcR/qQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:07.193337 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-8c6c70d8-8708-4e20-8bb0-b214f637dad4 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Getting quotas for project 6006071429214a518602cecf8646892a. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:51:07.242760 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-8c6c70d8-8708-4e20-8bb0-b214f637dad4 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Getting quotas for user 0e25ddb6c2b944b695d4e3e29ede847f and project 6006071429214a518602cecf8646892a. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:51:07.414255 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8c6c70d8-8708-4e20-8bb0-b214f637dad4 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.995252 Oct 04 20:51:07.415612 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 919/1836] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:51:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:51:16.742884 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-100366ec-2578-41af-955e-befe3f244b28 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Action: 'create', calling method: .version_select at 0x7f77eee339d0>, body: {"keypair": {"name": "tempest-keypair-1437141545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzwyLQJUThRz+zeFIgESIm9nY3wV+fnpb7nv8BlNesCOmV+M92HVv+TPptlzNZpRMuOmNdzNOoNKiVRO1S0p0JJGbec264ECncqb6d+Z94X3wtg56ebthm8mtvIDLm8dQ=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:16.816002 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-100366ec-2578-41af-955e-befe3f244b28 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Getting quotas for project 72a4f1e433a6427ab380248125ebc5b6. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:51:16.839280 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-100366ec-2578-41af-955e-befe3f244b28 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Getting quotas for user 6d11c1b7cf444372a6baeb027c455d5a and project 72a4f1e433a6427ab380248125ebc5b6. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:51:17.029308 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-100366ec-2578-41af-955e-befe3f244b28 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.568044 Oct 04 20:51:17.044901 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 918/1837] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:51:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:51:24.467617 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c82b3384-e1fd-494d-8223-6ebd59581f87 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2070522355", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0fe7fb4-d5ef-472d-aff1-4131ebf9faf7"}], "security_groups": [{"name": "tempest-securitygroup--1727775013"}], "key_name": "tempest-keypair-1695132637", "user_data": "}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:24.523607 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:24.526565 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:25.516133 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b4f526c1-6725-40ca-91f3-00bda178fe2b tempest-ServerMetadataNegativeTestJSON-171905736 tempest-ServerMetadataNegativeTestJSON-171905736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2050450824", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "28a24512-7b90-45c1-928d-59da1ce275a8"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:25.765684 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-b4f526c1-6725-40ca-91f3-00bda178fe2b tempest-ServerMetadataNegativeTestJSON-171905736 tempest-ServerMetadataNegativeTestJSON-171905736-project] validate_networks() for [('28a24512-7b90-45c1-928d-59da1ce275a8', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:51:26.789681 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-c82b3384-e1fd-494d-8223-6ebd59581f87 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] validate_networks() for [('f0fe7fb4-d5ef-472d-aff1-4131ebf9faf7', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:51:26.868942 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-b4f526c1-6725-40ca-91f3-00bda178fe2b tempest-ServerMetadataNegativeTestJSON-171905736 tempest-ServerMetadataNegativeTestJSON-171905736-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-788c1d8c-51f2-49c1-9fe6-81ff1547f37b) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:51:28.138811 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-788c1d8c-51f2-49c1-9fe6-81ff1547f37b) Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-b4f526c1-6725-40ca-91f3-00bda178fe2b tempest-ServerMetadataNegativeTestJSON-171905736 tempest-ServerMetadataNegativeTestJSON-171905736-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:28.146051 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b4f526c1-6725-40ca-91f3-00bda178fe2b tempest-ServerMetadataNegativeTestJSON-171905736 tempest-ServerMetadataNegativeTestJSON-171905736-project] Request method failure captured: Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 232 Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJzMpmi3ooaaPd8i-S7PDOrLv15Gvxd_5Bhl0lVT344eku9JdVAPcSpX4RIcDuXYk4O0XYZ3zxC2doLF0Js14rio5M5pSHQ6BXe8TYKHUkOkmmoaYKAKSDqLLQ61Vw18p_qHgO0xWWCj-xxxXlBxzySBGRVBqw-ppJGLOdPTK6SsX-o Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 54d1c146b5ce415cb43490a0ae2130cb Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-171905736 Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_54d1c146b5ce415cb43490a0ae2130cb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54d1c146b5ce415cb43490a0ae2130cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54d1c146b5ce415cb43490a0ae2130cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/54d1c146b5ce415cb43490a0ae2130cb"}]}] Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-171905736 Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 54d1c146b5ce415cb43490a0ae2130cb Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-171905736 Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServerMetadataNegativeTestJSON-171905736-project Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: f40ddba37a5b491f81b9ed09fd577f19 Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-171905736-project Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2050450824", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "28a24512-7b90-45c1-928d-59da1ce275a8"}]}} Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2050450824', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'metadata': {}, 'networks': [{'uuid': '28a24512-7b90-45c1-928d-59da1ce275a8'}]}}} Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:51:28.156171 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-788c1d8c-51f2-49c1-9fe6-81ff1547f37b) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:28.165831 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b4f526c1-6725-40ca-91f3-00bda178fe2b tempest-ServerMetadataNegativeTestJSON-171905736 tempest-ServerMetadataNegativeTestJSON-171905736-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b4f526c1-6725-40ca-91f3-00bda178fe2b tempest-ServerMetadataNegativeTestJSON-171905736 tempest-ServerMetadataNegativeTestJSON-171905736-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.083262 Oct 04 20:51:28.180737 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 919/1838] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:25 2022] POST /compute/v2.1/servers => generated 214 bytes in 3090 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-c82b3384-e1fd-494d-8223-6ebd59581f87 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-496fbf06-745e-4e89-97b6-431221a07ca1) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:51:30.296918 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-496fbf06-745e-4e89-97b6-431221a07ca1) Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-c82b3384-e1fd-494d-8223-6ebd59581f87 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c82b3384-e1fd-494d-8223-6ebd59581f87 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Request method failure captured: Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 486 Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJy6LEeOimi4bTcgpTagpdO-JY1lr4yXrlA19zLWoZg2SQlyM5BpC4ds6vzKe1sGevsxMqfGLzH5nIGvSV2x3-DTvUhLbFds_XK0Nx-iPmiPOyubLccAeYpoaNMEYvIQq5_GlviuypDcQebq4htxUZIOCpXSEr_KNEmn1UyCZ8c_Ra4 Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 6006071429214a518602cecf8646892a Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AttachVolumeTestJSON-282694345 Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6006071429214a518602cecf8646892a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6006071429214a518602cecf8646892a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6006071429214a518602cecf8646892a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6006071429214a518602cecf8646892a"}]}] Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AttachVolumeTestJSON-282694345 Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 6006071429214a518602cecf8646892a Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AttachVolumeTestJSON-282694345 Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AttachVolumeTestJSON-282694345-project Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 0e25ddb6c2b944b695d4e3e29ede847f Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AttachVolumeTestJSON-282694345-project Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2070522355", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "f0fe7fb4-d5ef-472d-aff1-4131ebf9faf7"}], "security_groups": [{"name": "tempest-securitygroup--1727775013"}], "key_name": "tempest-keypair-1695132637", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:30.308617 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeTestJSON-server-2070522355', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'f0fe7fb4-d5ef-472d-aff1-4131ebf9faf7'}], 'security_groups': [{'name': 'tempest-securitygroup--1727775013'}], 'key_name': 'tempest-keypair-1695132637', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:51:30.320093 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-496fbf06-745e-4e89-97b6-431221a07ca1) Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c82b3384-e1fd-494d-8223-6ebd59581f87 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c82b3384-e1fd-494d-8223-6ebd59581f87 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 5.864753 Oct 04 20:51:30.341057 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 920/1839] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:24 2022] POST /compute/v2.1/servers => generated 214 bytes in 5867 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:51:30.346777 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1002f19b-8ce9-4ff0-a8d2-b7a31bd6bf1d tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Calling method '.version_select at 0x7f77eedf61f0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:30.600484 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1002f19b-8ce9-4ff0-a8d2-b7a31bd6bf1d tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695132637" status: 202 len: 0 microversion: 2.1 time: 0.273507 Oct 04 20:51:30.607915 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 920/1840] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:51:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695132637 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:51:36.329671 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-90f43155-bc02-424a-a9f8-62d3eb2f6ee7 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-132364563", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "271ee594-d335-4e64-9a5f-f76e148f6d50"}], "security_groups": [{"name": "tempest-securitygroup--1999120537"}], "key_name": "tempest-keypair-1437141545", "user_data": "}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:39.440967 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-90f43155-bc02-424a-a9f8-62d3eb2f6ee7 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] validate_networks() for [('271ee594-d335-4e64-9a5f-f76e148f6d50', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-90f43155-bc02-424a-a9f8-62d3eb2f6ee7 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3720824d-9e5a-4fc4-8146-d98584aaf525) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:51:40.502214 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3720824d-9e5a-4fc4-8146-d98584aaf525) Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-90f43155-bc02-424a-a9f8-62d3eb2f6ee7 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-90f43155-bc02-424a-a9f8-62d3eb2f6ee7 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Request method failure captured: Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 489 Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJzDPVMMuYOaVC9Frcz6cKl-hI_0YsBhT3fsuXPyI3jGsPGez16awQY_WMUKncm1n1ptgvbcAl0H7N1Rpb5R3e7BUwAgtjZGF1rLJYDz6kh_xV5BhV4TP7UEzjkefkPuJxhTcaNBVvGcgRk0CeJqwNW3osyPuGk5IJ3MAAzgUP6MU5E Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 72a4f1e433a6427ab380248125ebc5b6 Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123406746 Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_72a4f1e433a6427ab380248125ebc5b6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/72a4f1e433a6427ab380248125ebc5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/72a4f1e433a6427ab380248125ebc5b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/72a4f1e433a6427ab380248125ebc5b6"}]}] Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AttachVolumeNegativeTest-1123406746 Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 72a4f1e433a6427ab380248125ebc5b6 Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123406746 Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AttachVolumeNegativeTest-1123406746-project Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 6d11c1b7cf444372a6baeb027c455d5a Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AttachVolumeNegativeTest-1123406746-project Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-132364563", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "271ee594-d335-4e64-9a5f-f76e148f6d50"}], "security_groups": [{"name": "tempest-securitygroup--1999120537"}], "key_name": "tempest-keypair-1437141545", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:40.513128 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-132364563', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '271ee594-d335-4e64-9a5f-f76e148f6d50'}], 'security_groups': [{'name': 'tempest-securitygroup--1999120537'}], 'key_name': 'tempest-keypair-1437141545', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:51:40.531356 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3720824d-9e5a-4fc4-8146-d98584aaf525) Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-90f43155-bc02-424a-a9f8-62d3eb2f6ee7 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-90f43155-bc02-424a-a9f8-62d3eb2f6ee7 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 4.190602 Oct 04 20:51:40.538225 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 921/1841] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 4201 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:51:40.564373 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5c09af9c-8110-46d2-a561-3f3f69c69d28 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Calling method '.version_select at 0x7f77eedf6af0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:40.599263 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:40.805800 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5c09af9c-8110-46d2-a561-3f3f69c69d28 tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437141545" status: 202 len: 0 microversion: 2.1 time: 0.270282 Oct 04 20:51:40.807079 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 921/1842] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:51:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437141545 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:51:41.845631 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bc150f1a-8961-4219-a7b8-165b3bb90172 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Action: 'create', calling method: .version_select at 0x7f77eeb2a310>, body: {"keypair": {"name": "tempest-keypair-2145946635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAggXPNWIdabTgPqxLgggfXvYMcYL7WlkTSuxmrEpq6vf8kg7TKoe+Dg9izbsrEzpfvOfJchk6SP20bXdDqF7YeVF+vYHbAQYRjeFkPDsfyNcsk0FpOmJznUY8mXCDs5eQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:41.896164 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-bc150f1a-8961-4219-a7b8-165b3bb90172 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Getting quotas for project 6006071429214a518602cecf8646892a. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:51:41.911317 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-bc150f1a-8961-4219-a7b8-165b3bb90172 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Getting quotas for user 0e25ddb6c2b944b695d4e3e29ede847f and project 6006071429214a518602cecf8646892a. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:51:42.082540 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bc150f1a-8961-4219-a7b8-165b3bb90172 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.241403 Oct 04 20:51:42.085388 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 922/1843] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:51:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:46.165735 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-93820db4-8e6b-4ef7-b9ee-9679299756e4 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1005914217", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:46.178647 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-93820db4-8e6b-4ef7-b9ee-9679299756e4 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] HTTP exception thrown: min_count must be <= max_count Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-93820db4-8e6b-4ef7-b9ee-9679299756e4 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Request method failure captured: Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 184 Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJzgP3mAh-MT2cBYKR4L68d8Q0sSLDhFzcxLI0l_873JVs26UzCvWasoEEXuKUSmCo_7GiRDATIvTGPIc5hC7xxOXwIZavA855cbv29beHnwikJ7_PpfHPLT_15DYY2Ym85vxQbpg3NBlKfukFi8B3pHYwhg9XU-maGFI-3Mg9sFiYM Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 43040c4dc3cc4a30a242acaf3630c1b0 Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_43040c4dc3cc4a30a242acaf3630c1b0", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43040c4dc3cc4a30a242acaf3630c1b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43040c4dc3cc4a30a242acaf3630c1b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/43040c4dc3cc4a30a242acaf3630c1b0"}]}] Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 43040c4dc3cc4a30a242acaf3630c1b0 Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-MultipleCreateNegativeTestJSON-533289568-project Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: fc8d97966f144d609bc40298fb9b9f9a Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-533289568-project Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1005914217", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: exception: min_count must be <= max_count Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1005914217', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 04 20:51:46.193293 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.204401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-93820db4-8e6b-4ef7-b9ee-9679299756e4 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Returning 400 to user: min_count must be <= max_count {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:46.207002 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-93820db4-8e6b-4ef7-b9ee-9679299756e4 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.641805 Oct 04 20:51:46.224902 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 922/1844] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:45 2022] POST /compute/v2.1/servers => generated 74 bytes in 662 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:46.418341 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7909f582-30cd-4616-a90e-259ba65a2c83 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-782668776", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "max_count": 0}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7909f582-30cd-4616-a90e-259ba65a2c83 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Request method failure captured: Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 167 Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJzgP3mAh-MT2cBYKR4L68d8Q0sSLDhFzcxLI0l_873JVs26UzCvWasoEEXuKUSmCo_7GiRDATIvTGPIc5hC7xxOXwIZavA855cbv29beHnwikJ7_PpfHPLT_15DYY2Ym85vxQbpg3NBlKfukFi8B3pHYwhg9XU-maGFI-3Mg9sFiYM Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 43040c4dc3cc4a30a242acaf3630c1b0 Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_43040c4dc3cc4a30a242acaf3630c1b0", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43040c4dc3cc4a30a242acaf3630c1b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43040c4dc3cc4a30a242acaf3630c1b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/43040c4dc3cc4a30a242acaf3630c1b0"}]}] Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 43040c4dc3cc4a30a242acaf3630c1b0 Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-MultipleCreateNegativeTestJSON-533289568-project Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: fc8d97966f144d609bc40298fb9b9f9a Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-533289568-project Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-782668776", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "max_count": 0}} Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-782668776', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'max_count': 0}}} Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 0 Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:51:46.444227 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:51:46.453120 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.473119 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7909f582-30cd-4616-a90e-259ba65a2c83 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:46.485254 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7909f582-30cd-4616-a90e-259ba65a2c83 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.075319 Oct 04 20:51:46.495909 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 923/1845] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:46 2022] POST /compute/v2.1/servers => generated 130 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:51:46.668244 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-23d1b2fb-88fa-4293-ac3a-d59e48163136 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-708284372", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "max_count": 2.5}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-23d1b2fb-88fa-4293-ac3a-d59e48163136 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Request method failure captured: Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 169 Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJzgP3mAh-MT2cBYKR4L68d8Q0sSLDhFzcxLI0l_873JVs26UzCvWasoEEXuKUSmCo_7GiRDATIvTGPIc5hC7xxOXwIZavA855cbv29beHnwikJ7_PpfHPLT_15DYY2Ym85vxQbpg3NBlKfukFi8B3pHYwhg9XU-maGFI-3Mg9sFiYM Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 43040c4dc3cc4a30a242acaf3630c1b0 Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_43040c4dc3cc4a30a242acaf3630c1b0", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43040c4dc3cc4a30a242acaf3630c1b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43040c4dc3cc4a30a242acaf3630c1b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/43040c4dc3cc4a30a242acaf3630c1b0"}]}] Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 43040c4dc3cc4a30a242acaf3630c1b0 Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-MultipleCreateNegativeTestJSON-533289568-project Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: fc8d97966f144d609bc40298fb9b9f9a Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-533289568-project Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-708284372", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "max_count": 2.5}} Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-708284372', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'max_count': 2.5}}} Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:51:46.706934 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:51:46.714298 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.722205 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-23d1b2fb-88fa-4293-ac3a-d59e48163136 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:46.730958 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-23d1b2fb-88fa-4293-ac3a-d59e48163136 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.084205 Oct 04 20:51:46.735260 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 923/1846] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:46 2022] POST /compute/v2.1/servers => generated 139 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:51:46.927567 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e1e65021-dcbf-483d-bf5d-dc8e2a94eb6c tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1189297514", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 0}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e1e65021-dcbf-483d-bf5d-dc8e2a94eb6c tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Request method failure captured: Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 168 Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJzgP3mAh-MT2cBYKR4L68d8Q0sSLDhFzcxLI0l_873JVs26UzCvWasoEEXuKUSmCo_7GiRDATIvTGPIc5hC7xxOXwIZavA855cbv29beHnwikJ7_PpfHPLT_15DYY2Ym85vxQbpg3NBlKfukFi8B3pHYwhg9XU-maGFI-3Mg9sFiYM Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 43040c4dc3cc4a30a242acaf3630c1b0 Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_43040c4dc3cc4a30a242acaf3630c1b0", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43040c4dc3cc4a30a242acaf3630c1b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43040c4dc3cc4a30a242acaf3630c1b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/43040c4dc3cc4a30a242acaf3630c1b0"}]}] Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 43040c4dc3cc4a30a242acaf3630c1b0 Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-MultipleCreateNegativeTestJSON-533289568-project Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: fc8d97966f144d609bc40298fb9b9f9a Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-533289568-project Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1189297514", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 0}} Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1189297514', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'min_count': 0}}} Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi 0 Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:51:46.969046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:51:46.978206 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e1e65021-dcbf-483d-bf5d-dc8e2a94eb6c tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:46.988953 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e1e65021-dcbf-483d-bf5d-dc8e2a94eb6c tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.060701 Oct 04 20:51:46.994719 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 924/1847] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:46 2022] POST /compute/v2.1/servers => generated 130 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:51:47.185873 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-752fbb62-f8ea-4b97-a2aa-99f3e17e8775 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-500718536", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 2.5}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-752fbb62-f8ea-4b97-a2aa-99f3e17e8775 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Request method failure captured: Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 169 Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJzgP3mAh-MT2cBYKR4L68d8Q0sSLDhFzcxLI0l_873JVs26UzCvWasoEEXuKUSmCo_7GiRDATIvTGPIc5hC7xxOXwIZavA855cbv29beHnwikJ7_PpfHPLT_15DYY2Ym85vxQbpg3NBlKfukFi8B3pHYwhg9XU-maGFI-3Mg9sFiYM Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 43040c4dc3cc4a30a242acaf3630c1b0 Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_43040c4dc3cc4a30a242acaf3630c1b0", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43040c4dc3cc4a30a242acaf3630c1b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/43040c4dc3cc4a30a242acaf3630c1b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/43040c4dc3cc4a30a242acaf3630c1b0"}]}] Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 43040c4dc3cc4a30a242acaf3630c1b0 Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-533289568 Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-MultipleCreateNegativeTestJSON-533289568-project Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: fc8d97966f144d609bc40298fb9b9f9a Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-533289568-project Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-500718536", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "min_count": 2.5}} Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-500718536', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'min_count': 2.5}}} Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:51:47.210521 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-752fbb62-f8ea-4b97-a2aa-99f3e17e8775 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-752fbb62-f8ea-4b97-a2aa-99f3e17e8775 tempest-MultipleCreateNegativeTestJSON-533289568 tempest-MultipleCreateNegativeTestJSON-533289568-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042865 Oct 04 20:51:47.233977 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 924/1848] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:47 2022] POST /compute/v2.1/servers => generated 139 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:51:49.548816 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-30a9b071-52f4-4a3e-a3d0-b7e0d3ca7aca tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Action: 'create', calling method: .version_select at 0x7f77eeb15ca0>, body: {"keypair": {"name": "tempest-keypair-357011654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv3WZ8nASPdsWr1Yfz0p/S18ySc6WqbOPNTz9hTumMClAsRhrQ3qkK8qQc11/xROzo5TKRpgzCHROVI9QAv0BPAfhHzWGEeIcKZt/8oGc/HxO/Fk7YIlkG3Ut0q8lBTUQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:49.587668 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-30a9b071-52f4-4a3e-a3d0-b7e0d3ca7aca tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Getting quotas for project 72a4f1e433a6427ab380248125ebc5b6. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:51:49.600862 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-30a9b071-52f4-4a3e-a3d0-b7e0d3ca7aca tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Getting quotas for user 6d11c1b7cf444372a6baeb027c455d5a and project 72a4f1e433a6427ab380248125ebc5b6. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:51:49.773706 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-30a9b071-52f4-4a3e-a3d0-b7e0d3ca7aca tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.233803 Oct 04 20:51:49.781897 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 925/1849] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:51:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:55.026197 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dab64ee7-a4f0-464e-a801-1e4e18c526a7 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1219362515", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0fe7fb4-d5ef-472d-aff1-4131ebf9faf7"}], "security_groups": [{"name": "tempest-securitygroup--849254252"}], "key_name": "tempest-keypair-2145946635", "user_data": "}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:56.847447 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-dab64ee7-a4f0-464e-a801-1e4e18c526a7 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] validate_networks() for [('f0fe7fb4-d5ef-472d-aff1-4131ebf9faf7', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-dab64ee7-a4f0-464e-a801-1e4e18c526a7 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-db1978fb-c723-42bd-a962-33f89715013e) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:51:58.067845 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-db1978fb-c723-42bd-a962-33f89715013e) Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-dab64ee7-a4f0-464e-a801-1e4e18c526a7 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:58.075019 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dab64ee7-a4f0-464e-a801-1e4e18c526a7 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Request method failure captured: Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 485 Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJy6LEeOimi4bTcgpTagpdO-JY1lr4yXrlA19zLWoZg2SQlyM5BpC4ds6vzKe1sGevsxMqfGLzH5nIGvSV2x3-DTvUhLbFds_XK0Nx-iPmiPOyubLccAeYpoaNMEYvIQq5_GlviuypDcQebq4htxUZIOCpXSEr_KNEmn1UyCZ8c_Ra4 Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 6006071429214a518602cecf8646892a Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-AttachVolumeTestJSON-282694345 Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6006071429214a518602cecf8646892a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6006071429214a518602cecf8646892a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6006071429214a518602cecf8646892a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6006071429214a518602cecf8646892a"}]}] Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-AttachVolumeTestJSON-282694345 Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 6006071429214a518602cecf8646892a Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-AttachVolumeTestJSON-282694345 Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-AttachVolumeTestJSON-282694345-project Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 0e25ddb6c2b944b695d4e3e29ede847f Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-AttachVolumeTestJSON-282694345-project Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1219362515", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "f0fe7fb4-d5ef-472d-aff1-4131ebf9faf7"}], "security_groups": [{"name": "tempest-securitygroup--849254252"}], "key_name": "tempest-keypair-2145946635", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeTestJSON-server-1219362515', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'f0fe7fb4-d5ef-472d-aff1-4131ebf9faf7'}], 'security_groups': [{'name': 'tempest-securitygroup--849254252'}], 'key_name': 'tempest-keypair-2145946635', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:51:58.089237 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-db1978fb-c723-42bd-a962-33f89715013e) Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:58.105795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-dab64ee7-a4f0-464e-a801-1e4e18c526a7 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-dab64ee7-a4f0-464e-a801-1e4e18c526a7 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.068206 Oct 04 20:51:58.125547 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 925/1850] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:55 2022] POST /compute/v2.1/servers => generated 214 bytes in 3078 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:51:58.136847 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a2f1de0f-578f-403f-9c95-6314ff689b38 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] Calling method '.version_select at 0x7f77eeb3d820>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:58.140311 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:58.325013 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a2f1de0f-578f-403f-9c95-6314ff689b38 tempest-AttachVolumeTestJSON-282694345 tempest-AttachVolumeTestJSON-282694345-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145946635" status: 202 len: 0 microversion: 2.1 time: 0.218993 Oct 04 20:51:58.332634 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 926/1851] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:51:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145946635 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:52:03.174335 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2a90755d-f479-4af3-ba69-c5417e394f1a tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1451400724", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "271ee594-d335-4e64-9a5f-f76e148f6d50"}], "security_groups": [{"name": "tempest-securitygroup--2056665463"}], "key_name": "tempest-keypair-357011654", "user_data": "}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:03.765483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-2a90755d-f479-4af3-ba69-c5417e394f1a tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] validate_networks() for [('271ee594-d335-4e64-9a5f-f76e148f6d50', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-2a90755d-f479-4af3-ba69-c5417e394f1a tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e896b931-d097-4331-9895-b2819295640b) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:52:04.931896 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e896b931-d097-4331-9895-b2819295640b) Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-2a90755d-f479-4af3-ba69-c5417e394f1a tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:04.939681 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2a90755d-f479-4af3-ba69-c5417e394f1a tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Request method failure captured: Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 489 Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJzDPVMMuYOaVC9Frcz6cKl-hI_0YsBhT3fsuXPyI3jGsPGez16awQY_WMUKncm1n1ptgvbcAl0H7N1Rpb5R3e7BUwAgtjZGF1rLJYDz6kh_xV5BhV4TP7UEzjkefkPuJxhTcaNBVvGcgRk0CeJqwNW3osyPuGk5IJ3MAAzgUP6MU5E Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 72a4f1e433a6427ab380248125ebc5b6 Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123406746 Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_72a4f1e433a6427ab380248125ebc5b6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/72a4f1e433a6427ab380248125ebc5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/72a4f1e433a6427ab380248125ebc5b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/72a4f1e433a6427ab380248125ebc5b6"}]}] Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-AttachVolumeNegativeTest-1123406746 Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 72a4f1e433a6427ab380248125ebc5b6 Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123406746 Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-AttachVolumeNegativeTest-1123406746-project Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 6d11c1b7cf444372a6baeb027c455d5a Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-AttachVolumeNegativeTest-1123406746-project Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1451400724", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "271ee594-d335-4e64-9a5f-f76e148f6d50"}], "security_groups": [{"name": "tempest-securitygroup--2056665463"}], "key_name": "tempest-keypair-357011654", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-1451400724', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '271ee594-d335-4e64-9a5f-f76e148f6d50'}], 'security_groups': [{'name': 'tempest-securitygroup--2056665463'}], 'key_name': 'tempest-keypair-357011654', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:52:04.942017 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e896b931-d097-4331-9895-b2819295640b) Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:04.956633 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2a90755d-f479-4af3-ba69-c5417e394f1a tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2a90755d-f479-4af3-ba69-c5417e394f1a tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.783300 Oct 04 20:52:04.967014 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 926/1852] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:52:03 2022] POST /compute/v2.1/servers => generated 214 bytes in 1797 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:52:04.971502 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=8 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:04.975646 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-87e3afe5-f2c0-4dfb-a5c0-10a107f967ed tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Calling method '.version_select at 0x7f77eeac19d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:05.165014 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-87e3afe5-f2c0-4dfb-a5c0-10a107f967ed tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-357011654" status: 202 len: 0 microversion: 2.1 time: 0.205304 Oct 04 20:52:05.166664 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 927/1853] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 4 20:52:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-357011654 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:12.930702 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9f02cec0-e985-4058-a649-c979b778b3bd tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Action: 'create', calling method: .version_select at 0x7f77eee8e940>, body: {"keypair": {"name": "tempest-keypair-429756636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtWjh+vqHzuD99qlC2JfZ0I4DwoMqyoQ/gYS26SzkfeImdyoXGTO2XWSVsqAbDi9jXh2IiXO012GDs9J8usfxnfQtIZQC0hQHrJXhx8Nkp7ziGlgKNkjrux8yTauJXbmA=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:12.970640 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-9f02cec0-e985-4058-a649-c979b778b3bd tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Getting quotas for project 72a4f1e433a6427ab380248125ebc5b6. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:12.987910 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-9f02cec0-e985-4058-a649-c979b778b3bd tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Getting quotas for user 6d11c1b7cf444372a6baeb027c455d5a and project 72a4f1e433a6427ab380248125ebc5b6. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:13.147836 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9f02cec0-e985-4058-a649-c979b778b3bd tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.230499 Oct 04 20:52:13.161487 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 927/1854] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:52:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:28.646062 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b50c9dcc-908e-4f83-910e-a9cea931f23c tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-163559957", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "271ee594-d335-4e64-9a5f-f76e148f6d50"}], "security_groups": [{"name": "tempest-securitygroup--74760378"}], "key_name": "tempest-keypair-429756636", "user_data": "}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:29.023473 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-b50c9dcc-908e-4f83-910e-a9cea931f23c tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] validate_networks() for [('271ee594-d335-4e64-9a5f-f76e148f6d50', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-b50c9dcc-908e-4f83-910e-a9cea931f23c tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c6d14ebf-a1c2-4a35-81a2-41a9f01021d5) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:52:29.681014 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c6d14ebf-a1c2-4a35-81a2-41a9f01021d5) Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-b50c9dcc-908e-4f83-910e-a9cea931f23c tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b50c9dcc-908e-4f83-910e-a9cea931f23c tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Request method failure captured: Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 486 Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJzDPVMMuYOaVC9Frcz6cKl-hI_0YsBhT3fsuXPyI3jGsPGez16awQY_WMUKncm1n1ptgvbcAl0H7N1Rpb5R3e7BUwAgtjZGF1rLJYDz6kh_xV5BhV4TP7UEzjkefkPuJxhTcaNBVvGcgRk0CeJqwNW3osyPuGk5IJ3MAAzgUP6MU5E Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 72a4f1e433a6427ab380248125ebc5b6 Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123406746 Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_72a4f1e433a6427ab380248125ebc5b6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/72a4f1e433a6427ab380248125ebc5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/72a4f1e433a6427ab380248125ebc5b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/72a4f1e433a6427ab380248125ebc5b6"}]}] Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-AttachVolumeNegativeTest-1123406746 Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 72a4f1e433a6427ab380248125ebc5b6 Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123406746 Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-AttachVolumeNegativeTest-1123406746-project Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 6d11c1b7cf444372a6baeb027c455d5a Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-AttachVolumeNegativeTest-1123406746-project Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-163559957", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "271ee594-d335-4e64-9a5f-f76e148f6d50"}], "security_groups": [{"name": "tempest-securitygroup--74760378"}], "key_name": "tempest-keypair-429756636", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:29.692151 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-163559957', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '271ee594-d335-4e64-9a5f-f76e148f6d50'}], 'security_groups': [{'name': 'tempest-securitygroup--74760378'}], 'key_name': 'tempest-keypair-429756636', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:52:29.706183 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c6d14ebf-a1c2-4a35-81a2-41a9f01021d5) Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b50c9dcc-908e-4f83-910e-a9cea931f23c tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:29.713690 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b50c9dcc-908e-4f83-910e-a9cea931f23c tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.064644 Oct 04 20:52:29.730540 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 928/1855] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:52:28 2022] POST /compute/v2.1/servers => generated 214 bytes in 1083 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:52:29.731725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a407061e-a8d8-4ed2-b38f-f4059abd816e tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] Calling method '.version_select at 0x7f77ef162700>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:29.769100 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:29.782525 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:29.977009 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a407061e-a8d8-4ed2-b38f-f4059abd816e tempest-AttachVolumeNegativeTest-1123406746 tempest-AttachVolumeNegativeTest-1123406746-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429756636" status: 202 len: 0 microversion: 2.1 time: 0.260138 Oct 04 20:52:29.988990 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 928/1856] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 4 20:52:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429756636 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:38.099234 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ad4168fd-0eb3-4968-997e-dd0b66fbaa3b tempest-ServerPasswordTestJSON-1857326628 tempest-ServerPasswordTestJSON-1857326628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2034133189", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "27c7409f-1dbf-4a82-a03b-8446fab427da"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:38.293314 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-ad4168fd-0eb3-4968-997e-dd0b66fbaa3b tempest-ServerPasswordTestJSON-1857326628 tempest-ServerPasswordTestJSON-1857326628-project] validate_networks() for [('27c7409f-1dbf-4a82-a03b-8446fab427da', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:52:38.568593 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-51c9f3ed-b6d8-4ba5-93cc-6e4305d9525a tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] Action: 'create', calling method: .version_select at 0x7f77ef5f8d30>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:38.655329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-51c9f3ed-b6d8-4ba5-93cc-6e4305d9525a tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] Getting quotas for project a64b7e8684dc4deabb72e98df57411a2. Resources: {'server_groups'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:38.674669 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-51c9f3ed-b6d8-4ba5-93cc-6e4305d9525a tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] Getting quotas for user ea9d8a6969e749fa957419b94b98fe90 and project a64b7e8684dc4deabb72e98df57411a2. Resources: {'server_groups'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:38.976397 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-51c9f3ed-b6d8-4ba5-93cc-6e4305d9525a tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] Getting quotas for project a64b7e8684dc4deabb72e98df57411a2. Resources: {'server_groups'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:39.006590 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-51c9f3ed-b6d8-4ba5-93cc-6e4305d9525a tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] Getting quotas for user ea9d8a6969e749fa957419b94b98fe90 and project a64b7e8684dc4deabb72e98df57411a2. Resources: {'server_groups'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:39.097330 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-51c9f3ed-b6d8-4ba5-93cc-6e4305d9525a tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.791546 Oct 04 20:52:39.110509 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 929/1857] 10.222.0.78 () {62 vars in 1214 bytes} [Tue Oct 4 20:52:38 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:52:39.128586 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-94b0894d-18e1-48c3-b1f6-8bbe8c8e6385 tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:39.194665 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-94b0894d-18e1-48c3-b1f6-8bbe8c8e6385 tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.078340 Oct 04 20:52:39.202436 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 930/1858] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Oct 4 20:52:39 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:52:39.237196 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-946fddcd-899c-423c-89a4-238a90229173 tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:39.285533 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-946fddcd-899c-423c-89a4-238a90229173 tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/75a4c18b-be54-4c24-ba44-e5bb6232d686" status: 200 len: 235 microversion: 2.64 time: 0.072156 Oct 04 20:52:39.289062 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 931/1859] 10.222.0.78 () {60 vars in 1304 bytes} [Tue Oct 4 20:52:39 2022] GET /compute/v2.1/os-server-groups/75a4c18b-be54-4c24-ba44-e5bb6232d686 => generated 235 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:52:39.315742 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-63fa03dd-86cd-47fa-ba25-7cd5a8bb0b8d tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:39.528389 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-63fa03dd-86cd-47fa-ba25-7cd5a8bb0b8d tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/75a4c18b-be54-4c24-ba44-e5bb6232d686" status: 204 len: 0 microversion: 2.64 time: 0.223798 Oct 04 20:52:39.536927 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 932/1860] 10.222.0.78 () {60 vars in 1307 bytes} [Tue Oct 4 20:52:39 2022] DELETE /compute/v2.1/os-server-groups/75a4c18b-be54-4c24-ba44-e5bb6232d686 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:52:39.557840 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-764efe88-9b19-414f-aea4-a6353396f9bf tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:39.589737 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-764efe88-9b19-414f-aea4-a6353396f9bf tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] HTTP exception thrown: Instance group 75a4c18b-be54-4c24-ba44-e5bb6232d686 could not be found. Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-764efe88-9b19-414f-aea4-a6353396f9bf tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] Request method failure captured: Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/os-server-groups/75a4c18b-be54-4c24-ba44-e5bb6232d686 HTTP/1.1 Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ0VO7bpNaUyYqFm-p5N2jtahxwMwmfQTDtmEyLGpvZW3-u9E8G-nlOX9k3Sk_UXX7Z9LprtZwHuP8Etes_RxYnRQ21lBCok8OGm9fk_r3Pd-ehtfPYXSxy1J3Y-F2WIBa2FTnE7FCEDm4qebvyH5sXZ3YhdbEALpzxZ3ftLdCzNhyE Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Openstack-Nova-Api-Version: 2.64 Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: a64b7e8684dc4deabb72e98df57411a2 Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServerGroup264TestJSON-1998270477 Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a64b7e8684dc4deabb72e98df57411a2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a64b7e8684dc4deabb72e98df57411a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a64b7e8684dc4deabb72e98df57411a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a64b7e8684dc4deabb72e98df57411a2"}]}] Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServerGroup264TestJSON-1998270477 Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: a64b7e8684dc4deabb72e98df57411a2 Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1998270477 Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServerGroup264TestJSON-1998270477-project Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: ea9d8a6969e749fa957419b94b98fe90 Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServerGroup264TestJSON-1998270477-project Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance group 75a4c18b-be54-4c24-ba44-e5bb6232d686 could not be found. Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '75a4c18b-be54-4c24-ba44-e5bb6232d686'} Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 75a4c18b-be54-4c24-ba44-e5bb6232d686 could not be found. Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 75a4c18b-be54-4c24-ba44-e5bb6232d686 could not be found. Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.608277 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:39.624377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:39.624377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:39.624377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:39.624377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:39.624377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 75a4c18b-be54-4c24-ba44-e5bb6232d686 could not be found. Oct 04 20:52:39.624377 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.624377 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-764efe88-9b19-414f-aea4-a6353396f9bf tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] Returning 404 to user: Instance group 75a4c18b-be54-4c24-ba44-e5bb6232d686 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:39.624377 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-764efe88-9b19-414f-aea4-a6353396f9bf tempest-ServerGroup264TestJSON-1998270477 tempest-ServerGroup264TestJSON-1998270477-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/75a4c18b-be54-4c24-ba44-e5bb6232d686" status: 404 len: 117 microversion: 2.64 time: 0.078817 Oct 04 20:52:39.624377 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 933/1861] 10.222.0.78 () {60 vars in 1307 bytes} [Tue Oct 4 20:52:39 2022] DELETE /compute/v2.1/os-server-groups/75a4c18b-be54-4c24-ba44-e5bb6232d686 => generated 117 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-ad4168fd-0eb3-4968-997e-dd0b66fbaa3b tempest-ServerPasswordTestJSON-1857326628 tempest-ServerPasswordTestJSON-1857326628-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5a537696-5d46-4f98-941a-807174082192) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:52:39.822740 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5a537696-5d46-4f98-941a-807174082192) Oct 04 20:52:39.831229 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.839189 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-ad4168fd-0eb3-4968-997e-dd0b66fbaa3b tempest-ServerPasswordTestJSON-1857326628 tempest-ServerPasswordTestJSON-1857326628-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:39.839189 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ad4168fd-0eb3-4968-997e-dd0b66fbaa3b tempest-ServerPasswordTestJSON-1857326628 tempest-ServerPasswordTestJSON-1857326628-project] Request method failure captured: Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 208 Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJ0VgIoDQEooghtUuUs_RxxquOjw3Cad7_0I7CwmD5rQ3Y6ewNyTydB99ANt9mv6T1wguOdBvT7fPVFktE5bVHmKc4GXMQcKnCOcHN46ETshasnw6AmmN1cYlXXSKf7oo_B5NHFZdHQebm1YgHgFqBldMWpDHJZoMoyWc9RC1tU01ZA Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: fa8ddddd74fb455ba31fac9874139134 Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerPasswordTestJSON-1857326628 Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fa8ddddd74fb455ba31fac9874139134", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fa8ddddd74fb455ba31fac9874139134"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fa8ddddd74fb455ba31fac9874139134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fa8ddddd74fb455ba31fac9874139134"}]}] Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerPasswordTestJSON-1857326628 Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: fa8ddddd74fb455ba31fac9874139134 Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1857326628 Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerPasswordTestJSON-1857326628-project Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 7e735f5c6064450fbfc9f400c215bd41 Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerPasswordTestJSON-1857326628-project Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2034133189", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "27c7409f-1dbf-4a82-a03b-8446fab427da"}]}} Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServerPasswordTestJSON-server-2034133189', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '27c7409f-1dbf-4a82-a03b-8446fab427da'}]}}} Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:52:39.840815 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5a537696-5d46-4f98-941a-807174082192) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:52:39.849510 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.860952 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:39.879603 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ad4168fd-0eb3-4968-997e-dd0b66fbaa3b tempest-ServerPasswordTestJSON-1857326628 tempest-ServerPasswordTestJSON-1857326628-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:52:39.879603 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:39.881971 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ad4168fd-0eb3-4968-997e-dd0b66fbaa3b tempest-ServerPasswordTestJSON-1857326628 tempest-ServerPasswordTestJSON-1857326628-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.228523 Oct 04 20:52:39.887090 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 929/1862] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:52:37 2022] POST /compute/v2.1/servers => generated 214 bytes in 2235 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:52:46.256513 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fbb3a5ec-08e4-4b5c-ad80-c47c1fdafd66 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Action: 'create', calling method: .version_select at 0x7f77ef13a160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1421806187", "metadata": {"Type": "work"}}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fbb3a5ec-08e4-4b5c-ad80-c47c1fdafd66 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Request method failure captured: Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 122 Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ0dcpvD1hXksye-I1jNLnVRaoGGWNGtROhAppHQAr2LnWj4mVOz7qnCgUtZY0twu_vgQt3g4a4DUKaPlk2DqBEu1OQLQ0G6ZZj7CHdDXu7auceAfaNbhZ3gevBUHSU88QR5qtKBdCpgPxaBWZc5fMf5byjJUj4F7e2Ozp3BGKUOT5s Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: d31cc90641634694a29b52dda2392c28 Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d31cc90641634694a29b52dda2392c28", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d31cc90641634694a29b52dda2392c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d31cc90641634694a29b52dda2392c28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d31cc90641634694a29b52dda2392c28"}]}] Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: d31cc90641634694a29b52dda2392c28 Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-VolumesNegativeTest-984074316-project Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b25e38bf6d854e40bbc93ff22664c846 Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-VolumesNegativeTest-984074316-project Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1421806187", "metadata": {"Type": "work"}}} Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1421806187', 'metadata': {'Type': 'work'}}}} Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:52:46.280085 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fbb3a5ec-08e4-4b5c-ad80-c47c1fdafd66 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fbb3a5ec-08e4-4b5c-ad80-c47c1fdafd66 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.600412 Oct 04 20:52:46.289935 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 934/1863] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 4 20:52:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 608 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:52:46.313476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fbfa7919-706e-4ad6-9a32-941146b305b9 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Action: 'create', calling method: .version_select at 0x7f77eec903a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-984075105", "metadata": {"Type": "work"}}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fbfa7919-706e-4ad6-9a32-941146b305b9 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Request method failure captured: Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 119 Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJ0dcpvD1hXksye-I1jNLnVRaoGGWNGtROhAppHQAr2LnWj4mVOz7qnCgUtZY0twu_vgQt3g4a4DUKaPlk2DqBEu1OQLQ0G6ZZj7CHdDXu7auceAfaNbhZ3gevBUHSU88QR5qtKBdCpgPxaBWZc5fMf5byjJUj4F7e2Ozp3BGKUOT5s Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: d31cc90641634694a29b52dda2392c28 Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d31cc90641634694a29b52dda2392c28", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d31cc90641634694a29b52dda2392c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d31cc90641634694a29b52dda2392c28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d31cc90641634694a29b52dda2392c28"}]}] Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: d31cc90641634694a29b52dda2392c28 Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-VolumesNegativeTest-984074316-project Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: b25e38bf6d854e40bbc93ff22664c846 Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-VolumesNegativeTest-984074316-project Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-984075105", "metadata": {"Type": "work"}}} Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-984075105', 'metadata': {'Type': 'work'}}}} Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi '0' Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:52:46.334955 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:52:46.348593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 20:52:46.348593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.348593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.348593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.348593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.348593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:46.348593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:46.348593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:52:46.348593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:52:46.348593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 20:52:46.348593 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.351911 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fbfa7919-706e-4ad6-9a32-941146b305b9 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:46.354091 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fbfa7919-706e-4ad6-9a32-941146b305b9 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.071672 Oct 04 20:52:46.367242 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 930/1864] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 4 20:52:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:52:46.392253 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7e13cad4-427d-4f48-b8e1-c03c0c7466bb tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Action: 'create', calling method: .version_select at 0x7f77ef1624c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-258527405", "metadata": {"Type": "work"}}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7e13cad4-427d-4f48-b8e1-c03c0c7466bb tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Request method failure captured: Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 118 Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ0dcpvD1hXksye-I1jNLnVRaoGGWNGtROhAppHQAr2LnWj4mVOz7qnCgUtZY0twu_vgQt3g4a4DUKaPlk2DqBEu1OQLQ0G6ZZj7CHdDXu7auceAfaNbhZ3gevBUHSU88QR5qtKBdCpgPxaBWZc5fMf5byjJUj4F7e2Ozp3BGKUOT5s Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: d31cc90641634694a29b52dda2392c28 Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d31cc90641634694a29b52dda2392c28", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d31cc90641634694a29b52dda2392c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d31cc90641634694a29b52dda2392c28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d31cc90641634694a29b52dda2392c28"}]}] Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: d31cc90641634694a29b52dda2392c28 Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-VolumesNegativeTest-984074316-project Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b25e38bf6d854e40bbc93ff22664c846 Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-VolumesNegativeTest-984074316-project Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-258527405", "metadata": {"Type": "work"}}} Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-258527405', 'metadata': {'Type': 'work'}}}} Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi '' Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:52:46.423103 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:52:46.428368 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 20:52:46.428368 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.428368 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.428368 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.428368 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.428368 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:46.428368 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:46.428368 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:52:46.428368 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:52:46.428368 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 20:52:46.428368 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.430330 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7e13cad4-427d-4f48-b8e1-c03c0c7466bb tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:46.436824 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7e13cad4-427d-4f48-b8e1-c03c0c7466bb tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.059122 Oct 04 20:52:46.438219 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 935/1865] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 4 20:52:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:52:46.447908 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b5a79026-75f1-4def-8d54-f9a93333220a tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] Action: 'create', calling method: .version_select at 0x7f77eeb0f3a0>, body: {"keypair": {"name": "tempest-keypair-1143726339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN81XrbYvZVF3hiURf5i4WgR69VxsD8h84gqApELgvOL2v+g3vj1bt3PyEl9vjnbA4p4QzKkgh7Fh/YCayz8ImUdz9+w6BuDbPGn0IfM/tBuiAC+hoqjE+g6p2ZK/NEhXw=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:46.462948 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2ce48a52-4284-4784-b741-0158912a4363 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Calling method '.version_select at 0x7f77eef01f70>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:46.515710 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-b5a79026-75f1-4def-8d54-f9a93333220a tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] Getting quotas for project bd8adb1a7e034cbeb6d40757ae7cf31b. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:46.530317 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-b5a79026-75f1-4def-8d54-f9a93333220a tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] Getting quotas for user 3fb1f6f1b6c24316bb09ff23ae0a9252 and project bd8adb1a7e034cbeb6d40757ae7cf31b. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:46.578278 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-2ce48a52-4284-4784-b741-0158912a4363 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] HTTP exception thrown: Volume tempest-invalid-1673242714 could not be found. Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2ce48a52-4284-4784-b741-0158912a4363 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Request method failure captured: Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1673242714 HTTP/1.1 Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ0dcpvD1hXksye-I1jNLnVRaoGGWNGtROhAppHQAr2LnWj4mVOz7qnCgUtZY0twu_vgQt3g4a4DUKaPlk2DqBEu1OQLQ0G6ZZj7CHdDXu7auceAfaNbhZ3gevBUHSU88QR5qtKBdCpgPxaBWZc5fMf5byjJUj4F7e2Ozp3BGKUOT5s Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: d31cc90641634694a29b52dda2392c28 Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d31cc90641634694a29b52dda2392c28", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d31cc90641634694a29b52dda2392c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d31cc90641634694a29b52dda2392c28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d31cc90641634694a29b52dda2392c28"}]}] Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: d31cc90641634694a29b52dda2392c28 Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-VolumesNegativeTest-984074316-project Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b25e38bf6d854e40bbc93ff22664c846 Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-VolumesNegativeTest-984074316-project Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: exception: Volume tempest-invalid-1673242714 could not be found. Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'tempest-invalid-1673242714'} Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1673242714 could not be found. (HTTP 404) (Request-ID: req-9f71277f-ed46-459a-b16a-845ec2f1af4f) Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:52:46.589169 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1673242714 could not be found. Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1673242714 could not be found. Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1673242714 could not be found. Oct 04 20:52:46.598234 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.613058 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2ce48a52-4284-4784-b741-0158912a4363 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Returning 404 to user: Volume tempest-invalid-1673242714 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:46.613058 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2ce48a52-4284-4784-b741-0158912a4363 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1673242714" status: 404 len: 99 microversion: 2.1 time: 0.152273 Oct 04 20:52:46.615410 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 936/1866] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 4 20:52:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1673242714 => generated 99 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:52:46.641185 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-63842f6c-5ecd-4c67-992c-76efdebac2d0 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009526 Oct 04 20:52:46.641185 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 937/1867] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Oct 4 20:52:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 20:52:46.660412 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8e822bc7-7e1b-4aed-9798-d18caab48c04 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008688 Oct 04 20:52:46.662488 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 938/1868] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 20:52:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 20:52:46.696261 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b64fa919-af72-4663-a705-053f174decb0 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Calling method '.version_select at 0x7f77ef4cedc0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:46.710729 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b5a79026-75f1-4def-8d54-f9a93333220a tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.276587 Oct 04 20:52:46.729985 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 931/1869] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 4 20:52:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 296 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:52:46.811877 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-b64fa919-af72-4663-a705-053f174decb0 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] HTTP exception thrown: Volume 8affd523-5972-4af7-91ec-05e7fd948be5 could not be found. Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b64fa919-af72-4663-a705-053f174decb0 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Request method failure captured: Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/os-volumes/8affd523-5972-4af7-91ec-05e7fd948be5 HTTP/1.1 Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ0dcpvD1hXksye-I1jNLnVRaoGGWNGtROhAppHQAr2LnWj4mVOz7qnCgUtZY0twu_vgQt3g4a4DUKaPlk2DqBEu1OQLQ0G6ZZj7CHdDXu7auceAfaNbhZ3gevBUHSU88QR5qtKBdCpgPxaBWZc5fMf5byjJUj4F7e2Ozp3BGKUOT5s Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: d31cc90641634694a29b52dda2392c28 Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d31cc90641634694a29b52dda2392c28", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d31cc90641634694a29b52dda2392c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d31cc90641634694a29b52dda2392c28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d31cc90641634694a29b52dda2392c28"}]}] Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: d31cc90641634694a29b52dda2392c28 Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-VolumesNegativeTest-984074316-project Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b25e38bf6d854e40bbc93ff22664c846 Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-VolumesNegativeTest-984074316-project Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: exception: Volume 8affd523-5972-4af7-91ec-05e7fd948be5 could not be found. Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '8affd523-5972-4af7-91ec-05e7fd948be5'} Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8affd523-5972-4af7-91ec-05e7fd948be5 could not be found. (HTTP 404) (Request-ID: req-2ad7df51-b932-4b38-805e-a8c0f185151a) Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:52:46.817485 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8affd523-5972-4af7-91ec-05e7fd948be5 could not be found. Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8affd523-5972-4af7-91ec-05e7fd948be5 could not be found. Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8affd523-5972-4af7-91ec-05e7fd948be5 could not be found. Oct 04 20:52:46.834549 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.857490 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b64fa919-af72-4663-a705-053f174decb0 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Returning 404 to user: Volume 8affd523-5972-4af7-91ec-05e7fd948be5 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:46.867424 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b64fa919-af72-4663-a705-053f174decb0 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/8affd523-5972-4af7-91ec-05e7fd948be5" status: 404 len: 109 microversion: 2.1 time: 0.187176 Oct 04 20:52:46.870344 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 939/1870] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:52:46 2022] DELETE /compute/v2.1/os-volumes/8affd523-5972-4af7-91ec-05e7fd948be5 => generated 109 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:52:46.891728 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0728bce4-e607-44a3-91b6-212ffe870b56 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Calling method '.version_select at 0x7f77eec29d30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:46.961242 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-0728bce4-e607-44a3-91b6-212ffe870b56 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] HTTP exception thrown: Volume 132a8052-18cd-4920-8dc3-4bfb56abcef7 could not be found. Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0728bce4-e607-44a3-91b6-212ffe870b56 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Request method failure captured: Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-volumes/132a8052-18cd-4920-8dc3-4bfb56abcef7 HTTP/1.1 Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJ0dcpvD1hXksye-I1jNLnVRaoGGWNGtROhAppHQAr2LnWj4mVOz7qnCgUtZY0twu_vgQt3g4a4DUKaPlk2DqBEu1OQLQ0G6ZZj7CHdDXu7auceAfaNbhZ3gevBUHSU88QR5qtKBdCpgPxaBWZc5fMf5byjJUj4F7e2Ozp3BGKUOT5s Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: d31cc90641634694a29b52dda2392c28 Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d31cc90641634694a29b52dda2392c28", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d31cc90641634694a29b52dda2392c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d31cc90641634694a29b52dda2392c28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d31cc90641634694a29b52dda2392c28"}]}] Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: d31cc90641634694a29b52dda2392c28 Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-VolumesNegativeTest-984074316 Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-VolumesNegativeTest-984074316-project Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: b25e38bf6d854e40bbc93ff22664c846 Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-VolumesNegativeTest-984074316-project Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: exception: Volume 132a8052-18cd-4920-8dc3-4bfb56abcef7 could not be found. Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '132a8052-18cd-4920-8dc3-4bfb56abcef7'} Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 132a8052-18cd-4920-8dc3-4bfb56abcef7 could not be found. (HTTP 404) (Request-ID: req-16624367-36a2-4ff4-893c-4132931b189a) Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:52:46.966354 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 132a8052-18cd-4920-8dc3-4bfb56abcef7 could not be found. Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 132a8052-18cd-4920-8dc3-4bfb56abcef7 could not be found. Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 132a8052-18cd-4920-8dc3-4bfb56abcef7 could not be found. Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0728bce4-e607-44a3-91b6-212ffe870b56 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] Returning 404 to user: Volume 132a8052-18cd-4920-8dc3-4bfb56abcef7 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0728bce4-e607-44a3-91b6-212ffe870b56 tempest-VolumesNegativeTest-984074316 tempest-VolumesNegativeTest-984074316-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/132a8052-18cd-4920-8dc3-4bfb56abcef7" status: 404 len: 109 microversion: 2.1 time: 0.093014 Oct 04 20:52:46.991669 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 932/1871] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:52:46 2022] GET /compute/v2.1/os-volumes/132a8052-18cd-4920-8dc3-4bfb56abcef7 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:04.938815 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=8 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:04.940782 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:04.943893 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:53:04.945972 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 20:53:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 20:53:04.977748 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-942bdf86-b859-49b5-8efa-cb727b8978ae tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-115205453", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d7e335bd-452b-4b28-a631-d8ec4632b1ff"}, {"port": "00f4fc37-fde3-4842-82c0-06054c0a879b", "tag": "port-1"}, {"port": "80ed0137-40fd-4177-9456-37478f3cc45f", "tag": "port-2"}, {"uuid": "8d2d5848-a194-4e51-833e-12e1ff126b76", "tag": "net-1"}, {"uuid": "8d2d5848-a194-4e51-833e-12e1ff126b76"}, {"uuid": "c5dfd2b2-03b5-4649-af3d-9e2e03b726c5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c5dfd2b2-03b5-4649-af3d-9e2e03b726c5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b06074fa-50d9-4a80-b292-bd74b590326e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3bac7269-0ea7-4012-b9d7-b50fb8a5de13", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5bbece24-7080-493b-8c18-94c5573b6256", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1860042354"}], "key_name": "tempest-keypair-1143726339", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:05.533394 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-942bdf86-b859-49b5-8efa-cb727b8978ae tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] validate_networks() for [('d7e335bd-452b-4b28-a631-d8ec4632b1ff', None, None, None, None, None), (None, None, '00f4fc37-fde3-4842-82c0-06054c0a879b', None, None, None), (None, None, '80ed0137-40fd-4177-9456-37478f3cc45f', None, None, None), ('8d2d5848-a194-4e51-833e-12e1ff126b76', None, None, None, None, None), ('8d2d5848-a194-4e51-833e-12e1ff126b76', None, None, None, None, None), ('c5dfd2b2-03b5-4649-af3d-9e2e03b726c5', '10.2.2.100', None, None, None, None), ('c5dfd2b2-03b5-4649-af3d-9e2e03b726c5', '10.2.2.200', None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-942bdf86-b859-49b5-8efa-cb727b8978ae tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a1d3095b-7314-4089-87d9-9e33740319a0) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:53:09.524049 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a1d3095b-7314-4089-87d9-9e33740319a0) Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-942bdf86-b859-49b5-8efa-cb727b8978ae tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-942bdf86-b859-49b5-8efa-cb727b8978ae tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] Request method failure captured: Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 1344 Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJyOZu2Qc5bAIZu1_zb8whlBOgPFcKH2cr5a-rEZYwwl9kKDfUTf8yoo5PGNt9v9RtGXWz8aQt1Njhcw4K9jGSTlCQ7KdvJBjohAGrnDTxxMhB5tQ7zJPDkWFKDXPEFaDkfwyj0znae4cdJxy3gvBSNYQzoOETQJxLwaGg_UZsS4D0w Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: bd8adb1a7e034cbeb6d40757ae7cf31b Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TaggedBootDevicesTest-446184929 Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bd8adb1a7e034cbeb6d40757ae7cf31b", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bd8adb1a7e034cbeb6d40757ae7cf31b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bd8adb1a7e034cbeb6d40757ae7cf31b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bd8adb1a7e034cbeb6d40757ae7cf31b"}]}] Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TaggedBootDevicesTest-446184929 Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: bd8adb1a7e034cbeb6d40757ae7cf31b Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TaggedBootDevicesTest-446184929 Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TaggedBootDevicesTest-446184929-project Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 3fb1f6f1b6c24316bb09ff23ae0a9252 Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TaggedBootDevicesTest-446184929-project Oct 04 20:53:09.534031 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-device-tagging-server-115205453", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d7e335bd-452b-4b28-a631-d8ec4632b1ff"}, {"port": "00f4fc37-fde3-4842-82c0-06054c0a879b", "tag": "port-1"}, {"port": "80ed0137-40fd-4177-9456-37478f3cc45f", "tag": "port-2"}, {"uuid": "8d2d5848-a194-4e51-833e-12e1ff126b76", "tag": "net-1"}, {"uuid": "8d2d5848-a194-4e51-833e-12e1ff126b76"}, {"uuid": "c5dfd2b2-03b5-4649-af3d-9e2e03b726c5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c5dfd2b2-03b5-4649-af3d-9e2e03b726c5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b06074fa-50d9-4a80-b292-bd74b590326e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3bac7269-0ea7-4012-b9d7-b50fb8a5de13", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5bbece24-7080-493b-8c18-94c5573b6256", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1860042354"}], "key_name": "tempest-keypair-1143726339", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-device-tagging-server-115205453', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': 'd7e335bd-452b-4b28-a631-d8ec4632b1ff'}, {'port': '00f4fc37-fde3-4842-82c0-06054c0a879b', 'tag': 'port-1'}, {'port': '80ed0137-40fd-4177-9456-37478f3cc45f', 'tag': 'port-2'}, {'uuid': '8d2d5848-a194-4e51-833e-12e1ff126b76', 'tag': 'net-1'}, {'uuid': '8d2d5848-a194-4e51-833e-12e1ff126b76'}, {'uuid': 'c5dfd2b2-03b5-4649-af3d-9e2e03b726c5', 'fixed_ip': '10.2.2.100', 'tag': 'net-2-100'}, {'uuid': 'c5dfd2b2-03b5-4649-af3d-9e2e03b726c5', 'fixed_ip': '10.2.2.200', 'tag': 'net-2-200'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'tag': 'boot', 'volume_id': 'b06074fa-50d9-4a80-b292-bd74b590326e', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 1, 'tag': 'other', 'volume_id': '3bac7269-0ea7-4012-b9d7-b50fb8a5de13', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 2, 'volume_id': '5bbece24-7080-493b-8c18-94c5573b6256', 'delete_on_termination': False}], 'security_groups': [{'name': 'tempest-securitygroup--1860042354'}], 'key_name': 'tempest-keypair-1143726339', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:09.542532 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a1d3095b-7314-4089-87d9-9e33740319a0) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.549795 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:09.561658 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.561658 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:09.561658 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:09.561658 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:09.561658 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:09.561658 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:09.561658 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:53:09.561658 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.561658 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.561658 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-942bdf86-b859-49b5-8efa-cb727b8978ae tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:53:09.561658 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:09.561658 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-942bdf86-b859-49b5-8efa-cb727b8978ae tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.32 time: 4.600409 Oct 04 20:53:09.569761 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:09.569761 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:09.570640 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 940/1872] 10.222.0.78 () {62 vars in 1189 bytes} [Tue Oct 4 20:53:04 2022] POST /compute/v2.1/servers => generated 214 bytes in 4622 msecs (HTTP/1.1 500) 9 headers in 393 bytes (2 switches on core 0) Oct 04 20:53:09.571889 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-609cb4cd-879b-4732-b46d-75d350524da8 tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] Calling method '.version_select at 0x7f77eebc8d30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:09.711604 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-609cb4cd-879b-4732-b46d-75d350524da8 tempest-TaggedBootDevicesTest-446184929 tempest-TaggedBootDevicesTest-446184929-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143726339" status: 204 len: 0 microversion: 2.32 time: 0.162951 Oct 04 20:53:09.713849 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 933/1873] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Oct 4 20:53:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143726339 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 20:53:21.857078 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:22.950001 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-97053061", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": "none"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:23.168739 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:53:23.170835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:53:23.172122 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:53:23.173197 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:53:23.174303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:53:23.194164 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:23.195657 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:23.196818 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:23.198880 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:23.200395 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:23.202070 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:23.244173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Getting quotas for project 28d648bc85694df58d795f914acd4843. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:53:23.256553 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Getting quotas for user 8ca55756d08d40fb8464b859f5945e64 and project 28d648bc85694df58d795f914acd4843. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:53:23.304514 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:53:23.316276 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:53:23.645468 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d21be31e-0fc1-4ad3-9965-e5830004f927 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.790294 Oct 04 20:53:23.648302 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 941/1874] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:53:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 20:53:23.672852 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1927ccc5-8ed0-49ed-b83e-ed5a2821474b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:23.686417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1927ccc5-8ed0-49ed-b83e-ed5a2821474b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:23.696663 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:53:23.702693 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 20:53:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 (ip 10.222.0.78) !!! Oct 04 20:53:23.903696 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1927ccc5-8ed0-49ed-b83e-ed5a2821474b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:23.923916 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1927ccc5-8ed0-49ed-b83e-ed5a2821474b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:23.928642 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1927ccc5-8ed0-49ed-b83e-ed5a2821474b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:23.933215 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1927ccc5-8ed0-49ed-b83e-ed5a2821474b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1276 microversion: 2.54 time: 0.270918 Oct 04 20:53:23.938318 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 934/1875] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:23 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:24.985644 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2fc462c4-afb1-4fbe-b2d0-6d7e014fbe5e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:24.988142 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2fc462c4-afb1-4fbe-b2d0-6d7e014fbe5e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:25.184445 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2fc462c4-afb1-4fbe-b2d0-6d7e014fbe5e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:25.213779 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2fc462c4-afb1-4fbe-b2d0-6d7e014fbe5e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:25.227508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2fc462c4-afb1-4fbe-b2d0-6d7e014fbe5e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:25.229858 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2fc462c4-afb1-4fbe-b2d0-6d7e014fbe5e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1276 microversion: 2.54 time: 0.251595 Oct 04 20:53:25.231490 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 942/1876] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:24 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:26.290078 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8a3d599d-0a4a-42c2-b5dd-f6f04621bc4e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:26.304894 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8a3d599d-0a4a-42c2-b5dd-f6f04621bc4e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:26.801763 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8a3d599d-0a4a-42c2-b5dd-f6f04621bc4e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:26.840872 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8a3d599d-0a4a-42c2-b5dd-f6f04621bc4e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:26.844567 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8a3d599d-0a4a-42c2-b5dd-f6f04621bc4e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:26.848259 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8a3d599d-0a4a-42c2-b5dd-f6f04621bc4e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1276 microversion: 2.54 time: 0.565170 Oct 04 20:53:26.875192 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 935/1877] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:26 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1276 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:27.929929 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ff318486-0e18-4c77-81e5-018d5ac8a6ae tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:27.934673 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ff318486-0e18-4c77-81e5-018d5ac8a6ae tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:27.986180 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff318486-0e18-4c77-81e5-018d5ac8a6ae tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:27.987119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff318486-0e18-4c77-81e5-018d5ac8a6ae tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:27.988724 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff318486-0e18-4c77-81e5-018d5ac8a6ae tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:27.994119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff318486-0e18-4c77-81e5-018d5ac8a6ae tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:28.000664 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff318486-0e18-4c77-81e5-018d5ac8a6ae tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:28.004428 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ff318486-0e18-4c77-81e5-018d5ac8a6ae tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:28.385034 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ff318486-0e18-4c77-81e5-018d5ac8a6ae tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:28.429801 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ff318486-0e18-4c77-81e5-018d5ac8a6ae tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:28.434477 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ff318486-0e18-4c77-81e5-018d5ac8a6ae tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:28.439336 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ff318486-0e18-4c77-81e5-018d5ac8a6ae tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1272 microversion: 2.54 time: 0.530017 Oct 04 20:53:28.440839 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 943/1878] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:27 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1272 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:29.503180 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ae95e009-1550-4fbb-ad0c-a6494f869152 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:29.504605 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ae95e009-1550-4fbb-ad0c-a6494f869152 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:29.572260 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ae95e009-1550-4fbb-ad0c-a6494f869152 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:29.573578 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ae95e009-1550-4fbb-ad0c-a6494f869152 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:29.574392 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ae95e009-1550-4fbb-ad0c-a6494f869152 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:29.576360 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ae95e009-1550-4fbb-ad0c-a6494f869152 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:29.577288 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ae95e009-1550-4fbb-ad0c-a6494f869152 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:29.578106 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ae95e009-1550-4fbb-ad0c-a6494f869152 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:29.939040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ae95e009-1550-4fbb-ad0c-a6494f869152 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:29.991365 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ae95e009-1550-4fbb-ad0c-a6494f869152 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:29.994726 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ae95e009-1550-4fbb-ad0c-a6494f869152 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:29.997258 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ae95e009-1550-4fbb-ad0c-a6494f869152 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1336 microversion: 2.54 time: 0.502171 Oct 04 20:53:30.014632 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 936/1879] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:29 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1336 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:31.054077 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-67c596bf-aa29-4f5b-b404-8417dd7cdda2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:31.059845 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-67c596bf-aa29-4f5b-b404-8417dd7cdda2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:31.095110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-67c596bf-aa29-4f5b-b404-8417dd7cdda2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:31.097167 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-67c596bf-aa29-4f5b-b404-8417dd7cdda2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:31.098576 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-67c596bf-aa29-4f5b-b404-8417dd7cdda2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:31.100480 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-67c596bf-aa29-4f5b-b404-8417dd7cdda2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:31.103894 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-67c596bf-aa29-4f5b-b404-8417dd7cdda2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:31.107214 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-67c596bf-aa29-4f5b-b404-8417dd7cdda2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:31.879284 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-67c596bf-aa29-4f5b-b404-8417dd7cdda2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:31.917523 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-67c596bf-aa29-4f5b-b404-8417dd7cdda2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:31.929211 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-67c596bf-aa29-4f5b-b404-8417dd7cdda2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:31.932068 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-67c596bf-aa29-4f5b-b404-8417dd7cdda2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1334 microversion: 2.54 time: 0.888498 Oct 04 20:53:31.968195 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 944/1880] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:31 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1334 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:33.014392 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b04bfab8-22e1-40c8-b834-aee7bb867040 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:33.019174 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b04bfab8-22e1-40c8-b834-aee7bb867040 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:33.065700 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b04bfab8-22e1-40c8-b834-aee7bb867040 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:33.065700 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b04bfab8-22e1-40c8-b834-aee7bb867040 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:33.065700 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b04bfab8-22e1-40c8-b834-aee7bb867040 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:33.067551 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b04bfab8-22e1-40c8-b834-aee7bb867040 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:33.071745 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b04bfab8-22e1-40c8-b834-aee7bb867040 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:33.084092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b04bfab8-22e1-40c8-b834-aee7bb867040 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:33.549208 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b04bfab8-22e1-40c8-b834-aee7bb867040 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:33.583496 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b04bfab8-22e1-40c8-b834-aee7bb867040 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:33.597945 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b04bfab8-22e1-40c8-b834-aee7bb867040 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:33.597945 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b04bfab8-22e1-40c8-b834-aee7bb867040 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1334 microversion: 2.54 time: 0.597841 Oct 04 20:53:33.611667 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 937/1881] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:32 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1334 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:34.650656 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-54150bb8-61d5-4ea7-9367-c50eb5d99237 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:34.660882 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-54150bb8-61d5-4ea7-9367-c50eb5d99237 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:34.692582 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:34.751384 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-54150bb8-61d5-4ea7-9367-c50eb5d99237 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:34.759304 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-54150bb8-61d5-4ea7-9367-c50eb5d99237 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:34.760100 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-54150bb8-61d5-4ea7-9367-c50eb5d99237 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:34.761493 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-54150bb8-61d5-4ea7-9367-c50eb5d99237 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:34.762374 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-54150bb8-61d5-4ea7-9367-c50eb5d99237 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:34.763763 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-54150bb8-61d5-4ea7-9367-c50eb5d99237 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:35.066590 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:53:35.066892 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 20:53:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 (ip 10.222.0.78) !!! Oct 04 20:53:35.209497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=8 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:36.345257 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-54150bb8-61d5-4ea7-9367-c50eb5d99237 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:36.384080 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-54150bb8-61d5-4ea7-9367-c50eb5d99237 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:36.400342 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-54150bb8-61d5-4ea7-9367-c50eb5d99237 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:36.402695 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-54150bb8-61d5-4ea7-9367-c50eb5d99237 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1334 microversion: 2.54 time: 1.764660 Oct 04 20:53:36.436039 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 945/1882] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:34 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1334 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:37.456399 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:37.466412 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a7d4e639-c173-4e9d-8e2e-786c319697c6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:37.477420 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a7d4e639-c173-4e9d-8e2e-786c319697c6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:37.517196 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a7d4e639-c173-4e9d-8e2e-786c319697c6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:37.521253 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a7d4e639-c173-4e9d-8e2e-786c319697c6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:37.523374 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a7d4e639-c173-4e9d-8e2e-786c319697c6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:37.531974 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a7d4e639-c173-4e9d-8e2e-786c319697c6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:37.539652 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a7d4e639-c173-4e9d-8e2e-786c319697c6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:37.542035 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a7d4e639-c173-4e9d-8e2e-786c319697c6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:39.166447 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a7d4e639-c173-4e9d-8e2e-786c319697c6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:39.222903 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a7d4e639-c173-4e9d-8e2e-786c319697c6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:39.240298 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a7d4e639-c173-4e9d-8e2e-786c319697c6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:39.245255 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a7d4e639-c173-4e9d-8e2e-786c319697c6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1355 microversion: 2.54 time: 1.790228 Oct 04 20:53:39.250147 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 938/1883] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:37 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1355 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:53:39.307429 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-82b9ab4e-57f3-4477-adb0-400f44cbe709 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Action: 'create', calling method: .version_select at 0x7f77ef43ac10>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1386355331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6se5iaaH18ZkLd13AMnHHbJSAc0hFpbC6sHt69JPorsl5Vat3zu15NiLFYxYjQFg5+RocgjYouehwVlGjg7VZxTbVnR1j/VBqeiSs/BM4E9lR8y6IE+xVTcLxLf+JX+A=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:39.342521 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-82b9ab4e-57f3-4477-adb0-400f44cbe709 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Getting quotas for project 28d648bc85694df58d795f914acd4843. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:53:39.357484 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-82b9ab4e-57f3-4477-adb0-400f44cbe709 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Getting quotas for user 8ca55756d08d40fb8464b859f5945e64 and project 28d648bc85694df58d795f914acd4843. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:53:39.736941 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-82b9ab4e-57f3-4477-adb0-400f44cbe709 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.436498 Oct 04 20:53:39.745667 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 946/1884] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Oct 4 20:53:39 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 439 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:53:39.770046 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1386355331", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:39.788392 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:39.826598 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:39.834663 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:39.842912 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:39.844428 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:39.845267 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:39.846034 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:40.490375 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:53:40.495195 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:53:40.499325 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:53:40.500307 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:53:40.506807 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:53:41.340172 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:41.397003 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:41.398006 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:41.405433 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:41.407011 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:41.407989 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:41.408822 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:41.635400 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3b5fe6bd-c4a6-4984-85d5-ac4f6e8465de tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "POST /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8/action" status: 202 len: 1138 microversion: 2.54 time: 1.881662 Oct 04 20:53:41.639893 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 939/1885] 10.222.0.78 () {62 vars in 1320 bytes} [Tue Oct 4 20:53:39 2022] POST /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8/action => generated 1138 bytes in 1888 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 04 20:53:41.715409 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5f30f23d-3e22-448b-904e-d491ad2cb02c tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:41.717598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-5f30f23d-3e22-448b-904e-d491ad2cb02c tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:41.734085 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5f30f23d-3e22-448b-904e-d491ad2cb02c tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:41.734835 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5f30f23d-3e22-448b-904e-d491ad2cb02c tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:41.737406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5f30f23d-3e22-448b-904e-d491ad2cb02c tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:41.739738 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5f30f23d-3e22-448b-904e-d491ad2cb02c tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:41.740995 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5f30f23d-3e22-448b-904e-d491ad2cb02c tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:41.742082 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5f30f23d-3e22-448b-904e-d491ad2cb02c tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:42.822161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5f30f23d-3e22-448b-904e-d491ad2cb02c tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:42.860060 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5f30f23d-3e22-448b-904e-d491ad2cb02c tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:42.868875 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5f30f23d-3e22-448b-904e-d491ad2cb02c tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:42.881960 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5f30f23d-3e22-448b-904e-d491ad2cb02c tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 1.207598 Oct 04 20:53:42.909878 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 947/1886] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:41 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:43.949298 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bb3ee91f-0f31-499f-b6c1-a6b5a5c2cd7e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:43.955542 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-bb3ee91f-0f31-499f-b6c1-a6b5a5c2cd7e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:44.001195 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bb3ee91f-0f31-499f-b6c1-a6b5a5c2cd7e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:44.010546 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bb3ee91f-0f31-499f-b6c1-a6b5a5c2cd7e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:44.013434 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bb3ee91f-0f31-499f-b6c1-a6b5a5c2cd7e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:44.021807 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bb3ee91f-0f31-499f-b6c1-a6b5a5c2cd7e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:44.023082 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bb3ee91f-0f31-499f-b6c1-a6b5a5c2cd7e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:44.027094 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bb3ee91f-0f31-499f-b6c1-a6b5a5c2cd7e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:44.533660 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-bb3ee91f-0f31-499f-b6c1-a6b5a5c2cd7e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:44.634004 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-bb3ee91f-0f31-499f-b6c1-a6b5a5c2cd7e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:44.636131 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-bb3ee91f-0f31-499f-b6c1-a6b5a5c2cd7e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:44.661041 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bb3ee91f-0f31-499f-b6c1-a6b5a5c2cd7e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 0.719209 Oct 04 20:53:44.670578 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 940/1887] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:43 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:45.721855 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e3a1982f-bc57-4768-87cf-25d32965d461 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:45.724811 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e3a1982f-bc57-4768-87cf-25d32965d461 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:45.753057 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3a1982f-bc57-4768-87cf-25d32965d461 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:45.753965 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3a1982f-bc57-4768-87cf-25d32965d461 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:45.754753 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3a1982f-bc57-4768-87cf-25d32965d461 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:45.756115 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3a1982f-bc57-4768-87cf-25d32965d461 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:45.756985 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3a1982f-bc57-4768-87cf-25d32965d461 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:45.757747 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3a1982f-bc57-4768-87cf-25d32965d461 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:46.391116 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e3a1982f-bc57-4768-87cf-25d32965d461 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:46.434753 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e3a1982f-bc57-4768-87cf-25d32965d461 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:46.449453 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e3a1982f-bc57-4768-87cf-25d32965d461 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:46.452569 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e3a1982f-bc57-4768-87cf-25d32965d461 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 0.742152 Oct 04 20:53:46.477086 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 948/1888] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:45 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:47.532252 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a19fee86-fce5-40bc-b5ea-dc8f5d9f2091 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:47.533391 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a19fee86-fce5-40bc-b5ea-dc8f5d9f2091 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:47.628017 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a19fee86-fce5-40bc-b5ea-dc8f5d9f2091 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:47.629331 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a19fee86-fce5-40bc-b5ea-dc8f5d9f2091 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:47.630212 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a19fee86-fce5-40bc-b5ea-dc8f5d9f2091 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:47.637335 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a19fee86-fce5-40bc-b5ea-dc8f5d9f2091 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:47.639171 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a19fee86-fce5-40bc-b5ea-dc8f5d9f2091 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:47.644163 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a19fee86-fce5-40bc-b5ea-dc8f5d9f2091 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:49.094762 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a19fee86-fce5-40bc-b5ea-dc8f5d9f2091 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:49.129288 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a19fee86-fce5-40bc-b5ea-dc8f5d9f2091 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:49.138530 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a19fee86-fce5-40bc-b5ea-dc8f5d9f2091 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:49.142582 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a19fee86-fce5-40bc-b5ea-dc8f5d9f2091 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 1.617421 Oct 04 20:53:49.146982 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 941/1889] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:47 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:50.211208 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-13274b2d-fc9b-4bec-a81d-693a190bf642 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:50.216071 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-13274b2d-fc9b-4bec-a81d-693a190bf642 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:50.297909 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:50.310411 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-13274b2d-fc9b-4bec-a81d-693a190bf642 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:50.313617 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-13274b2d-fc9b-4bec-a81d-693a190bf642 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:50.315365 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-13274b2d-fc9b-4bec-a81d-693a190bf642 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:50.322848 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-13274b2d-fc9b-4bec-a81d-693a190bf642 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:50.323598 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-13274b2d-fc9b-4bec-a81d-693a190bf642 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:50.348621 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-13274b2d-fc9b-4bec-a81d-693a190bf642 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:50.938964 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-13274b2d-fc9b-4bec-a81d-693a190bf642 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:50.963480 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-13274b2d-fc9b-4bec-a81d-693a190bf642 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:50.972932 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-13274b2d-fc9b-4bec-a81d-693a190bf642 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:50.975769 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-13274b2d-fc9b-4bec-a81d-693a190bf642 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 0.776454 Oct 04 20:53:50.992358 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 949/1890] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:50 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:52.024853 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b0959196-19ea-4f16-be26-df09410e1975 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:52.030505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-b0959196-19ea-4f16-be26-df09410e1975 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:52.047206 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0959196-19ea-4f16-be26-df09410e1975 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:52.050671 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0959196-19ea-4f16-be26-df09410e1975 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:52.054143 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0959196-19ea-4f16-be26-df09410e1975 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:52.060373 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0959196-19ea-4f16-be26-df09410e1975 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:52.061534 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0959196-19ea-4f16-be26-df09410e1975 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:52.062526 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-b0959196-19ea-4f16-be26-df09410e1975 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:52.414747 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b0959196-19ea-4f16-be26-df09410e1975 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:52.445781 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b0959196-19ea-4f16-be26-df09410e1975 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:52.457815 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-b0959196-19ea-4f16-be26-df09410e1975 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:52.461784 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b0959196-19ea-4f16-be26-df09410e1975 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 0.444641 Oct 04 20:53:52.470269 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 942/1891] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:52 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:53.529329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1891ef3d-6bd5-44a6-86ab-af304fa60005 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:53.536142 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-1891ef3d-6bd5-44a6-86ab-af304fa60005 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:53.575026 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:53.578508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1891ef3d-6bd5-44a6-86ab-af304fa60005 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:53.581691 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1891ef3d-6bd5-44a6-86ab-af304fa60005 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:53.582526 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1891ef3d-6bd5-44a6-86ab-af304fa60005 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:53.589104 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1891ef3d-6bd5-44a6-86ab-af304fa60005 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:53.590089 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1891ef3d-6bd5-44a6-86ab-af304fa60005 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:53.593180 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1891ef3d-6bd5-44a6-86ab-af304fa60005 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:53.708990 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=39 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:54.124845 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-1891ef3d-6bd5-44a6-86ab-af304fa60005 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:54.162337 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-1891ef3d-6bd5-44a6-86ab-af304fa60005 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:54.166659 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-1891ef3d-6bd5-44a6-86ab-af304fa60005 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:54.175507 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1891ef3d-6bd5-44a6-86ab-af304fa60005 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 0.658760 Oct 04 20:53:54.177587 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 950/1892] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:53 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:53:55.240551 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-137d1285-2fda-46da-9d6a-b7ab56945cf6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:55.248055 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-137d1285-2fda-46da-9d6a-b7ab56945cf6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:55.287375 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-137d1285-2fda-46da-9d6a-b7ab56945cf6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:55.295291 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-137d1285-2fda-46da-9d6a-b7ab56945cf6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:55.305202 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-137d1285-2fda-46da-9d6a-b7ab56945cf6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:55.306669 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-137d1285-2fda-46da-9d6a-b7ab56945cf6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:55.313146 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-137d1285-2fda-46da-9d6a-b7ab56945cf6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:55.317354 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-137d1285-2fda-46da-9d6a-b7ab56945cf6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:55.433363 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:55.731997 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-137d1285-2fda-46da-9d6a-b7ab56945cf6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:55.832824 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-137d1285-2fda-46da-9d6a-b7ab56945cf6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:55.850513 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-137d1285-2fda-46da-9d6a-b7ab56945cf6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:55.859871 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-137d1285-2fda-46da-9d6a-b7ab56945cf6 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 0.622040 Oct 04 20:53:55.880971 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 943/1893] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:55 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:56.934699 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b241e42c-a328-475f-91a7-0cc7fbc0bfda tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:56.941458 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b241e42c-a328-475f-91a7-0cc7fbc0bfda tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:56.968227 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b241e42c-a328-475f-91a7-0cc7fbc0bfda tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:56.986813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b241e42c-a328-475f-91a7-0cc7fbc0bfda tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:56.986813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b241e42c-a328-475f-91a7-0cc7fbc0bfda tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:56.986813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b241e42c-a328-475f-91a7-0cc7fbc0bfda tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:56.986813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b241e42c-a328-475f-91a7-0cc7fbc0bfda tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:56.986813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b241e42c-a328-475f-91a7-0cc7fbc0bfda tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:57.420548 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b241e42c-a328-475f-91a7-0cc7fbc0bfda tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:57.465633 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b241e42c-a328-475f-91a7-0cc7fbc0bfda tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:57.477986 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b241e42c-a328-475f-91a7-0cc7fbc0bfda tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:57.488639 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b241e42c-a328-475f-91a7-0cc7fbc0bfda tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 0.552414 Oct 04 20:53:57.500972 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 951/1894] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:56 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:53:58.543483 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-65556d93-9e62-407b-b077-73f49f931d8e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:58.549548 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-65556d93-9e62-407b-b077-73f49f931d8e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:58.611711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:58.639552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-65556d93-9e62-407b-b077-73f49f931d8e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:58.661520 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-65556d93-9e62-407b-b077-73f49f931d8e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:58.664941 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-65556d93-9e62-407b-b077-73f49f931d8e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:58.684021 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-65556d93-9e62-407b-b077-73f49f931d8e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:58.684021 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-65556d93-9e62-407b-b077-73f49f931d8e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:58.684021 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-65556d93-9e62-407b-b077-73f49f931d8e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:59.922369 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-65556d93-9e62-407b-b077-73f49f931d8e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:59.961597 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-65556d93-9e62-407b-b077-73f49f931d8e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:59.970982 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-65556d93-9e62-407b-b077-73f49f931d8e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:59.982027 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-65556d93-9e62-407b-b077-73f49f931d8e tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 1.443450 Oct 04 20:53:59.984647 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 944/1895] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:58 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:54:01.071511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6a9e0389-73a5-4c11-96fd-f99fbcd26146 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:01.071511 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6a9e0389-73a5-4c11-96fd-f99fbcd26146 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:01.078427 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a9e0389-73a5-4c11-96fd-f99fbcd26146 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:01.078721 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a9e0389-73a5-4c11-96fd-f99fbcd26146 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:01.080158 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a9e0389-73a5-4c11-96fd-f99fbcd26146 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:01.082514 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a9e0389-73a5-4c11-96fd-f99fbcd26146 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:01.095637 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a9e0389-73a5-4c11-96fd-f99fbcd26146 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:01.100940 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6a9e0389-73a5-4c11-96fd-f99fbcd26146 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:01.745220 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6a9e0389-73a5-4c11-96fd-f99fbcd26146 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:01.773489 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6a9e0389-73a5-4c11-96fd-f99fbcd26146 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:01.781364 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6a9e0389-73a5-4c11-96fd-f99fbcd26146 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:01.786044 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6a9e0389-73a5-4c11-96fd-f99fbcd26146 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 0.743095 Oct 04 20:54:01.789764 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 952/1896] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:01 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:02.856563 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-81108c80-02cd-4ef6-8d35-291a9fdc7781 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:02.858995 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-81108c80-02cd-4ef6-8d35-291a9fdc7781 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:02.877167 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-81108c80-02cd-4ef6-8d35-291a9fdc7781 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.880136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-81108c80-02cd-4ef6-8d35-291a9fdc7781 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.880136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-81108c80-02cd-4ef6-8d35-291a9fdc7781 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:02.881735 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-81108c80-02cd-4ef6-8d35-291a9fdc7781 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.883026 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-81108c80-02cd-4ef6-8d35-291a9fdc7781 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.884226 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-81108c80-02cd-4ef6-8d35-291a9fdc7781 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:03.286283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-81108c80-02cd-4ef6-8d35-291a9fdc7781 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:03.316921 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-81108c80-02cd-4ef6-8d35-291a9fdc7781 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:03.320140 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-81108c80-02cd-4ef6-8d35-291a9fdc7781 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:03.323122 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-81108c80-02cd-4ef6-8d35-291a9fdc7781 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 0.477961 Oct 04 20:54:03.340349 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 945/1897] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:02 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:04.384798 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6afb451e-ef9c-430b-9f9d-fb0be2305c13 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:04.391813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-6afb451e-ef9c-430b-9f9d-fb0be2305c13 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:04.434877 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6afb451e-ef9c-430b-9f9d-fb0be2305c13 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:04.438246 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6afb451e-ef9c-430b-9f9d-fb0be2305c13 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:04.440616 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6afb451e-ef9c-430b-9f9d-fb0be2305c13 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:04.445875 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6afb451e-ef9c-430b-9f9d-fb0be2305c13 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:04.447233 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6afb451e-ef9c-430b-9f9d-fb0be2305c13 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:04.448047 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-6afb451e-ef9c-430b-9f9d-fb0be2305c13 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:04.827445 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6afb451e-ef9c-430b-9f9d-fb0be2305c13 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:04.878424 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6afb451e-ef9c-430b-9f9d-fb0be2305c13 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:04.878953 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-6afb451e-ef9c-430b-9f9d-fb0be2305c13 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:04.881077 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6afb451e-ef9c-430b-9f9d-fb0be2305c13 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1407 microversion: 2.54 time: 0.512845 Oct 04 20:54:04.894856 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 953/1898] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:04 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1407 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:05.951072 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ca5d6055-29b9-4595-8c54-18521fb956c7 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:05.953379 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ca5d6055-29b9-4595-8c54-18521fb956c7 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:05.971886 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca5d6055-29b9-4595-8c54-18521fb956c7 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:05.975835 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca5d6055-29b9-4595-8c54-18521fb956c7 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:05.979382 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca5d6055-29b9-4595-8c54-18521fb956c7 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:05.984908 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca5d6055-29b9-4595-8c54-18521fb956c7 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:05.988531 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca5d6055-29b9-4595-8c54-18521fb956c7 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:05.989802 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca5d6055-29b9-4595-8c54-18521fb956c7 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:06.350491 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ca5d6055-29b9-4595-8c54-18521fb956c7 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:06.391883 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ca5d6055-29b9-4595-8c54-18521fb956c7 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:06.395083 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ca5d6055-29b9-4595-8c54-18521fb956c7 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:06.398340 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ca5d6055-29b9-4595-8c54-18521fb956c7 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1413 microversion: 2.54 time: 0.455780 Oct 04 20:54:06.402438 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 946/1899] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:05 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1413 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:07.461173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8633053e-a4eb-4db2-8136-d1bec48bfa3b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:07.464231 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8633053e-a4eb-4db2-8136-d1bec48bfa3b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:07.484518 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8633053e-a4eb-4db2-8136-d1bec48bfa3b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:07.486189 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8633053e-a4eb-4db2-8136-d1bec48bfa3b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:07.487446 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8633053e-a4eb-4db2-8136-d1bec48bfa3b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:07.489852 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8633053e-a4eb-4db2-8136-d1bec48bfa3b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:07.491054 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8633053e-a4eb-4db2-8136-d1bec48bfa3b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:07.492869 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8633053e-a4eb-4db2-8136-d1bec48bfa3b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:07.729026 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8633053e-a4eb-4db2-8136-d1bec48bfa3b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:07.759196 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8633053e-a4eb-4db2-8136-d1bec48bfa3b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:07.776637 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8633053e-a4eb-4db2-8136-d1bec48bfa3b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:07.779599 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8633053e-a4eb-4db2-8136-d1bec48bfa3b tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1413 microversion: 2.54 time: 0.328680 Oct 04 20:54:07.780713 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 954/1900] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:07 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1413 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:08.833909 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-aa399942-97f5-4c43-b74c-f49302421897 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:08.836490 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-aa399942-97f5-4c43-b74c-f49302421897 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:08.850495 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-aa399942-97f5-4c43-b74c-f49302421897 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:08.851960 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-aa399942-97f5-4c43-b74c-f49302421897 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:08.853484 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-aa399942-97f5-4c43-b74c-f49302421897 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:08.855912 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-aa399942-97f5-4c43-b74c-f49302421897 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:08.857112 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-aa399942-97f5-4c43-b74c-f49302421897 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:08.858197 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-aa399942-97f5-4c43-b74c-f49302421897 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:09.031868 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-aa399942-97f5-4c43-b74c-f49302421897 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:09.090368 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-aa399942-97f5-4c43-b74c-f49302421897 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:09.100590 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-aa399942-97f5-4c43-b74c-f49302421897 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:09.106094 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-aa399942-97f5-4c43-b74c-f49302421897 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1413 microversion: 2.54 time: 0.283629 Oct 04 20:54:09.111445 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 947/1901] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:08 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1413 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:54:10.167982 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-afadca80-185a-4ae4-87e7-b9a2190b9572 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:10.169964 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-afadca80-185a-4ae4-87e7-b9a2190b9572 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:10.204491 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-afadca80-185a-4ae4-87e7-b9a2190b9572 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.205923 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-afadca80-185a-4ae4-87e7-b9a2190b9572 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.207484 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-afadca80-185a-4ae4-87e7-b9a2190b9572 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:10.209142 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-afadca80-185a-4ae4-87e7-b9a2190b9572 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.211803 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-afadca80-185a-4ae4-87e7-b9a2190b9572 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.216034 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-afadca80-185a-4ae4-87e7-b9a2190b9572 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:10.474722 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-afadca80-185a-4ae4-87e7-b9a2190b9572 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:10.503814 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-afadca80-185a-4ae4-87e7-b9a2190b9572 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:10.508142 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-afadca80-185a-4ae4-87e7-b9a2190b9572 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:10.510775 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-afadca80-185a-4ae4-87e7-b9a2190b9572 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1398 microversion: 2.54 time: 0.356493 Oct 04 20:54:10.530743 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 955/1902] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:10 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1398 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:10.566248 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f666323b-166f-40ad-9b2e-f8897fcd46cc tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '.version_select at 0x7f77eeb2aca0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:10.737248 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f666323b-166f-40ad-9b2e-f8897fcd46cc tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1386355331" status: 204 len: 0 microversion: 2.54 time: 0.179376 Oct 04 20:54:10.758740 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 948/1903] 10.222.0.78 () {60 vars in 1319 bytes} [Tue Oct 4 20:54:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1386355331 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 20:54:10.763815 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-39956f23-523f-41eb-84cf-24ce6547bd03 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:10.767372 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-39956f23-523f-41eb-84cf-24ce6547bd03 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:10.794015 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-39956f23-523f-41eb-84cf-24ce6547bd03 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.794015 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-39956f23-523f-41eb-84cf-24ce6547bd03 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.794512 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-39956f23-523f-41eb-84cf-24ce6547bd03 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:10.795506 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-39956f23-523f-41eb-84cf-24ce6547bd03 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.796719 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-39956f23-523f-41eb-84cf-24ce6547bd03 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.797436 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-39956f23-523f-41eb-84cf-24ce6547bd03 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:10.859990 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-39956f23-523f-41eb-84cf-24ce6547bd03 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:54:11.428506 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-39956f23-523f-41eb-84cf-24ce6547bd03 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 204 len: 0 microversion: 2.54 time: 0.674537 Oct 04 20:54:11.429473 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 956/1904] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:54:10 2022] DELETE /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 20:54:11.442576 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7f68cb4a-1958-4acc-aeef-75bc7d22863a tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:11.443992 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7f68cb4a-1958-4acc-aeef-75bc7d22863a tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:11.456929 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7f68cb4a-1958-4acc-aeef-75bc7d22863a tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:11.458296 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7f68cb4a-1958-4acc-aeef-75bc7d22863a tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:11.463026 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7f68cb4a-1958-4acc-aeef-75bc7d22863a tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:11.463026 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7f68cb4a-1958-4acc-aeef-75bc7d22863a tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:11.463026 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7f68cb4a-1958-4acc-aeef-75bc7d22863a tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:11.463026 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7f68cb4a-1958-4acc-aeef-75bc7d22863a tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:11.755975 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7f68cb4a-1958-4acc-aeef-75bc7d22863a tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:11.803104 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7f68cb4a-1958-4acc-aeef-75bc7d22863a tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:11.812528 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7f68cb4a-1958-4acc-aeef-75bc7d22863a tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:11.818809 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7f68cb4a-1958-4acc-aeef-75bc7d22863a tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1404 microversion: 2.54 time: 0.381142 Oct 04 20:54:11.821441 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 949/1905] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:11 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1404 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:54:12.877652 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e8487338-8eac-405a-b82f-17883f79edd2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:12.878447 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e8487338-8eac-405a-b82f-17883f79edd2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:12.899007 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8487338-8eac-405a-b82f-17883f79edd2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:12.900467 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8487338-8eac-405a-b82f-17883f79edd2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:12.901578 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8487338-8eac-405a-b82f-17883f79edd2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:12.903324 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8487338-8eac-405a-b82f-17883f79edd2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:12.904659 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8487338-8eac-405a-b82f-17883f79edd2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:12.905736 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e8487338-8eac-405a-b82f-17883f79edd2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:13.107903 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e8487338-8eac-405a-b82f-17883f79edd2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:13.127264 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e8487338-8eac-405a-b82f-17883f79edd2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:13.131501 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e8487338-8eac-405a-b82f-17883f79edd2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:13.134494 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e8487338-8eac-405a-b82f-17883f79edd2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1404 microversion: 2.54 time: 0.266817 Oct 04 20:54:13.147929 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 957/1906] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:12 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1404 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:14.186271 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a18b9d66-e3a4-4b81-91fa-51ad63596db2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:14.188555 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a18b9d66-e3a4-4b81-91fa-51ad63596db2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:14.201557 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a18b9d66-e3a4-4b81-91fa-51ad63596db2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:14.202723 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a18b9d66-e3a4-4b81-91fa-51ad63596db2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:14.203678 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a18b9d66-e3a4-4b81-91fa-51ad63596db2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:14.205202 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a18b9d66-e3a4-4b81-91fa-51ad63596db2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:14.206866 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a18b9d66-e3a4-4b81-91fa-51ad63596db2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:14.208202 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a18b9d66-e3a4-4b81-91fa-51ad63596db2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:14.533920 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a18b9d66-e3a4-4b81-91fa-51ad63596db2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:14.556608 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a18b9d66-e3a4-4b81-91fa-51ad63596db2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:14.562443 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a18b9d66-e3a4-4b81-91fa-51ad63596db2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:14.566788 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a18b9d66-e3a4-4b81-91fa-51ad63596db2 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1404 microversion: 2.54 time: 0.388089 Oct 04 20:54:14.568982 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 950/1907] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:14 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1404 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:15.633528 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:15.637290 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:15.660402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.662170 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.663187 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.666268 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.667653 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.669131 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.886508 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.889361 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.892629 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.894073 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lazy-loading 'fault' on Instance uuid f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:54:16.208926 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:16.293831 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:16.309920 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ca55756d08d40fb8464b859f5945e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d648bc85694df58d795f914acd4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:16.324361 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ed9a64ba-c204-42d1-a68f-25a2dba0f686 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 200 len: 1409 microversion: 2.54 time: 0.690554 Oct 04 20:54:16.325721 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 958/1908] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:15 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 1409 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:17.428673 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0458f082-9e18-4428-9a03-a01e1e868940 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:17.434179 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-0458f082-9e18-4428-9a03-a01e1e868940 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] [instance: f75a1e63-9eaf-45d4-8ba3-5650e5e325b8] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:17.504639 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0458f082-9e18-4428-9a03-a01e1e868940 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:17.505756 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0458f082-9e18-4428-9a03-a01e1e868940 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:17.506586 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0458f082-9e18-4428-9a03-a01e1e868940 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:17.508059 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0458f082-9e18-4428-9a03-a01e1e868940 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:17.509063 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0458f082-9e18-4428-9a03-a01e1e868940 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:17.509889 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-0458f082-9e18-4428-9a03-a01e1e868940 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:17.641207 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-0458f082-9e18-4428-9a03-a01e1e868940 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] HTTP exception thrown: Instance f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 could not be found. Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0458f082-9e18-4428-9a03-a01e1e868940 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Request method failure captured: Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 HTTP/1.1 Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJ1B-XpH9SfqiXT3VZDO5uLhByS_erdSHnzt6FCYkqVU49lG2ObhMDbC3ypHjR5yJCzzbv7RJ7vJEQdoC6qPBAAux_4xNJtyyVfis8rOvnAdFfmIKah8mJFtdUY2v-oOWJZ5JZZH8hdKgzcG2KDL6Dt77lZBBctAjxlZh-9O_1MhPHo Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.54 Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 28d648bc85694df58d795f914acd4843 Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerShowV254Test-2042905204 Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_28d648bc85694df58d795f914acd4843", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/28d648bc85694df58d795f914acd4843"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/28d648bc85694df58d795f914acd4843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/28d648bc85694df58d795f914acd4843"}]}] Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerShowV254Test-2042905204 Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 28d648bc85694df58d795f914acd4843 Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerShowV254Test-2042905204 Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerShowV254Test-2042905204-project Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 8ca55756d08d40fb8464b859f5945e64 Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerShowV254Test-2042905204-project Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 could not be found. Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': 'f75a1e63-9eaf-45d4-8ba3-5650e5e325b8'} Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 could not be found. Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 could not be found. Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:17.647833 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:54:17.664272 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:17.664272 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:17.664272 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:17.664272 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:17.664272 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:17.664272 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 could not be found. Oct 04 20:54:17.664272 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:54:17.664272 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0458f082-9e18-4428-9a03-a01e1e868940 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] Returning 404 to user: Instance f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:17.664272 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0458f082-9e18-4428-9a03-a01e1e868940 tempest-ServerShowV254Test-2042905204 tempest-ServerShowV254Test-2042905204-project] 10.222.0.78 "GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8" status: 404 len: 111 microversion: 2.54 time: 0.233121 Oct 04 20:54:17.664272 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 951/1909] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:17 2022] GET /compute/v2.1/servers/f75a1e63-9eaf-45d4-8ba3-5650e5e325b8 => generated 111 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:54:25.860489 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:26.229011 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:26.474379 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-11ec27a1-bdcc-4d0a-bbe6-3988a239bbdc tempest-ServersNegativeTestMultiTenantJSON-584093323 tempest-ServersNegativeTestMultiTenantJSON-584093323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1071485993", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0f02f09f-f74c-4c9e-b798-232ff1428103"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:26.704226 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-11ec27a1-bdcc-4d0a-bbe6-3988a239bbdc tempest-ServersNegativeTestMultiTenantJSON-584093323 tempest-ServersNegativeTestMultiTenantJSON-584093323-project] validate_networks() for [('0f02f09f-f74c-4c9e-b798-232ff1428103', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-11ec27a1-bdcc-4d0a-bbe6-3988a239bbdc tempest-ServersNegativeTestMultiTenantJSON-584093323 tempest-ServersNegativeTestMultiTenantJSON-584093323-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4ab83f16-d4aa-407e-a429-932637c484d4) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:54:27.852249 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4ab83f16-d4aa-407e-a429-932637c484d4) Oct 04 20:54:27.860264 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.866157 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-11ec27a1-bdcc-4d0a-bbe6-3988a239bbdc tempest-ServersNegativeTestMultiTenantJSON-584093323 tempest-ServersNegativeTestMultiTenantJSON-584093323-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:54:27.866157 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-11ec27a1-bdcc-4d0a-bbe6-3988a239bbdc tempest-ServersNegativeTestMultiTenantJSON-584093323 tempest-ServersNegativeTestMultiTenantJSON-584093323-project] Request method failure captured: Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 220 Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ1e2mwRg_nYVvMRMeaRv0nR5xklQ-zoaV3lcdjcdqj3V5LnZUdJ-s1sTwYy6wtIo01h9uE8b11w6VisCX-wzBuq1JJ-sST71lPzMslVm2t9kWutjJfmVz9PjoPw4YCWvjjUEeM6KLgiM9UBWjQFc9Yja4wyTrztHPoBGmIiAwS_O6M Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 46118121de724c439d844950f5542370 Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-584093323 Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_46118121de724c439d844950f5542370", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/46118121de724c439d844950f5542370"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/46118121de724c439d844950f5542370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/46118121de724c439d844950f5542370"}]}] Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-584093323 Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 46118121de724c439d844950f5542370 Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-584093323 Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersNegativeTestMultiTenantJSON-584093323-project Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: f2a38bfe37194b57aeca1a0e11becf17 Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-584093323-project Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1071485993", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0f02f09f-f74c-4c9e-b798-232ff1428103"}]}} Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestMultiTenantJSON-server-1071485993', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '0f02f09f-f74c-4c9e-b798-232ff1428103'}]}}} Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:54:27.870889 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4ab83f16-d4aa-407e-a429-932637c484d4) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:27.879561 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-11ec27a1-bdcc-4d0a-bbe6-3988a239bbdc tempest-ServersNegativeTestMultiTenantJSON-584093323 tempest-ServersNegativeTestMultiTenantJSON-584093323-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:54:27.894570 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:27.913235 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-11ec27a1-bdcc-4d0a-bbe6-3988a239bbdc tempest-ServersNegativeTestMultiTenantJSON-584093323 tempest-ServersNegativeTestMultiTenantJSON-584093323-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.932446 Oct 04 20:54:27.913235 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 959/1910] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:54:24 2022] POST /compute/v2.1/servers => generated 214 bytes in 2945 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:54:29.445111 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:29.448851 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=43 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:29.887477 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-319785930", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": "none"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:30.141814 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:54:30.143491 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:54:30.145001 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:54:30.146160 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:54:30.147295 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:54:30.199529 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:30.202155 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:30.207524 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:30.209340 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:30.210376 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:30.214539 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:30.283546 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Getting quotas for project 8600ebb44bd847e2b8114c3d8d2cbbf2. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:54:30.297058 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Getting quotas for user f06e5f7d140c4e689955b9856e651331 and project 8600ebb44bd847e2b8114c3d8d2cbbf2. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:54:30.344515 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Going to run 1 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:54:30.378096 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:54:30.884759 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2867e977-6f01-46c5-8f6a-8b8c8f7ea5b3 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.461670 Oct 04 20:54:30.911839 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 952/1911] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:54:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:54:30.932951 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-188f2412-39d6-4e4d-86a5-582ce6990ee2 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:30.936057 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-188f2412-39d6-4e4d-86a5-582ce6990ee2 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:31.317619 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-188f2412-39d6-4e4d-86a5-582ce6990ee2 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:31.346592 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-188f2412-39d6-4e4d-86a5-582ce6990ee2 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:31.380736 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-188f2412-39d6-4e4d-86a5-582ce6990ee2 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:31.416718 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-188f2412-39d6-4e4d-86a5-582ce6990ee2 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1277 microversion: 2.57 time: 0.474452 Oct 04 20:54:31.416718 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 960/1912] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:30 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1277 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:32.466716 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ffa82e22-f378-4923-a5e7-2104368f261d tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:32.469037 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ffa82e22-f378-4923-a5e7-2104368f261d tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:32.860831 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ffa82e22-f378-4923-a5e7-2104368f261d tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:32.929289 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ffa82e22-f378-4923-a5e7-2104368f261d tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:32.946633 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ffa82e22-f378-4923-a5e7-2104368f261d tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:32.949716 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ffa82e22-f378-4923-a5e7-2104368f261d tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1277 microversion: 2.57 time: 0.498637 Oct 04 20:54:32.951862 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 953/1913] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:32 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1277 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:34.020403 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5b326828-af66-427f-b367-53189bab411f tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:34.025400 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-5b326828-af66-427f-b367-53189bab411f tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:34.063037 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5b326828-af66-427f-b367-53189bab411f tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:34.063788 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5b326828-af66-427f-b367-53189bab411f tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:34.065475 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5b326828-af66-427f-b367-53189bab411f tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:34.066540 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5b326828-af66-427f-b367-53189bab411f tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:34.067004 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5b326828-af66-427f-b367-53189bab411f tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:34.067473 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5b326828-af66-427f-b367-53189bab411f tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:34.574135 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5b326828-af66-427f-b367-53189bab411f tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:34.611402 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5b326828-af66-427f-b367-53189bab411f tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:34.634827 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5b326828-af66-427f-b367-53189bab411f tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:34.639205 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5b326828-af66-427f-b367-53189bab411f tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1281 microversion: 2.57 time: 0.638013 Oct 04 20:54:34.657113 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 961/1914] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:33 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1281 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:54:35.696861 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bd76c64d-8705-4765-aa10-05b2eb0897f0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:35.699162 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-bd76c64d-8705-4765-aa10-05b2eb0897f0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:35.714616 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bd76c64d-8705-4765-aa10-05b2eb0897f0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:35.717944 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bd76c64d-8705-4765-aa10-05b2eb0897f0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:35.719434 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bd76c64d-8705-4765-aa10-05b2eb0897f0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:35.721065 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bd76c64d-8705-4765-aa10-05b2eb0897f0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:35.722197 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bd76c64d-8705-4765-aa10-05b2eb0897f0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:35.725543 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bd76c64d-8705-4765-aa10-05b2eb0897f0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:36.101320 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-bd76c64d-8705-4765-aa10-05b2eb0897f0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:36.168544 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-bd76c64d-8705-4765-aa10-05b2eb0897f0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:36.176006 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-bd76c64d-8705-4765-aa10-05b2eb0897f0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:36.180860 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bd76c64d-8705-4765-aa10-05b2eb0897f0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1329 microversion: 2.57 time: 0.492234 Oct 04 20:54:36.186913 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 954/1915] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:35 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1329 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:37.245198 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2b1f4521-eab3-4684-9aab-487771484edf tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:37.246403 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2b1f4521-eab3-4684-9aab-487771484edf tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.287303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b1f4521-eab3-4684-9aab-487771484edf tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.288161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b1f4521-eab3-4684-9aab-487771484edf tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.305275 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b1f4521-eab3-4684-9aab-487771484edf tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.306666 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b1f4521-eab3-4684-9aab-487771484edf tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.307913 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b1f4521-eab3-4684-9aab-487771484edf tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.308978 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2b1f4521-eab3-4684-9aab-487771484edf tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.543880 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2b1f4521-eab3-4684-9aab-487771484edf tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:37.576823 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2b1f4521-eab3-4684-9aab-487771484edf tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:37.582844 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2b1f4521-eab3-4684-9aab-487771484edf tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:37.586306 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2b1f4521-eab3-4684-9aab-487771484edf tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1337 microversion: 2.57 time: 0.355461 Oct 04 20:54:37.588656 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 962/1916] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:37 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1337 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:38.644480 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1e6253b8-d93d-44eb-bc71-95cdafc29eb5 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:38.645719 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1e6253b8-d93d-44eb-bc71-95cdafc29eb5 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:38.683199 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e6253b8-d93d-44eb-bc71-95cdafc29eb5 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:38.687787 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e6253b8-d93d-44eb-bc71-95cdafc29eb5 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:38.688749 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e6253b8-d93d-44eb-bc71-95cdafc29eb5 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:38.690301 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e6253b8-d93d-44eb-bc71-95cdafc29eb5 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:38.690943 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e6253b8-d93d-44eb-bc71-95cdafc29eb5 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:38.699354 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1e6253b8-d93d-44eb-bc71-95cdafc29eb5 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:38.904577 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1e6253b8-d93d-44eb-bc71-95cdafc29eb5 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:38.929727 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1e6253b8-d93d-44eb-bc71-95cdafc29eb5 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:38.934742 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1e6253b8-d93d-44eb-bc71-95cdafc29eb5 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:38.937511 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1e6253b8-d93d-44eb-bc71-95cdafc29eb5 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1335 microversion: 2.57 time: 0.302931 Oct 04 20:54:38.939449 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 955/1917] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:38 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1335 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:54:39.998294 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-320ab421-a8bf-4f14-aadc-1317606f6dbe tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:40.000790 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-320ab421-a8bf-4f14-aadc-1317606f6dbe tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:40.049403 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-320ab421-a8bf-4f14-aadc-1317606f6dbe tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:40.055978 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-320ab421-a8bf-4f14-aadc-1317606f6dbe tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:40.056889 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-320ab421-a8bf-4f14-aadc-1317606f6dbe tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:40.058193 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-320ab421-a8bf-4f14-aadc-1317606f6dbe tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:40.066567 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-320ab421-a8bf-4f14-aadc-1317606f6dbe tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:40.068450 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-320ab421-a8bf-4f14-aadc-1317606f6dbe tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:40.410355 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-320ab421-a8bf-4f14-aadc-1317606f6dbe tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:40.458701 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-320ab421-a8bf-4f14-aadc-1317606f6dbe tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:40.493038 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-320ab421-a8bf-4f14-aadc-1317606f6dbe tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:40.517573 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-320ab421-a8bf-4f14-aadc-1317606f6dbe tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1335 microversion: 2.57 time: 0.524699 Oct 04 20:54:40.526394 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 963/1918] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:39 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1335 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:41.585623 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:41.633023 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-169e5a34-30bf-451c-8476-39ffe2b1d901 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:41.638294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-169e5a34-30bf-451c-8476-39ffe2b1d901 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:41.663411 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-169e5a34-30bf-451c-8476-39ffe2b1d901 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:41.665534 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-169e5a34-30bf-451c-8476-39ffe2b1d901 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:41.666817 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-169e5a34-30bf-451c-8476-39ffe2b1d901 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:41.668765 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-169e5a34-30bf-451c-8476-39ffe2b1d901 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:41.670002 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-169e5a34-30bf-451c-8476-39ffe2b1d901 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:41.670744 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-169e5a34-30bf-451c-8476-39ffe2b1d901 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:41.846457 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-169e5a34-30bf-451c-8476-39ffe2b1d901 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:41.873596 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-169e5a34-30bf-451c-8476-39ffe2b1d901 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:41.878075 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-169e5a34-30bf-451c-8476-39ffe2b1d901 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:41.882288 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-169e5a34-30bf-451c-8476-39ffe2b1d901 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1335 microversion: 2.57 time: 0.297844 Oct 04 20:54:41.884526 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 956/1919] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:41 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1335 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:42.951840 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-af857fcf-5883-4ec5-92d0-13ac48bdc511 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:42.963677 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-af857fcf-5883-4ec5-92d0-13ac48bdc511 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:42.986573 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:42.989795 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af857fcf-5883-4ec5-92d0-13ac48bdc511 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.990734 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af857fcf-5883-4ec5-92d0-13ac48bdc511 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.998340 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af857fcf-5883-4ec5-92d0-13ac48bdc511 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:43.003123 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af857fcf-5883-4ec5-92d0-13ac48bdc511 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:43.005865 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af857fcf-5883-4ec5-92d0-13ac48bdc511 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:43.013458 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-af857fcf-5883-4ec5-92d0-13ac48bdc511 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:43.370654 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-af857fcf-5883-4ec5-92d0-13ac48bdc511 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:43.448993 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-af857fcf-5883-4ec5-92d0-13ac48bdc511 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:43.459386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-af857fcf-5883-4ec5-92d0-13ac48bdc511 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:43.475719 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-af857fcf-5883-4ec5-92d0-13ac48bdc511 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1356 microversion: 2.57 time: 0.521197 Oct 04 20:54:43.475719 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 964/1920] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:42 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1356 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:43.528907 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:43.534406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:43.560768 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=8 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:43.567344 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:43.568933 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:43.570612 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:43.572909 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:43.574610 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:43.576246 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:43.917774 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:54:43.918984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:54:43.925398 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:54:43.926363 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:54:43.927281 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:54:44.390628 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:44.423702 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.430426 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.433242 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.438767 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.459785 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.461701 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.697316 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8149bcae-9abc-4387-961f-edf61983dd14 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "POST /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c/action" status: 202 len: 1137 microversion: 2.57 time: 1.173397 Oct 04 20:54:44.705922 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 957/1921] 10.222.0.78 () {62 vars in 1320 bytes} [Tue Oct 4 20:54:43 2022] POST /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c/action => generated 1137 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 20:54:44.770137 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7333df82-adc8-41d4-a4be-a94199ca9f61 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:44.782684 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7333df82-adc8-41d4-a4be-a94199ca9f61 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:44.829775 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7333df82-adc8-41d4-a4be-a94199ca9f61 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.853191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7333df82-adc8-41d4-a4be-a94199ca9f61 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.853191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7333df82-adc8-41d4-a4be-a94199ca9f61 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.853191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7333df82-adc8-41d4-a4be-a94199ca9f61 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.853191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7333df82-adc8-41d4-a4be-a94199ca9f61 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.853191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7333df82-adc8-41d4-a4be-a94199ca9f61 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:45.277797 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7333df82-adc8-41d4-a4be-a94199ca9f61 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:45.343225 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7333df82-adc8-41d4-a4be-a94199ca9f61 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:45.375287 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7333df82-adc8-41d4-a4be-a94199ca9f61 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:45.388258 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7333df82-adc8-41d4-a4be-a94199ca9f61 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.630873 Oct 04 20:54:45.426320 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 965/1922] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:44 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:46.461490 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-78780d89-04ed-4637-85d6-3e75a3406e32 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:46.463252 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-78780d89-04ed-4637-85d6-3e75a3406e32 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:46.487287 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78780d89-04ed-4637-85d6-3e75a3406e32 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:46.488503 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78780d89-04ed-4637-85d6-3e75a3406e32 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:46.489283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78780d89-04ed-4637-85d6-3e75a3406e32 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:46.497775 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78780d89-04ed-4637-85d6-3e75a3406e32 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:46.499587 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78780d89-04ed-4637-85d6-3e75a3406e32 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:46.500569 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-78780d89-04ed-4637-85d6-3e75a3406e32 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:46.758403 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-78780d89-04ed-4637-85d6-3e75a3406e32 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:46.784432 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-78780d89-04ed-4637-85d6-3e75a3406e32 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:46.787321 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-78780d89-04ed-4637-85d6-3e75a3406e32 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:46.789496 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-78780d89-04ed-4637-85d6-3e75a3406e32 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.340849 Oct 04 20:54:46.793528 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 958/1923] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:46 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:47.844576 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f3b2806b-76d2-4ebc-a074-4b7db925d7a4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:47.847647 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f3b2806b-76d2-4ebc-a074-4b7db925d7a4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:47.862354 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3b2806b-76d2-4ebc-a074-4b7db925d7a4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:47.864097 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3b2806b-76d2-4ebc-a074-4b7db925d7a4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:47.867384 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3b2806b-76d2-4ebc-a074-4b7db925d7a4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:47.869781 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3b2806b-76d2-4ebc-a074-4b7db925d7a4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:47.871054 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3b2806b-76d2-4ebc-a074-4b7db925d7a4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:47.872185 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f3b2806b-76d2-4ebc-a074-4b7db925d7a4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.145329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f3b2806b-76d2-4ebc-a074-4b7db925d7a4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:48.172641 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f3b2806b-76d2-4ebc-a074-4b7db925d7a4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:48.174640 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f3b2806b-76d2-4ebc-a074-4b7db925d7a4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:48.177959 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f3b2806b-76d2-4ebc-a074-4b7db925d7a4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.343800 Oct 04 20:54:48.192324 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 966/1924] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:47 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:49.233523 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dfce2240-4cc7-4531-b66d-42c3a43cb0d1 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:49.249206 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-dfce2240-4cc7-4531-b66d-42c3a43cb0d1 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:49.271497 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dfce2240-4cc7-4531-b66d-42c3a43cb0d1 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:49.272411 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dfce2240-4cc7-4531-b66d-42c3a43cb0d1 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:49.273244 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dfce2240-4cc7-4531-b66d-42c3a43cb0d1 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:49.274608 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dfce2240-4cc7-4531-b66d-42c3a43cb0d1 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:49.276053 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dfce2240-4cc7-4531-b66d-42c3a43cb0d1 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:49.276841 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dfce2240-4cc7-4531-b66d-42c3a43cb0d1 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:49.555720 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-dfce2240-4cc7-4531-b66d-42c3a43cb0d1 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:49.586332 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-dfce2240-4cc7-4531-b66d-42c3a43cb0d1 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:49.592177 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-dfce2240-4cc7-4531-b66d-42c3a43cb0d1 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:49.607051 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-dfce2240-4cc7-4531-b66d-42c3a43cb0d1 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.381243 Oct 04 20:54:49.609280 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 959/1925] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:49 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:50.658504 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e3e2676a-7fc0-4922-9f78-dd0791815f90 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:50.659691 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-e3e2676a-7fc0-4922-9f78-dd0791815f90 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:50.692357 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3e2676a-7fc0-4922-9f78-dd0791815f90 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:50.693177 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3e2676a-7fc0-4922-9f78-dd0791815f90 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:50.693893 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3e2676a-7fc0-4922-9f78-dd0791815f90 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:50.695479 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3e2676a-7fc0-4922-9f78-dd0791815f90 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:50.696637 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3e2676a-7fc0-4922-9f78-dd0791815f90 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:50.697421 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-e3e2676a-7fc0-4922-9f78-dd0791815f90 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:51.087386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e3e2676a-7fc0-4922-9f78-dd0791815f90 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:51.117695 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e3e2676a-7fc0-4922-9f78-dd0791815f90 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:51.123167 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-e3e2676a-7fc0-4922-9f78-dd0791815f90 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:51.129304 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e3e2676a-7fc0-4922-9f78-dd0791815f90 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.477231 Oct 04 20:54:51.135401 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 967/1926] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:50 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:52.208290 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-34699a9f-e9e3-460c-8df8-fd94eb8eb5ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:52.212680 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-34699a9f-e9e3-460c-8df8-fd94eb8eb5ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:52.241886 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-34699a9f-e9e3-460c-8df8-fd94eb8eb5ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:52.242821 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-34699a9f-e9e3-460c-8df8-fd94eb8eb5ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:52.244231 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-34699a9f-e9e3-460c-8df8-fd94eb8eb5ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:52.248490 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-34699a9f-e9e3-460c-8df8-fd94eb8eb5ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:52.249414 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-34699a9f-e9e3-460c-8df8-fd94eb8eb5ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:52.252444 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-34699a9f-e9e3-460c-8df8-fd94eb8eb5ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:52.518931 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-34699a9f-e9e3-460c-8df8-fd94eb8eb5ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:52.537029 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-34699a9f-e9e3-460c-8df8-fd94eb8eb5ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:52.541570 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-34699a9f-e9e3-460c-8df8-fd94eb8eb5ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:52.547427 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-34699a9f-e9e3-460c-8df8-fd94eb8eb5ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.354344 Oct 04 20:54:52.549318 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 960/1927] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:52 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:53.608886 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-286da733-d7d8-4563-8e6a-5354073fceb4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:53.609696 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-286da733-d7d8-4563-8e6a-5354073fceb4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:53.652079 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-286da733-d7d8-4563-8e6a-5354073fceb4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:53.656736 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-286da733-d7d8-4563-8e6a-5354073fceb4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:53.656736 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-286da733-d7d8-4563-8e6a-5354073fceb4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:53.656736 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-286da733-d7d8-4563-8e6a-5354073fceb4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:53.656736 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-286da733-d7d8-4563-8e6a-5354073fceb4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:53.657213 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-286da733-d7d8-4563-8e6a-5354073fceb4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:54.152962 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-286da733-d7d8-4563-8e6a-5354073fceb4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:54.187205 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-286da733-d7d8-4563-8e6a-5354073fceb4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:54.199761 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-286da733-d7d8-4563-8e6a-5354073fceb4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:54.208613 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-286da733-d7d8-4563-8e6a-5354073fceb4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.609047 Oct 04 20:54:54.210325 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 968/1928] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:53 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:54:55.272755 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8c429d35-c1f0-486a-b701-d50e009e9bbd tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:55.273837 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-8c429d35-c1f0-486a-b701-d50e009e9bbd tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:55.299414 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c429d35-c1f0-486a-b701-d50e009e9bbd tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:55.301895 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c429d35-c1f0-486a-b701-d50e009e9bbd tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:55.302808 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c429d35-c1f0-486a-b701-d50e009e9bbd tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:55.304170 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c429d35-c1f0-486a-b701-d50e009e9bbd tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:55.309706 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c429d35-c1f0-486a-b701-d50e009e9bbd tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:55.312975 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-8c429d35-c1f0-486a-b701-d50e009e9bbd tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:55.642244 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8c429d35-c1f0-486a-b701-d50e009e9bbd tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:55.691286 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8c429d35-c1f0-486a-b701-d50e009e9bbd tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:55.725238 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-8c429d35-c1f0-486a-b701-d50e009e9bbd tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:55.748932 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8c429d35-c1f0-486a-b701-d50e009e9bbd tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.480925 Oct 04 20:54:55.771659 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 961/1929] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:55 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:56.810531 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ebcbecf6-b9da-491c-88a3-ed3f6dc98d50 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:56.820310 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ebcbecf6-b9da-491c-88a3-ed3f6dc98d50 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:56.839725 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ebcbecf6-b9da-491c-88a3-ed3f6dc98d50 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:56.840654 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ebcbecf6-b9da-491c-88a3-ed3f6dc98d50 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:56.841545 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ebcbecf6-b9da-491c-88a3-ed3f6dc98d50 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:56.842869 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ebcbecf6-b9da-491c-88a3-ed3f6dc98d50 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:56.843838 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ebcbecf6-b9da-491c-88a3-ed3f6dc98d50 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:56.844621 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ebcbecf6-b9da-491c-88a3-ed3f6dc98d50 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.265448 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ebcbecf6-b9da-491c-88a3-ed3f6dc98d50 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:57.291432 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ebcbecf6-b9da-491c-88a3-ed3f6dc98d50 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:57.305645 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ebcbecf6-b9da-491c-88a3-ed3f6dc98d50 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:57.325183 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ebcbecf6-b9da-491c-88a3-ed3f6dc98d50 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.518311 Oct 04 20:54:57.326375 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 969/1930] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:56 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:58.385512 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-763f9217-dc55-4ace-87f3-0da7e8115510 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:58.385512 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-763f9217-dc55-4ace-87f3-0da7e8115510 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:58.440505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-763f9217-dc55-4ace-87f3-0da7e8115510 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.441703 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-763f9217-dc55-4ace-87f3-0da7e8115510 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.448850 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-763f9217-dc55-4ace-87f3-0da7e8115510 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.452037 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-763f9217-dc55-4ace-87f3-0da7e8115510 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.455492 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-763f9217-dc55-4ace-87f3-0da7e8115510 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.459014 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-763f9217-dc55-4ace-87f3-0da7e8115510 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.785825 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-763f9217-dc55-4ace-87f3-0da7e8115510 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:58.805109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-763f9217-dc55-4ace-87f3-0da7e8115510 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:58.813342 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-763f9217-dc55-4ace-87f3-0da7e8115510 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:58.815206 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-763f9217-dc55-4ace-87f3-0da7e8115510 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.440625 Oct 04 20:54:58.832521 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 962/1931] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:58 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:59.886618 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5a1f72a5-e1f2-41f1-a793-cce1c3da430e tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:59.888023 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-5a1f72a5-e1f2-41f1-a793-cce1c3da430e tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:59.901148 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5a1f72a5-e1f2-41f1-a793-cce1c3da430e tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:59.902683 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5a1f72a5-e1f2-41f1-a793-cce1c3da430e tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:59.908709 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5a1f72a5-e1f2-41f1-a793-cce1c3da430e tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:59.908709 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5a1f72a5-e1f2-41f1-a793-cce1c3da430e tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:59.908709 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5a1f72a5-e1f2-41f1-a793-cce1c3da430e tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:59.908709 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5a1f72a5-e1f2-41f1-a793-cce1c3da430e tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:00.209974 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5a1f72a5-e1f2-41f1-a793-cce1c3da430e tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:00.242629 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5a1f72a5-e1f2-41f1-a793-cce1c3da430e tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:00.249556 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5a1f72a5-e1f2-41f1-a793-cce1c3da430e tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:00.259525 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5a1f72a5-e1f2-41f1-a793-cce1c3da430e tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.381679 Oct 04 20:55:00.261553 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 970/1932] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:59 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:01.320477 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ab24b6f9-90f3-4c8b-8f04-09dcef1ac546 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:01.325945 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ab24b6f9-90f3-4c8b-8f04-09dcef1ac546 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:01.362651 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ab24b6f9-90f3-4c8b-8f04-09dcef1ac546 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:01.369074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ab24b6f9-90f3-4c8b-8f04-09dcef1ac546 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:01.370061 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ab24b6f9-90f3-4c8b-8f04-09dcef1ac546 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:01.374243 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ab24b6f9-90f3-4c8b-8f04-09dcef1ac546 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:01.376711 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ab24b6f9-90f3-4c8b-8f04-09dcef1ac546 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:01.378107 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ab24b6f9-90f3-4c8b-8f04-09dcef1ac546 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:01.390051 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:01.699011 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ab24b6f9-90f3-4c8b-8f04-09dcef1ac546 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:01.727307 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ab24b6f9-90f3-4c8b-8f04-09dcef1ac546 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:01.732341 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ab24b6f9-90f3-4c8b-8f04-09dcef1ac546 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:01.736948 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ab24b6f9-90f3-4c8b-8f04-09dcef1ac546 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.426629 Oct 04 20:55:01.739580 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 963/1933] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:01 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:02.801652 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-33b39d4d-104f-4e1b-9170-ddc86a34ab45 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:02.802800 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-33b39d4d-104f-4e1b-9170-ddc86a34ab45 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:02.815642 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=27 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:02.827001 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-33b39d4d-104f-4e1b-9170-ddc86a34ab45 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:02.828238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-33b39d4d-104f-4e1b-9170-ddc86a34ab45 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:02.829220 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-33b39d4d-104f-4e1b-9170-ddc86a34ab45 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:02.830916 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-33b39d4d-104f-4e1b-9170-ddc86a34ab45 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:02.832167 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-33b39d4d-104f-4e1b-9170-ddc86a34ab45 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:02.833148 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-33b39d4d-104f-4e1b-9170-ddc86a34ab45 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:03.594398 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-33b39d4d-104f-4e1b-9170-ddc86a34ab45 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:03.637455 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-33b39d4d-104f-4e1b-9170-ddc86a34ab45 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:03.641978 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-33b39d4d-104f-4e1b-9170-ddc86a34ab45 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:03.646193 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-33b39d4d-104f-4e1b-9170-ddc86a34ab45 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.853056 Oct 04 20:55:03.649100 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 971/1934] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:02 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:04.716693 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e191eb10-f495-4beb-8f46-0bb740968814 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:04.718189 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e191eb10-f495-4beb-8f46-0bb740968814 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:04.737811 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:04.762853 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e191eb10-f495-4beb-8f46-0bb740968814 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:04.765459 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e191eb10-f495-4beb-8f46-0bb740968814 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:04.767093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e191eb10-f495-4beb-8f46-0bb740968814 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:04.768980 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e191eb10-f495-4beb-8f46-0bb740968814 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:04.770482 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e191eb10-f495-4beb-8f46-0bb740968814 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:04.771967 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e191eb10-f495-4beb-8f46-0bb740968814 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:06.187379 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e191eb10-f495-4beb-8f46-0bb740968814 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:06.220655 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e191eb10-f495-4beb-8f46-0bb740968814 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:06.231505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e191eb10-f495-4beb-8f46-0bb740968814 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:06.244918 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e191eb10-f495-4beb-8f46-0bb740968814 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 1.552591 Oct 04 20:55:06.250751 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 964/1935] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:04 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:55:07.316441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d87e3b3c-dfe3-4eae-acb8-fbae4c7894b0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:07.316441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d87e3b3c-dfe3-4eae-acb8-fbae4c7894b0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:07.340586 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d87e3b3c-dfe3-4eae-acb8-fbae4c7894b0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:07.341643 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d87e3b3c-dfe3-4eae-acb8-fbae4c7894b0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:07.342452 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d87e3b3c-dfe3-4eae-acb8-fbae4c7894b0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:07.343870 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d87e3b3c-dfe3-4eae-acb8-fbae4c7894b0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:07.344768 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d87e3b3c-dfe3-4eae-acb8-fbae4c7894b0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:07.350334 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d87e3b3c-dfe3-4eae-acb8-fbae4c7894b0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:07.372956 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=67 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:07.732647 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d87e3b3c-dfe3-4eae-acb8-fbae4c7894b0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:07.765414 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d87e3b3c-dfe3-4eae-acb8-fbae4c7894b0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:07.773098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d87e3b3c-dfe3-4eae-acb8-fbae4c7894b0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:07.776479 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d87e3b3c-dfe3-4eae-acb8-fbae4c7894b0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.478724 Oct 04 20:55:07.777630 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 972/1936] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:07 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:08.842323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-219c8bd0-482f-40ec-ae83-9f56e2afd3cc tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:08.848372 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-219c8bd0-482f-40ec-ae83-9f56e2afd3cc tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:08.922693 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-219c8bd0-482f-40ec-ae83-9f56e2afd3cc tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:08.923870 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-219c8bd0-482f-40ec-ae83-9f56e2afd3cc tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:08.924998 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-219c8bd0-482f-40ec-ae83-9f56e2afd3cc tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:08.932853 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-219c8bd0-482f-40ec-ae83-9f56e2afd3cc tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:08.954370 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-219c8bd0-482f-40ec-ae83-9f56e2afd3cc tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:08.957007 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-219c8bd0-482f-40ec-ae83-9f56e2afd3cc tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:10.703377 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-219c8bd0-482f-40ec-ae83-9f56e2afd3cc tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:10.725536 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-219c8bd0-482f-40ec-ae83-9f56e2afd3cc tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:10.751607 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-219c8bd0-482f-40ec-ae83-9f56e2afd3cc tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:10.751607 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-219c8bd0-482f-40ec-ae83-9f56e2afd3cc tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 1.913006 Oct 04 20:55:10.753355 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 965/1937] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:08 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:11.791000 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-43831448-9a48-4743-988f-9d0832725c81 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:11.796637 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-43831448-9a48-4743-988f-9d0832725c81 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:11.854898 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-43831448-9a48-4743-988f-9d0832725c81 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:11.874009 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-43831448-9a48-4743-988f-9d0832725c81 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:11.874550 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-43831448-9a48-4743-988f-9d0832725c81 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:11.885121 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-43831448-9a48-4743-988f-9d0832725c81 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:11.886095 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-43831448-9a48-4743-988f-9d0832725c81 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:11.886975 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-43831448-9a48-4743-988f-9d0832725c81 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:12.376098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-43831448-9a48-4743-988f-9d0832725c81 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:12.427443 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-43831448-9a48-4743-988f-9d0832725c81 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:12.430969 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-43831448-9a48-4743-988f-9d0832725c81 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:12.436328 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-43831448-9a48-4743-988f-9d0832725c81 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1365 microversion: 2.57 time: 0.653526 Oct 04 20:55:12.438775 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 973/1938] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:11 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1365 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:13.500191 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c5c15e83-b412-4299-821f-4201750563c4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:13.510240 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c5c15e83-b412-4299-821f-4201750563c4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:13.559500 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5c15e83-b412-4299-821f-4201750563c4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:13.560923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5c15e83-b412-4299-821f-4201750563c4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:13.565924 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5c15e83-b412-4299-821f-4201750563c4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:13.568118 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5c15e83-b412-4299-821f-4201750563c4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:13.571913 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5c15e83-b412-4299-821f-4201750563c4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:13.573136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-c5c15e83-b412-4299-821f-4201750563c4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:14.139280 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c5c15e83-b412-4299-821f-4201750563c4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:14.190425 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c5c15e83-b412-4299-821f-4201750563c4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:14.209032 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c5c15e83-b412-4299-821f-4201750563c4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:14.232182 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c5c15e83-b412-4299-821f-4201750563c4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1371 microversion: 2.57 time: 0.739361 Oct 04 20:55:14.234134 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 966/1939] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:13 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1371 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:15.292919 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a5d7bbd1-1c14-43ce-8a30-550f715a80d4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:15.297710 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a5d7bbd1-1c14-43ce-8a30-550f715a80d4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:15.322795 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5d7bbd1-1c14-43ce-8a30-550f715a80d4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:15.324522 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5d7bbd1-1c14-43ce-8a30-550f715a80d4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:15.325715 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5d7bbd1-1c14-43ce-8a30-550f715a80d4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:15.332350 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5d7bbd1-1c14-43ce-8a30-550f715a80d4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:15.335056 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5d7bbd1-1c14-43ce-8a30-550f715a80d4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:15.336616 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a5d7bbd1-1c14-43ce-8a30-550f715a80d4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:16.369861 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a5d7bbd1-1c14-43ce-8a30-550f715a80d4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:16.396622 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a5d7bbd1-1c14-43ce-8a30-550f715a80d4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:16.402277 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a5d7bbd1-1c14-43ce-8a30-550f715a80d4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:16.405701 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a5d7bbd1-1c14-43ce-8a30-550f715a80d4 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1371 microversion: 2.57 time: 1.122566 Oct 04 20:55:16.412227 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 974/1940] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:15 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1371 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:17.460593 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9e316f5f-5bbc-42eb-8a85-0ee0269d7569 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:17.464920 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-9e316f5f-5bbc-42eb-8a85-0ee0269d7569 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:17.497222 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9e316f5f-5bbc-42eb-8a85-0ee0269d7569 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.499237 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9e316f5f-5bbc-42eb-8a85-0ee0269d7569 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.505825 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9e316f5f-5bbc-42eb-8a85-0ee0269d7569 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:17.508137 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9e316f5f-5bbc-42eb-8a85-0ee0269d7569 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.518185 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9e316f5f-5bbc-42eb-8a85-0ee0269d7569 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.521463 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9e316f5f-5bbc-42eb-8a85-0ee0269d7569 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:17.849283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9e316f5f-5bbc-42eb-8a85-0ee0269d7569 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:17.886224 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9e316f5f-5bbc-42eb-8a85-0ee0269d7569 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:17.890324 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-9e316f5f-5bbc-42eb-8a85-0ee0269d7569 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:17.900582 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9e316f5f-5bbc-42eb-8a85-0ee0269d7569 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1371 microversion: 2.57 time: 0.448634 Oct 04 20:55:17.901591 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 967/1941] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:17 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1371 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:18.956399 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7c4be4b4-b57a-422a-9720-b7e682183608 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:18.960287 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7c4be4b4-b57a-422a-9720-b7e682183608 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:18.990808 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7c4be4b4-b57a-422a-9720-b7e682183608 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:18.995326 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7c4be4b4-b57a-422a-9720-b7e682183608 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:19.000155 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7c4be4b4-b57a-422a-9720-b7e682183608 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:19.000155 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7c4be4b4-b57a-422a-9720-b7e682183608 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:19.000155 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7c4be4b4-b57a-422a-9720-b7e682183608 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:19.000155 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7c4be4b4-b57a-422a-9720-b7e682183608 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:19.017347 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ed7b2e27-6418-4f01-b5ea-5de5ead81ae4 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] Calling method '.version_select at 0x7f77eeeba940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:19.158873 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7c4be4b4-b57a-422a-9720-b7e682183608 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:19.193313 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7c4be4b4-b57a-422a-9720-b7e682183608 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:19.198953 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7c4be4b4-b57a-422a-9720-b7e682183608 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:19.203894 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7c4be4b4-b57a-422a-9720-b7e682183608 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1356 microversion: 2.57 time: 0.255933 Oct 04 20:55:19.206211 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 968/1942] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:18 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1356 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:55:19.285032 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-21555873-c616-4a16-a3b5-41b06bfddd25 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:19.292954 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-21555873-c616-4a16-a3b5-41b06bfddd25 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:19.332001 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-21555873-c616-4a16-a3b5-41b06bfddd25 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:19.340314 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-21555873-c616-4a16-a3b5-41b06bfddd25 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:19.344070 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-21555873-c616-4a16-a3b5-41b06bfddd25 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:19.377136 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-21555873-c616-4a16-a3b5-41b06bfddd25 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:19.378456 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-21555873-c616-4a16-a3b5-41b06bfddd25 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:19.379590 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-21555873-c616-4a16-a3b5-41b06bfddd25 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:19.467431 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-21555873-c616-4a16-a3b5-41b06bfddd25 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:55:19.556199 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ed7b2e27-6418-4f01-b5ea-5de5ead81ae4 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/9b54dbb6a0bc4d3aa3aa943d646aed67/defaults" status: 200 len: 371 microversion: 2.1 time: 1.009322 Oct 04 20:55:19.563036 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 975/1943] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:55:18 2022] GET /compute/v2.1/os-quota-sets/9b54dbb6a0bc4d3aa3aa943d646aed67/defaults => generated 371 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:19.586575 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-248f7c2b-cba6-4d8c-8abb-995aa5742630 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] Calling method '.version_select at 0x7f77eee33670>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:20.185443 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-21555873-c616-4a16-a3b5-41b06bfddd25 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 204 len: 0 microversion: 2.57 time: 0.912221 Oct 04 20:55:20.188274 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 969/1944] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Oct 4 20:55:19 2022] DELETE /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 0 bytes in 916 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 20:55:20.259938 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5a0e4257-34ad-470b-b245-179fe17705e0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:20.269299 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-5a0e4257-34ad-470b-b245-179fe17705e0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:20.304876 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-248f7c2b-cba6-4d8c-8abb-995aa5742630 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/9b54dbb6a0bc4d3aa3aa943d646aed67" status: 200 len: 371 microversion: 2.1 time: 0.726492 Oct 04 20:55:20.305733 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5a0e4257-34ad-470b-b245-179fe17705e0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:20.306138 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5a0e4257-34ad-470b-b245-179fe17705e0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:20.311307 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5a0e4257-34ad-470b-b245-179fe17705e0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:20.312964 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5a0e4257-34ad-470b-b245-179fe17705e0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:20.314049 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 976/1945] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:55:19 2022] GET /compute/v2.1/os-quota-sets/9b54dbb6a0bc4d3aa3aa943d646aed67 => generated 371 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:20.334262 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5a0e4257-34ad-470b-b245-179fe17705e0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:20.339893 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-5a0e4257-34ad-470b-b245-179fe17705e0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:20.359682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c51807f9-7516-420e-b9de-5f19b4d93955 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] Calling method '.version_select at 0x7f77eed03040>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:20.583731 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c51807f9-7516-420e-b9de-5f19b4d93955 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/9b54dbb6a0bc4d3aa3aa943d646aed67/defaults" status: 200 len: 371 microversion: 2.1 time: 0.238553 Oct 04 20:55:20.585735 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 977/1946] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:55:20 2022] GET /compute/v2.1/os-quota-sets/9b54dbb6a0bc4d3aa3aa943d646aed67/defaults => generated 371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:20.627244 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bab25fb6-4144-4758-bf25-d13df89378f2 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] Calling method '.version_select at 0x7f77eee33430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:20.761335 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-5a0e4257-34ad-470b-b245-179fe17705e0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:20.773360 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-5a0e4257-34ad-470b-b245-179fe17705e0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:20.774999 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-5a0e4257-34ad-470b-b245-179fe17705e0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:20.792870 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5a0e4257-34ad-470b-b245-179fe17705e0 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1362 microversion: 2.57 time: 0.585915 Oct 04 20:55:20.793588 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 970/1947] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:20 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1362 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:20.867770 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bab25fb6-4144-4758-bf25-d13df89378f2 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/9b54dbb6a0bc4d3aa3aa943d646aed67" status: 200 len: 371 microversion: 2.1 time: 0.258136 Oct 04 20:55:20.869036 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 978/1948] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:55:20 2022] GET /compute/v2.1/os-quota-sets/9b54dbb6a0bc4d3aa3aa943d646aed67 => generated 371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:55:20.885351 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e06e1bbc-5e54-4f87-ad88-74266be0909a tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] Calling method '.version_select at 0x7f77eea4d310>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:21.135419 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e06e1bbc-5e54-4f87-ad88-74266be0909a tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/9b54dbb6a0bc4d3aa3aa943d646aed67?user_id=003a9f520055490f920716d1e71b9999" status: 200 len: 371 microversion: 2.1 time: 0.255148 Oct 04 20:55:21.136675 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 971/1949] 10.222.0.78 () {58 vars in 1323 bytes} [Tue Oct 4 20:55:20 2022] GET /compute/v2.1/os-quota-sets/9b54dbb6a0bc4d3aa3aa943d646aed67?user_id=003a9f520055490f920716d1e71b9999 => generated 371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:55:21.843318 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-26f77c2c-c6b2-4097-8f8c-9c39ade45ccb tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:21.844672 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-26f77c2c-c6b2-4097-8f8c-9c39ade45ccb tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:21.862293 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-26f77c2c-c6b2-4097-8f8c-9c39ade45ccb tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:21.863458 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-26f77c2c-c6b2-4097-8f8c-9c39ade45ccb tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:21.864214 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-26f77c2c-c6b2-4097-8f8c-9c39ade45ccb tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:21.875191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-26f77c2c-c6b2-4097-8f8c-9c39ade45ccb tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:21.876645 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-26f77c2c-c6b2-4097-8f8c-9c39ade45ccb tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:21.877667 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-26f77c2c-c6b2-4097-8f8c-9c39ade45ccb tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:22.257092 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-26f77c2c-c6b2-4097-8f8c-9c39ade45ccb tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:22.295702 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-26f77c2c-c6b2-4097-8f8c-9c39ade45ccb tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:22.312386 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-26f77c2c-c6b2-4097-8f8c-9c39ade45ccb tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:22.315403 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-26f77c2c-c6b2-4097-8f8c-9c39ade45ccb tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1362 microversion: 2.57 time: 0.488121 Oct 04 20:55:22.329490 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 979/1950] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:21 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1362 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:23.366383 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:23.372515 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:23.405839 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:23.408317 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:23.410313 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:23.414535 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:23.421104 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:23.422484 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:23.584216 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:23.585152 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:23.586494 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:23.591749 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lazy-loading 'fault' on Instance uuid 9933f019-7130-449a-bfc5-69ef6b77217c {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:55:23.974659 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:24.013484 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:24.020968 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f06e5f7d140c4e689955b9856e651331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:24.025787 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ca7be65d-c9b9-4508-a162-b2ea1d871577 tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 200 len: 1367 microversion: 2.57 time: 0.667351 Oct 04 20:55:24.031105 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 972/1951] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:23 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 1367 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:25.093426 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c94624e3-a253-4058-890d-0d10497f10ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:25.098847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c94624e3-a253-4058-890d-0d10497f10ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] [instance: 9933f019-7130-449a-bfc5-69ef6b77217c] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:25.128082 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c94624e3-a253-4058-890d-0d10497f10ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:25.131431 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c94624e3-a253-4058-890d-0d10497f10ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:25.132539 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c94624e3-a253-4058-890d-0d10497f10ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:25.138523 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c94624e3-a253-4058-890d-0d10497f10ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:25.140967 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c94624e3-a253-4058-890d-0d10497f10ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:25.140967 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c94624e3-a253-4058-890d-0d10497f10ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:25.211754 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-c94624e3-a253-4058-890d-0d10497f10ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] HTTP exception thrown: Instance 9933f019-7130-449a-bfc5-69ef6b77217c could not be found. Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c94624e3-a253-4058-890d-0d10497f10ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Request method failure captured: Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c HTTP/1.1 Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ2EB4jbVKhbECpPgkITtDtNYdVYK0qB3M7RlCcksd-hkIVmeuWSjXaKkyN49vOJGe6H6NnyVByudT2X-21W_HV-y6ZcuHnGoXzlVmX6aRx0FYp5mz9MaWvjLKSqbvhOHkvt9YMAkGFj-2nuWyvwhIn_vIQUq9kmn9eiN2sQEfhsfB0 Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Openstack-Nova-Api-Version: 2.57 Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 8600ebb44bd847e2b8114c3d8d2cbbf2 Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServerShowV257Test-1183170414 Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8600ebb44bd847e2b8114c3d8d2cbbf2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8600ebb44bd847e2b8114c3d8d2cbbf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8600ebb44bd847e2b8114c3d8d2cbbf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8600ebb44bd847e2b8114c3d8d2cbbf2"}]}] Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServerShowV257Test-1183170414 Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 8600ebb44bd847e2b8114c3d8d2cbbf2 Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServerShowV257Test-1183170414 Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServerShowV257Test-1183170414-project Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: f06e5f7d140c4e689955b9856e651331 Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServerShowV257Test-1183170414-project Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance 9933f019-7130-449a-bfc5-69ef6b77217c could not be found. Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '9933f019-7130-449a-bfc5-69ef6b77217c'} Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9933f019-7130-449a-bfc5-69ef6b77217c could not be found. Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9933f019-7130-449a-bfc5-69ef6b77217c could not be found. Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:25.218071 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:55:25.230162 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:25.230162 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:25.230162 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:25.230162 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:25.230162 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:25.230162 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9933f019-7130-449a-bfc5-69ef6b77217c could not be found. Oct 04 20:55:25.230162 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:55:25.248404 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c94624e3-a253-4058-890d-0d10497f10ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] Returning 404 to user: Instance 9933f019-7130-449a-bfc5-69ef6b77217c could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:25.248404 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c94624e3-a253-4058-890d-0d10497f10ed tempest-ServerShowV257Test-1183170414 tempest-ServerShowV257Test-1183170414-project] 10.222.0.78 "GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c" status: 404 len: 111 microversion: 2.57 time: 0.148690 Oct 04 20:55:25.248404 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 980/1952] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:25 2022] GET /compute/v2.1/servers/9933f019-7130-449a-bfc5-69ef6b77217c => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:55:31.407876 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:32.077283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5f7f1342-a485-433d-b600-70a4cbf39b61 tempest-InstanceActionsV221TestJSON-896708399 tempest-InstanceActionsV221TestJSON-896708399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-32301707", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "a8112da8-6f7c-404b-8956-584c1f9d7cc1"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:32.385708 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-5f7f1342-a485-433d-b600-70a4cbf39b61 tempest-InstanceActionsV221TestJSON-896708399 tempest-InstanceActionsV221TestJSON-896708399-project] validate_networks() for [('a8112da8-6f7c-404b-8956-584c1f9d7cc1', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-5f7f1342-a485-433d-b600-70a4cbf39b61 tempest-InstanceActionsV221TestJSON-896708399 tempest-InstanceActionsV221TestJSON-896708399-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e9ed3650-b96d-4178-9c4d-06e76d94348f) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:55:33.884636 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e9ed3650-b96d-4178-9c4d-06e76d94348f) Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-5f7f1342-a485-433d-b600-70a4cbf39b61 tempest-InstanceActionsV221TestJSON-896708399 tempest-InstanceActionsV221TestJSON-896708399-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:55:33.893501 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5f7f1342-a485-433d-b600-70a4cbf39b61 tempest-InstanceActionsV221TestJSON-896708399 tempest-InstanceActionsV221TestJSON-896708399-project] Request method failure captured: Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 211 Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJ3CU3isUtT_0M1U78PivavuTbv6wsLQDD-jo0qcqwaW2QXjnkW1m-vnv3xodZk5b5Yldhx62Dtw7YJCMuorw8bXC2JaorbyAI7_hTZmDxHiqaTKPjfzRTGOOTG1GG3rBCZ6pky-anTRtZ_XPX6N71Kg97tLbLkq8bTjN_aEsY-3HtI Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: a7aee6375ab0440d970befc057955940 Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-InstanceActionsV221TestJSON-896708399 Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a7aee6375ab0440d970befc057955940", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7aee6375ab0440d970befc057955940"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a7aee6375ab0440d970befc057955940"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a7aee6375ab0440d970befc057955940"}]}] Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-InstanceActionsV221TestJSON-896708399 Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: a7aee6375ab0440d970befc057955940 Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-896708399 Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-InstanceActionsV221TestJSON-896708399-project Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 790598df1c304f4e9984449ad8b26c95 Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-InstanceActionsV221TestJSON-896708399-project Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-32301707", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "a8112da8-6f7c-404b-8956-584c1f9d7cc1"}]}} Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsV221TestJSON-server-32301707', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'a8112da8-6f7c-404b-8956-584c1f9d7cc1'}]}}} Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:55:33.898364 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e9ed3650-b96d-4178-9c4d-06e76d94348f) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:55:33.910160 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5f7f1342-a485-433d-b600-70a4cbf39b61 tempest-InstanceActionsV221TestJSON-896708399 tempest-InstanceActionsV221TestJSON-896708399-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:33.923170 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5f7f1342-a485-433d-b600-70a4cbf39b61 tempest-InstanceActionsV221TestJSON-896708399 tempest-InstanceActionsV221TestJSON-896708399-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.21 time: 2.528626 Oct 04 20:55:33.928879 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 973/1953] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Oct 4 20:55:31 2022] POST /compute/v2.1/servers => generated 214 bytes in 2541 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 04 20:55:59.997444 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:00.000807 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=23 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:00.002471 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=25 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:01.174188 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e300c6c7-a4c7-436e-a79b-2560406ec067 tempest-ServersNegativeTestJSON-133768279 tempest-ServersNegativeTestJSON-133768279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1648649324", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "057c865c-26ef-4491-ba5f-fc685aff30a6"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:01.337550 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-e300c6c7-a4c7-436e-a79b-2560406ec067 tempest-ServersNegativeTestJSON-133768279 tempest-ServersNegativeTestJSON-133768279-project] validate_networks() for [('057c865c-26ef-4491-ba5f-fc685aff30a6', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-e300c6c7-a4c7-436e-a79b-2560406ec067 tempest-ServersNegativeTestJSON-133768279 tempest-ServersNegativeTestJSON-133768279-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-650c2ad6-7576-434d-98a9-cc7801209349) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:56:02.673300 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-650c2ad6-7576-434d-98a9-cc7801209349) Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-e300c6c7-a4c7-436e-a79b-2560406ec067 tempest-ServersNegativeTestJSON-133768279 tempest-ServersNegativeTestJSON-133768279-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e300c6c7-a4c7-436e-a79b-2560406ec067 tempest-ServersNegativeTestJSON-133768279 tempest-ServersNegativeTestJSON-133768279-project] Request method failure captured: Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 209 Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ3e4-HlpT_W8gPkHgNl0tScMffUfQHUGjIuT1HB9SjR16fCMcb5NZqfulLTXhNLOo7raWIDtHxegzvps_AHZ2KfpJj3jyDPBriMzKa-69RKef-FK4mMt3cy0NWBHt8v7AV9FhN6kLb8beLaiJoJVGjQHR2qlm2xxwZhkP4tATq5xdc Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 8bc331439dfe4bbbb6c764bc5c243b35 Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersNegativeTestJSON-133768279 Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8bc331439dfe4bbbb6c764bc5c243b35", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8bc331439dfe4bbbb6c764bc5c243b35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8bc331439dfe4bbbb6c764bc5c243b35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8bc331439dfe4bbbb6c764bc5c243b35"}]}] Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersNegativeTestJSON-133768279 Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 8bc331439dfe4bbbb6c764bc5c243b35 Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-133768279 Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersNegativeTestJSON-133768279-project Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 0da48b8d726f40ddadd9f51c65ba8fde Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersNegativeTestJSON-133768279-project Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1648649324", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "057c865c-26ef-4491-ba5f-fc685aff30a6"}]}} Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1648649324', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '057c865c-26ef-4491-ba5f-fc685aff30a6'}]}}} Oct 04 20:56:02.699912 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:56:02.709387 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-650c2ad6-7576-434d-98a9-cc7801209349) Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e300c6c7-a4c7-436e-a79b-2560406ec067 tempest-ServersNegativeTestJSON-133768279 tempest-ServersNegativeTestJSON-133768279-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e300c6c7-a4c7-436e-a79b-2560406ec067 tempest-ServersNegativeTestJSON-133768279 tempest-ServersNegativeTestJSON-133768279-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.694485 Oct 04 20:56:02.718173 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 981/1954] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:55:59 2022] POST /compute/v2.1/servers => generated 214 bytes in 2696 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 20:56:34.433299 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:34.436213 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:34.438834 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:56:34.439456 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 20:56:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 20:56:35.946427 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-194bf678-fa0c-43fc-ba16-05a9da5f9910 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] Action: 'create', calling method: .version_select at 0x7f77ef9de670>, body: {"keypair": {"name": "tempest-keypair-2011353853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzySEGX7AOC5sd3VcZ23zWoLjY0E0W+4e0V3OZdgZEKMmHEyHflJuwKDoxWirzWIzkOirM5uS/bdQtOZg/IuMkgUQatTQagroRHhbNWLzOro/PfrnVPV3G3PRq2n37XjQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:36.019501 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-194bf678-fa0c-43fc-ba16-05a9da5f9910 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] Getting quotas for project 423269a2642a45b29d4f92a0995e6c3c. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:56:36.036656 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-194bf678-fa0c-43fc-ba16-05a9da5f9910 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] Getting quotas for user 0c675434f74c4f5098001c859f7963d6 and project 423269a2642a45b29d4f92a0995e6c3c. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:56:36.207000 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-194bf678-fa0c-43fc-ba16-05a9da5f9910 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.775790 Oct 04 20:56:36.212076 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 974/1955] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 20:56:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:36.760397 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:36.765041 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:56:36.765741 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 20:56:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/extensions/os-consoles (ip 10.222.0.78) !!! Oct 04 20:56:37.939540 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b1ef5cce-99b5-4e60-9d46-e4049b349206 tempest-ExtensionsTest-1176477004 tempest-ExtensionsTest-1176477004-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:37.948848 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b1ef5cce-99b5-4e60-9d46-e4049b349206 tempest-ExtensionsTest-1176477004 tempest-ExtensionsTest-1176477004-project] 10.222.0.78 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 1.184113 Oct 04 20:56:37.956985 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 982/1956] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Oct 4 20:56:36 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:37.978653 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8d4cf805-4196-4dee-b568-85610efb1086 tempest-ExtensionsTest-1176477004 tempest-ExtensionsTest-1176477004-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:37.991316 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8d4cf805-4196-4dee-b568-85610efb1086 tempest-ExtensionsTest-1176477004 tempest-ExtensionsTest-1176477004-project] 10.222.0.78 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.027201 Oct 04 20:56:37.995795 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 975/1957] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 4 20:56:37 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:56:47.696087 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bd45b243-3b64-4b1f-9354-18dba31df958 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227-project-admin] Calling method '.version_select at 0x7f77ef641940>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:47.710781 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd45b243-3b64-4b1f-9354-18dba31df958 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:47.712233 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd45b243-3b64-4b1f-9354-18dba31df958 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:47.714613 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd45b243-3b64-4b1f-9354-18dba31df958 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:47.801040 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd45b243-3b64-4b1f-9354-18dba31df958 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:47.807599 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd45b243-3b64-4b1f-9354-18dba31df958 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:47.812655 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd45b243-3b64-4b1f-9354-18dba31df958 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:47.879401 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd45b243-3b64-4b1f-9354-18dba31df958 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:47.882082 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd45b243-3b64-4b1f-9354-18dba31df958 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:47.884489 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd45b243-3b64-4b1f-9354-18dba31df958 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:47.922293 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bd45b243-3b64-4b1f-9354-18dba31df958 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-13436227-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.792049 Oct 04 20:56:47.923686 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 983/1958] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:56:46 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:50.220285 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-80150e8a-0fb2-474b-9c18-2a78ed639318 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-478388042", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9580a1b9-b475-4fcd-9d57-8aa902ddfc60"}], "security_groups": [{"name": "tempest-securitygroup--1385996709"}], "key_name": "tempest-keypair-2011353853", "user_data": "}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:50.354288 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:52.109392 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-80150e8a-0fb2-474b-9c18-2a78ed639318 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] validate_networks() for [('9580a1b9-b475-4fcd-9d57-8aa902ddfc60', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-80150e8a-0fb2-474b-9c18-2a78ed639318 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ef9e00b9-dedd-4c19-8da1-5ab666945a05) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:56:53.039188 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ef9e00b9-dedd-4c19-8da1-5ab666945a05) Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-80150e8a-0fb2-474b-9c18-2a78ed639318 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:56:53.049088 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-80150e8a-0fb2-474b-9c18-2a78ed639318 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] Request method failure captured: Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 493 Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJ4CJqeTGnVsjclVel7Bfk6OslobnJcXw5eM0KzJebw8vLMYU-P7Ep974vrFdF-zUS2se-VUsyc7WOxr94mQJ_CoXFyDy0-k2n7nJWyyvYcPK9YjmnVfxLMIrNhicjKN4m_ZvWcUHfxATpzy_rNOBX4dpJaiME3qmEE0lFfB_qEaNeM Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 423269a2642a45b29d4f92a0995e6c3c Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerActionsTestJSON-1422442004 Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_423269a2642a45b29d4f92a0995e6c3c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/423269a2642a45b29d4f92a0995e6c3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/423269a2642a45b29d4f92a0995e6c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/423269a2642a45b29d4f92a0995e6c3c"}]}] Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerActionsTestJSON-1422442004 Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 423269a2642a45b29d4f92a0995e6c3c Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerActionsTestJSON-1422442004 Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerActionsTestJSON-1422442004-project Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 0c675434f74c4f5098001c859f7963d6 Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerActionsTestJSON-1422442004-project Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServerActionsTestJSON-server-478388042", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "Y0#TZ6nbWC_np@7", "networks": [{"uuid": "9580a1b9-b475-4fcd-9d57-8aa902ddfc60"}], "security_groups": [{"name": "tempest-securitygroup--1385996709"}], "key_name": "tempest-keypair-2011353853", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServerActionsTestJSON-server-478388042', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'Y0#TZ6nbWC_np@7', 'networks': [{'uuid': '9580a1b9-b475-4fcd-9d57-8aa902ddfc60'}], 'security_groups': [{'name': 'tempest-securitygroup--1385996709'}], 'key_name': 'tempest-keypair-2011353853', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 20:56:53.055308 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ef9e00b9-dedd-4c19-8da1-5ab666945a05) Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:53.073695 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-80150e8a-0fb2-474b-9c18-2a78ed639318 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-80150e8a-0fb2-474b-9c18-2a78ed639318 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.847355 Oct 04 20:56:53.087027 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 976/1959] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:56:50 2022] POST /compute/v2.1/servers => generated 214 bytes in 2862 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:56:53.100149 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-88cfdce6-7548-452a-b23d-90d1ebff88f0 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] Calling method '.version_select at 0x7f77eed03d30>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:53.254416 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-88cfdce6-7548-452a-b23d-90d1ebff88f0 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011353853" status: 202 len: 0 microversion: 2.1 time: 0.179714 Oct 04 20:56:53.258394 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 984/1960] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:56:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011353853 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:57:20.995769 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-80150e8a-0fb2-474b-9c18-2a78ed639318 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:21.012430 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-80150e8a-0fb2-474b-9c18-2a78ed639318 tempest-ServerActionsTestJSON-1422442004 tempest-ServerActionsTestJSON-1422442004-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003419 Oct 04 20:57:21.027727 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 977/1961] 10.222.0.78 () {56 vars in 886 bytes} [Tue Oct 4 20:57:20 2022] GET /compute/ => generated 377 bytes in 22 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 20:57:31.477223 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:57:31.479216 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 20:57:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.78) !!! Oct 04 20:57:31.483782 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=6 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:31.483782 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:32.950548 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1c05bc3c-4755-4571-b215-ff3b967cefca tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Action: 'create', calling method: .version_select at 0x7f77eedf61f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1774856743"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:35.903403 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1c05bc3c-4755-4571-b215-ff3b967cefca tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.430045 Oct 04 20:57:35.904933 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 985/1962] 10.222.0.78 () {60 vars in 1155 bytes} [Tue Oct 4 20:57:31 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4433 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 20:57:35.942371 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-672d1024-7732-4374-a3bb-76688250389d tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77ef272160>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:35.979497 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:36.123955 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-672d1024-7732-4374-a3bb-76688250389d tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 200 len: 345 microversion: 2.1 time: 0.189078 Oct 04 20:57:36.126861 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 978/1963] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:57:35 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 345 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:37.159084 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6a7c7cb2-f599-4627-b33d-4c997580efc6 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eeb360d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:37.342336 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6a7c7cb2-f599-4627-b33d-4c997580efc6 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 200 len: 345 microversion: 2.1 time: 0.190481 Oct 04 20:57:37.343851 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 986/1964] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:57:37 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:38.390133 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-030ef0b5-7f98-41fb-b05e-4c7641dea642 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eeae6ee0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:38.713381 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-030ef0b5-7f98-41fb-b05e-4c7641dea642 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 200 len: 345 microversion: 2.1 time: 0.348546 Oct 04 20:57:38.715776 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 979/1965] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:57:38 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 345 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:39.765865 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9b297a62-9935-4a10-a3d4-0eeb697bf9fc tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eeb36e50>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:39.926430 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9b297a62-9935-4a10-a3d4-0eeb697bf9fc tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 200 len: 346 microversion: 2.1 time: 0.189843 Oct 04 20:57:39.940049 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 987/1966] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:57:39 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 346 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:39.999381 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-553ce3ed-208b-479e-9857-d8ca34a9b0a1 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Action: 'create', calling method: .version_select at 0x7f77ef272700>, body: {"snapshot": {"volume_id": "5c0964ca-b244-411c-8723-d1a9f18ac45c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-630493548"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:41.394207 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-553ce3ed-208b-479e-9857-d8ca34a9b0a1 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.443336 Oct 04 20:57:41.397111 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 980/1967] 10.222.0.78 () {60 vars in 1162 bytes} [Tue Oct 4 20:57:39 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:41.426695 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6865d3e7-7aa9-4276-a608-a0a826ad1336 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eeae60d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:41.623496 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6865d3e7-7aa9-4276-a608-a0a826ad1336 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 200 len: 286 microversion: 2.1 time: 0.215720 Oct 04 20:57:41.624768 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 981/1968] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:41 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:41.644870 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-619d5739-95be-4118-a618-5443b8767e00 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eea4dca0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:41.879427 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-619d5739-95be-4118-a618-5443b8767e00 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.240976 Oct 04 20:57:41.880435 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 982/1969] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Oct 4 20:57:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:41.907173 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3395c135-d002-48fb-a870-90f2a5ad046f tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eec29e50>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:42.039941 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3395c135-d002-48fb-a870-90f2a5ad046f tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 200 len: 286 microversion: 2.1 time: 0.147092 Oct 04 20:57:42.040999 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 983/1970] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:41 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:42.417971 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-eddbef75-b735-4039-ac09-d52133962b6e tempest-PortsAdminExtendedAttrsTestJSON-2008960214 tempest-PortsAdminExtendedAttrsTestJSON-2008960214-project-admin] Calling method '.version_select at 0x7f77eee76d30>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:42.426715 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eddbef75-b735-4039-ac09-d52133962b6e tempest-PortsAdminExtendedAttrsTestJSON-2008960214 tempest-PortsAdminExtendedAttrsTestJSON-2008960214-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:42.434274 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eddbef75-b735-4039-ac09-d52133962b6e tempest-PortsAdminExtendedAttrsTestJSON-2008960214 tempest-PortsAdminExtendedAttrsTestJSON-2008960214-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:42.435078 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eddbef75-b735-4039-ac09-d52133962b6e tempest-PortsAdminExtendedAttrsTestJSON-2008960214 tempest-PortsAdminExtendedAttrsTestJSON-2008960214-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:42.494181 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eddbef75-b735-4039-ac09-d52133962b6e tempest-PortsAdminExtendedAttrsTestJSON-2008960214 tempest-PortsAdminExtendedAttrsTestJSON-2008960214-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:42.501692 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eddbef75-b735-4039-ac09-d52133962b6e tempest-PortsAdminExtendedAttrsTestJSON-2008960214 tempest-PortsAdminExtendedAttrsTestJSON-2008960214-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:42.502833 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eddbef75-b735-4039-ac09-d52133962b6e tempest-PortsAdminExtendedAttrsTestJSON-2008960214 tempest-PortsAdminExtendedAttrsTestJSON-2008960214-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:42.553594 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eddbef75-b735-4039-ac09-d52133962b6e tempest-PortsAdminExtendedAttrsTestJSON-2008960214 tempest-PortsAdminExtendedAttrsTestJSON-2008960214-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:42.558680 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eddbef75-b735-4039-ac09-d52133962b6e tempest-PortsAdminExtendedAttrsTestJSON-2008960214 tempest-PortsAdminExtendedAttrsTestJSON-2008960214-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:42.562469 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eddbef75-b735-4039-ac09-d52133962b6e tempest-PortsAdminExtendedAttrsTestJSON-2008960214 tempest-PortsAdminExtendedAttrsTestJSON-2008960214-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:42.590208 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-eddbef75-b735-4039-ac09-d52133962b6e tempest-PortsAdminExtendedAttrsTestJSON-2008960214 tempest-PortsAdminExtendedAttrsTestJSON-2008960214-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.373975 Oct 04 20:57:42.606098 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 988/1971] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 20:57:41 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:43.062259 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8a418c46-fb1c-4bb3-a628-ac0f6281237f tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77f7498dc0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:43.224110 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8a418c46-fb1c-4bb3-a628-ac0f6281237f tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 200 len: 286 microversion: 2.1 time: 0.169260 Oct 04 20:57:43.225757 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 984/1972] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:43 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:44.252339 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5b7a8c5f-3cfd-48ba-ab34-c2aa6042486c tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eeb36dc0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:44.377898 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5b7a8c5f-3cfd-48ba-ab34-c2aa6042486c tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 200 len: 286 microversion: 2.1 time: 0.136858 Oct 04 20:57:44.380035 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 989/1973] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:44 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:45.400856 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-626757a8-d920-40c1-bbe4-6b9a856a0a8a tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eeae6af0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:45.539966 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-626757a8-d920-40c1-bbe4-6b9a856a0a8a tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 200 len: 286 microversion: 2.1 time: 0.146788 Oct 04 20:57:45.543832 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 985/1974] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:45 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:46.569066 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-11f4d94c-59d6-4b2d-aa5e-15ce819d1e10 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77ef1681f0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:46.763076 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-11f4d94c-59d6-4b2d-aa5e-15ce819d1e10 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 200 len: 286 microversion: 2.1 time: 0.202998 Oct 04 20:57:46.765094 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 990/1975] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:46 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:47.791055 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-81fba836-ea2b-48a9-8994-64e8a0d86901 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eea4d9d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:47.897145 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-81fba836-ea2b-48a9-8994-64e8a0d86901 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 200 len: 287 microversion: 2.1 time: 0.118773 Oct 04 20:57:47.898539 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 986/1976] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:47 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:47.937096 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f87bb53c-1762-4dfc-ac9f-4714822659e6 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eed98430>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:48.167322 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f87bb53c-1762-4dfc-ac9f-4714822659e6 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 202 len: 0 microversion: 2.1 time: 0.254566 Oct 04 20:57:48.168748 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 991/1977] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 4 20:57:47 2022] DELETE /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:57:48.187075 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6f711613-1ab0-46d7-90c1-70c1bafa9062 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77ef2094c0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:48.304407 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6f711613-1ab0-46d7-90c1-70c1bafa9062 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 200 len: 286 microversion: 2.1 time: 0.128322 Oct 04 20:57:48.306286 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 987/1978] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:48 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:49.328644 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-aaa38635-bffc-4eae-9404-ff1be3951492 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eeb36310>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:49.448947 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-aaa38635-bffc-4eae-9404-ff1be3951492 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 200 len: 286 microversion: 2.1 time: 0.127615 Oct 04 20:57:49.450113 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 992/1979] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:49 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:50.472417 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5d1cff72-cf43-4d06-9939-1391bfda0f36 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eeae60d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:50.724361 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5d1cff72-cf43-4d06-9939-1391bfda0f36 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 200 len: 286 microversion: 2.1 time: 0.258503 Oct 04 20:57:50.728905 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 988/1980] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:50 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 286 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:51.754845 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d60c8b50-610e-4221-9999-f87644754282 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eed98670>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:51.861589 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d60c8b50-610e-4221-9999-f87644754282 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 200 len: 286 microversion: 2.1 time: 0.118372 Oct 04 20:57:51.871662 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 993/1981] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:51 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:52.890283 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0c1612cd-f246-4b07-bac7-5e0a5a372ba1 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77ef75dd30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:53.006898 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0c1612cd-f246-4b07-bac7-5e0a5a372ba1 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 200 len: 286 microversion: 2.1 time: 0.128228 Oct 04 20:57:53.010315 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 989/1982] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:52 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:54.022813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:54.024519 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=6 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:54.034423 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-88856246-700b-4500-84bd-44d9184f222c tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eed983a0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:54.126924 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-88856246-700b-4500-84bd-44d9184f222c tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] HTTP exception thrown: Snapshot e9849216-a538-4b37-a667-0c23b0a50f59 could not be found. Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-88856246-700b-4500-84bd-44d9184f222c tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Request method failure captured: Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 HTTP/1.1 Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ47fSs9LyVHbCYg6JptzCki1hu0Iy2SFeU4PB0R6PdMWGuCgetLOJr8npE8iy9f6rtBmh5T0O7Vy49KNXqC5yFdQvkbg8VEysj-QhWhn93ZB3LXLyYGwdd084aD8nSJTgnXjYNRuB2SmRLNnjK8JHrPCMrkh95JKzeKWY6XjMIoTEs Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: f386d694b9154960a741f31caafb0e02 Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-874569611 Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f386d694b9154960a741f31caafb0e02", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f386d694b9154960a741f31caafb0e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f386d694b9154960a741f31caafb0e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f386d694b9154960a741f31caafb0e02"}]}] Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-VolumesSnapshotsTestJSON-874569611 Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: f386d694b9154960a741f31caafb0e02 Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-874569611 Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-VolumesSnapshotsTestJSON-874569611-project Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 21f75ea1b9a94d7ebefe98bf691cf406 Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-VolumesSnapshotsTestJSON-874569611-project Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: exception: Snapshot e9849216-a538-4b37-a667-0c23b0a50f59 could not be found. Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'e9849216-a538-4b37-a667-0c23b0a50f59'} Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e9849216-a538-4b37-a667-0c23b0a50f59 could not be found. (HTTP 404) (Request-ID: req-e65dc2ca-7525-4bb8-bf11-a409a610e0e7) Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:57:54.136819 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e9849216-a538-4b37-a667-0c23b0a50f59 could not be found. Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e9849216-a538-4b37-a667-0c23b0a50f59 could not be found. Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e9849216-a538-4b37-a667-0c23b0a50f59 could not be found. Oct 04 20:57:54.144104 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.155284 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-88856246-700b-4500-84bd-44d9184f222c tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Returning 404 to user: Snapshot e9849216-a538-4b37-a667-0c23b0a50f59 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:54.161101 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-88856246-700b-4500-84bd-44d9184f222c tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59" status: 404 len: 111 microversion: 2.1 time: 0.138588 Oct 04 20:57:54.163254 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 994/1983] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:57:54 2022] GET /compute/v2.1/os-snapshots/e9849216-a538-4b37-a667-0c23b0a50f59 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:54.181411 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7d1d8bb8-235a-4a80-95ac-e5bef5776ea1 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77ef5d9e50>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:54.612834 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7d1d8bb8-235a-4a80-95ac-e5bef5776ea1 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 202 len: 0 microversion: 2.1 time: 0.440181 Oct 04 20:57:54.620345 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 990/1984] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:57:54 2022] DELETE /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:57:54.632084 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6aa041fa-6cd6-40d8-b389-17cac020dd4f tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eef7f5e0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:54.901441 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6aa041fa-6cd6-40d8-b389-17cac020dd4f tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 200 len: 345 microversion: 2.1 time: 0.278143 Oct 04 20:57:54.903297 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 995/1985] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:57:54 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 345 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:55.935372 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1fc570d5-486a-450e-b9b2-edad599d1707 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eea4d280>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:56.186879 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1fc570d5-486a-450e-b9b2-edad599d1707 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 200 len: 345 microversion: 2.1 time: 0.265493 Oct 04 20:57:56.200146 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 991/1986] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:57:55 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 345 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:57.216788 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e5b06306-78c6-4943-b9ec-e14649ac82a3 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77ef168f70>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:57.494841 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e5b06306-78c6-4943-b9ec-e14649ac82a3 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 200 len: 345 microversion: 2.1 time: 0.287356 Oct 04 20:57:57.508607 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 996/1987] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:57:57 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 345 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:58.524334 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-87e18224-661e-492e-8954-80c41df76dac tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eea4d430>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:58.761576 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-87e18224-661e-492e-8954-80c41df76dac tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 200 len: 345 microversion: 2.1 time: 0.246191 Oct 04 20:57:58.776961 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 992/1988] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:57:58 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 345 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:59.794110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a20a1a07-34df-4876-be7c-6c3670f49162 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77ef168700>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:59.962190 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a20a1a07-34df-4876-be7c-6c3670f49162 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 200 len: 345 microversion: 2.1 time: 0.177677 Oct 04 20:57:59.976236 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 997/1989] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:57:59 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 345 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:00.991430 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2a1d2fea-c5b0-4886-a56e-89f962bbbe9d tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eea4d550>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:01.258106 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2a1d2fea-c5b0-4886-a56e-89f962bbbe9d tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 200 len: 345 microversion: 2.1 time: 0.278205 Oct 04 20:58:01.259308 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 993/1990] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:58:00 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 345 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:02.314617 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5db459f9-5e2a-42a5-8440-27c8068af51e tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eedf69d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:02.529608 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5db459f9-5e2a-42a5-8440-27c8068af51e tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 200 len: 345 microversion: 2.1 time: 0.252531 Oct 04 20:58:02.531570 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 998/1991] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:58:02 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 345 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:03.555741 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-71684d09-888e-4081-aba3-fd2289b11bb1 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77f7498040>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:03.705192 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-71684d09-888e-4081-aba3-fd2289b11bb1 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] HTTP exception thrown: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-71684d09-888e-4081-aba3-fd2289b11bb1 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Request method failure captured: Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c HTTP/1.1 Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJ47fSs9LyVHbCYg6JptzCki1hu0Iy2SFeU4PB0R6PdMWGuCgetLOJr8npE8iy9f6rtBmh5T0O7Vy49KNXqC5yFdQvkbg8VEysj-QhWhn93ZB3LXLyYGwdd084aD8nSJTgnXjYNRuB2SmRLNnjK8JHrPCMrkh95JKzeKWY6XjMIoTEs Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: f386d694b9154960a741f31caafb0e02 Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-874569611 Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f386d694b9154960a741f31caafb0e02", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f386d694b9154960a741f31caafb0e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f386d694b9154960a741f31caafb0e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f386d694b9154960a741f31caafb0e02"}]}] Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-VolumesSnapshotsTestJSON-874569611 Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: f386d694b9154960a741f31caafb0e02 Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-874569611 Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-VolumesSnapshotsTestJSON-874569611-project Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 21f75ea1b9a94d7ebefe98bf691cf406 Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-VolumesSnapshotsTestJSON-874569611-project Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: exception: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '5c0964ca-b244-411c-8723-d1a9f18ac45c'} Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. (HTTP 404) (Request-ID: req-6180e1ab-76b3-4eb7-9eca-dd67ffd6a7e4) Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:58:03.709674 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.719997 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-71684d09-888e-4081-aba3-fd2289b11bb1 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Returning 404 to user: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:03.733847 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-71684d09-888e-4081-aba3-fd2289b11bb1 tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 404 len: 109 microversion: 2.1 time: 0.166974 Oct 04 20:58:03.735239 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 994/1992] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:58:03 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 109 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:58:03.756734 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-04d2dfad-b9fb-49d1-afb5-88583e4d812a tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77eead6c10>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:03.899588 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-04d2dfad-b9fb-49d1-afb5-88583e4d812a tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] HTTP exception thrown: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-04d2dfad-b9fb-49d1-afb5-88583e4d812a tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Request method failure captured: Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: request: DELETE /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c HTTP/1.1 Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ47fSs9LyVHbCYg6JptzCki1hu0Iy2SFeU4PB0R6PdMWGuCgetLOJr8npE8iy9f6rtBmh5T0O7Vy49KNXqC5yFdQvkbg8VEysj-QhWhn93ZB3LXLyYGwdd084aD8nSJTgnXjYNRuB2SmRLNnjK8JHrPCMrkh95JKzeKWY6XjMIoTEs Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: f386d694b9154960a741f31caafb0e02 Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-874569611 Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f386d694b9154960a741f31caafb0e02", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f386d694b9154960a741f31caafb0e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f386d694b9154960a741f31caafb0e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f386d694b9154960a741f31caafb0e02"}]}] Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-VolumesSnapshotsTestJSON-874569611 Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: f386d694b9154960a741f31caafb0e02 Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-874569611 Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-VolumesSnapshotsTestJSON-874569611-project Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 21f75ea1b9a94d7ebefe98bf691cf406 Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-VolumesSnapshotsTestJSON-874569611-project Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: method: Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: exception: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '5c0964ca-b244-411c-8723-d1a9f18ac45c'} Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. (HTTP 404) (Request-ID: req-b8f4c73e-27d7-428c-ab1c-7040f9b12206) Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:58:03.904496 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-04d2dfad-b9fb-49d1-afb5-88583e4d812a tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Returning 404 to user: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:03.908700 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-04d2dfad-b9fb-49d1-afb5-88583e4d812a tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 404 len: 109 microversion: 2.1 time: 0.162128 Oct 04 20:58:03.914082 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 999/1993] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:58:03 2022] DELETE /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 109 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:03.939590 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ff5b0181-2f3c-4858-814a-6d90ecf04f3c tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Calling method '.version_select at 0x7f77f7498280>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:04.081205 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-ff5b0181-2f3c-4858-814a-6d90ecf04f3c tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] HTTP exception thrown: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ff5b0181-2f3c-4858-814a-6d90ecf04f3c tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Request method failure captured: Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c HTTP/1.1 Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJ47fSs9LyVHbCYg6JptzCki1hu0Iy2SFeU4PB0R6PdMWGuCgetLOJr8npE8iy9f6rtBmh5T0O7Vy49KNXqC5yFdQvkbg8VEysj-QhWhn93ZB3LXLyYGwdd084aD8nSJTgnXjYNRuB2SmRLNnjK8JHrPCMrkh95JKzeKWY6XjMIoTEs Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: f386d694b9154960a741f31caafb0e02 Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-874569611 Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f386d694b9154960a741f31caafb0e02", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f386d694b9154960a741f31caafb0e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f386d694b9154960a741f31caafb0e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f386d694b9154960a741f31caafb0e02"}]}] Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-VolumesSnapshotsTestJSON-874569611 Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: f386d694b9154960a741f31caafb0e02 Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-874569611 Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-VolumesSnapshotsTestJSON-874569611-project Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 21f75ea1b9a94d7ebefe98bf691cf406 Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-VolumesSnapshotsTestJSON-874569611-project Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: method: Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: exception: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '5c0964ca-b244-411c-8723-d1a9f18ac45c'} Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. (HTTP 404) (Request-ID: req-0d9b5cae-052f-4444-86f0-b35685346ef7) Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:58:04.086402 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 20:58:04.090761 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ff5b0181-2f3c-4858-814a-6d90ecf04f3c tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] Returning 404 to user: Volume 5c0964ca-b244-411c-8723-d1a9f18ac45c could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:04.093005 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ff5b0181-2f3c-4858-814a-6d90ecf04f3c tempest-VolumesSnapshotsTestJSON-874569611 tempest-VolumesSnapshotsTestJSON-874569611-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c" status: 404 len: 109 microversion: 2.1 time: 0.167447 Oct 04 20:58:04.100904 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 995/1994] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:58:03 2022] GET /compute/v2.1/os-volumes/5c0964ca-b244-411c-8723-d1a9f18ac45c => generated 109 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:02:15.990285 n-d-852085-12 devstack@n-api.service[123539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d5edc17b-4d95-44e5-91e5-59bc85f612b8] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:02:15.992633 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:02:15.993267 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:02:15.996180 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:02:15.996785 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:02:15.999627 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:02:16.000035 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:02:16.525061 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a252aca4-860f-4dfc-b369-230f87b7c546 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Action: 'create', calling method: .version_select at 0x7f77eed98b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-665662603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMO2VYhZiGraGbiQsZAbU5SRReIb/mx2zym2g5L2kPg7/5yM26puK//wcQ9qU2/uQ+Z087IqufROHMud2guYruQKxV2kqy+Gut+12B+addtilcoEKQ/pz4b+GQaHYeVLQA=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:16.627406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-a252aca4-860f-4dfc-b369-230f87b7c546 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Getting quotas for project 2f27496d38be44c29c3cd5bc4ae008d8. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:02:16.664007 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-a252aca4-860f-4dfc-b369-230f87b7c546 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Getting quotas for user 626d1f96e801458eba55b56ff8fb3672 and project 2f27496d38be44c29c3cd5bc4ae008d8. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:02:16.933729 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a252aca4-860f-4dfc-b369-230f87b7c546 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.946327 Oct 04 21:02:16.956752 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1000/1995] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:02:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:03:07.053045 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:03:07.056428 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:03:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 21:03:07.059279 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:03:07.066571 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:03:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 21:03:07.081587 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:03:07.082280 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:03:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 21:03:07.120064 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-11858816-361c-48b5-85c9-f6fcdbe495b8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-935978450", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "e40afdc2-04d3-419c-b697-6ad6fc8f7435"}], "key_name": "tempest-TestNetworkAdvancedServerOps-665662603", "security_groups": [{"name": "tempest-secgroup-smoke-937483910"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:08.704982 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-11858816-361c-48b5-85c9-f6fcdbe495b8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] validate_networks() for [('e40afdc2-04d3-419c-b697-6ad6fc8f7435', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-11858816-361c-48b5-85c9-f6fcdbe495b8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-74618e71-ddc9-4f13-bfe8-a896dbcb0c81) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:03:10.065318 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-74618e71-ddc9-4f13-bfe8-a896dbcb0c81) Oct 04 21:03:10.072825 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:03:10.078400 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-11858816-361c-48b5-85c9-f6fcdbe495b8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:03:10.078400 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-11858816-361c-48b5-85c9-f6fcdbe495b8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Request method failure captured: Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 342 Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPJ9T7iZn6NtiviFSPRDxz-SEHKk_Q5hiVpwMr4x1Nr0KssspAFHrvzLuiEwNqpgfVhrnwaXGRFKLVSlheR7oAD2dXYG7Fxw_9vYSEfA1gq4w2-xlqdvmHX1pVBYqp9e_b_gi2frhcP_yLqMmQexgSBVpkUZELVAIHFJZbB7aqeMZ7FQ Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 2f27496d38be44c29c3cd5bc4ae008d8 Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1969028259 Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2f27496d38be44c29c3cd5bc4ae008d8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2f27496d38be44c29c3cd5bc4ae008d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2f27496d38be44c29c3cd5bc4ae008d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2f27496d38be44c29c3cd5bc4ae008d8"}]}] Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1969028259 Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 2f27496d38be44c29c3cd5bc4ae008d8 Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1969028259 Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestNetworkAdvancedServerOps-1969028259-project Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 626d1f96e801458eba55b56ff8fb3672 Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1969028259-project Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-935978450", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "e40afdc2-04d3-419c-b697-6ad6fc8f7435"}], "key_name": "tempest-TestNetworkAdvancedServerOps-665662603", "security_groups": [{"name": "tempest-secgroup-smoke-937483910"}]}} Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-935978450', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'e40afdc2-04d3-419c-b697-6ad6fc8f7435'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-665662603', 'security_groups': [{'name': 'tempest-secgroup-smoke-937483910'}]}}} Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:03:10.086945 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-74618e71-ddc9-4f13-bfe8-a896dbcb0c81) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:03:10.095075 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:03:10.106845 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:03:10.112418 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-11858816-361c-48b5-85c9-f6fcdbe495b8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:03:10.112418 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:03:10.118940 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-11858816-361c-48b5-85c9-f6fcdbe495b8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.067388 Oct 04 21:03:10.129000 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 996/1996] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:03:07 2022] POST /compute/v2.1/servers => generated 214 bytes in 3082 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:03:39.425293 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:39.429682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:39.439440 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-90d5931d-ad99-410e-aada-0f20ea2f2787 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Calling method '.version_select at 0x7f77eeadb9d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:39.513003 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] [d5edc17b-4d95-44e5-91e5-59bc85f612b8] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 35096. Oct 04 21:03:39.689665 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-90d5931d-ad99-410e-aada-0f20ea2f2787 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-665662603" status: 202 len: 0 microversion: 2.1 time: 0.268063 Oct 04 21:03:39.691010 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1001/1997] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Oct 4 21:03:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-665662603 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:03:39.732884 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-625c95f3-ed03-493f-bfc8-6ec1e4f4337f tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Action: 'create', calling method: .version_select at 0x7f77eecc1700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-954964540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVKAHB7k5GORknhpa1s1R2t6J7KtcCYzV2w6KWcv+/bRIlBA90ut7KZhbkhvL224lvSvzEy47ungnSBXaycVc6DlB9q7RZH0Ffm6jf6sMklTXSXYBUlgNHtOwmBnhnnPg=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:39.760342 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:39.805369 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-625c95f3-ed03-493f-bfc8-6ec1e4f4337f tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Getting quotas for project 2f27496d38be44c29c3cd5bc4ae008d8. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:03:39.836290 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-625c95f3-ed03-493f-bfc8-6ec1e4f4337f tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Getting quotas for user 626d1f96e801458eba55b56ff8fb3672 and project 2f27496d38be44c29c3cd5bc4ae008d8. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:03:40.051671 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-625c95f3-ed03-493f-bfc8-6ec1e4f4337f tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.327404 Oct 04 21:03:40.053875 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 997/1998] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:03:39 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:33.582786 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0fcdc576-b666-47c9-9c0b-ddec12345ad6 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-321576569", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "83e6ca08-c33d-48fc-a208-86007e616c48"}], "key_name": "tempest-TestNetworkAdvancedServerOps-954964540", "security_groups": [{"name": "tempest-secgroup-smoke-1174763856"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:35.385737 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-0fcdc576-b666-47c9-9c0b-ddec12345ad6 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] validate_networks() for [('83e6ca08-c33d-48fc-a208-86007e616c48', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-0fcdc576-b666-47c9-9c0b-ddec12345ad6 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e018d260-ac29-435e-8f79-8f52bfac9866) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:04:37.077878 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e018d260-ac29-435e-8f79-8f52bfac9866) Oct 04 21:04:37.084394 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:04:37.088866 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-0fcdc576-b666-47c9-9c0b-ddec12345ad6 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:04:37.088866 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0fcdc576-b666-47c9-9c0b-ddec12345ad6 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Request method failure captured: Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 343 Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ9T7iZn6NtiviFSPRDxz-SEHKk_Q5hiVpwMr4x1Nr0KssspAFHrvzLuiEwNqpgfVhrnwaXGRFKLVSlheR7oAD2dXYG7Fxw_9vYSEfA1gq4w2-xlqdvmHX1pVBYqp9e_b_gi2frhcP_yLqMmQexgSBVpkUZELVAIHFJZbB7aqeMZ7FQ Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 2f27496d38be44c29c3cd5bc4ae008d8 Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1969028259 Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2f27496d38be44c29c3cd5bc4ae008d8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2f27496d38be44c29c3cd5bc4ae008d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2f27496d38be44c29c3cd5bc4ae008d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2f27496d38be44c29c3cd5bc4ae008d8"}]}] Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1969028259 Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 2f27496d38be44c29c3cd5bc4ae008d8 Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1969028259 Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestNetworkAdvancedServerOps-1969028259-project Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 626d1f96e801458eba55b56ff8fb3672 Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1969028259-project Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-321576569", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "83e6ca08-c33d-48fc-a208-86007e616c48"}], "key_name": "tempest-TestNetworkAdvancedServerOps-954964540", "security_groups": [{"name": "tempest-secgroup-smoke-1174763856"}]}} Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-321576569', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '83e6ca08-c33d-48fc-a208-86007e616c48'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-954964540', 'security_groups': [{'name': 'tempest-secgroup-smoke-1174763856'}]}}} Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:04:37.094120 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e018d260-ac29-435e-8f79-8f52bfac9866) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:37.101158 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0fcdc576-b666-47c9-9c0b-ddec12345ad6 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:04:37.121741 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0fcdc576-b666-47c9-9c0b-ddec12345ad6 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.540882 Oct 04 21:04:37.125643 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1002/1999] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:04:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 3560 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:05:00.234852 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:00.263929 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-df7aab49-d02f-41ac-8aa1-4aa6d01ccda7 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Calling method '.version_select at 0x7f77eec97ca0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:00.655917 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-df7aab49-d02f-41ac-8aa1-4aa6d01ccda7 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-954964540" status: 202 len: 0 microversion: 2.1 time: 0.435294 Oct 04 21:05:00.661370 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 998/2000] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Oct 4 21:05:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-954964540 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:05:00.699943 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-9b2731ae-406f-4893-a484-5e255cd2c9f6 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Action: 'create', calling method: .version_select at 0x7f77eead6430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1406504571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID/niNd+ZWrGYipDXTX51yYfb1Zty7pZYEmXqQpLlL+KNiLT9Jf5Aa50632Lh8OUr6nEuX11qwC19TJ+q/ZaGyxuhiicB+ttpj8Ee+cpu/FnroX88i5DUItGHTK+K74Aw=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:00.741877 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:00.820701 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-9b2731ae-406f-4893-a484-5e255cd2c9f6 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Getting quotas for project 2f27496d38be44c29c3cd5bc4ae008d8. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:05:00.855822 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-9b2731ae-406f-4893-a484-5e255cd2c9f6 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Getting quotas for user 626d1f96e801458eba55b56ff8fb3672 and project 2f27496d38be44c29c3cd5bc4ae008d8. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:05:01.152869 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-9b2731ae-406f-4893-a484-5e255cd2c9f6 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.458798 Oct 04 21:05:01.155020 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1003/2001] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:05:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:37.595687 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:38.554996 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d49b255e-92d1-4c3f-8ec6-79789993a902 tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] Action: 'create', calling method: .version_select at 0x7f77ef28c040>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1622478477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqfTfp2rrAFnnRLbg8x3LGeZ7r+K8HYanYLp8cdcY6PNVqGiaWw/NHLRqEM0V7NSaFL6N8QpHIihUBfPCUVRWgTN3x0brO2nFWDzjSjukT7fD2G33ks5vRmxlDQQg3Z2A=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:38.639574 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-d49b255e-92d1-4c3f-8ec6-79789993a902 tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] Getting quotas for project 42290e303c56447082419baf9e037472. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:05:38.669820 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-d49b255e-92d1-4c3f-8ec6-79789993a902 tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] Getting quotas for user 8784a9c574a34c7dad4d96760dad1c7f and project 42290e303c56447082419baf9e037472. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:05:38.861657 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d49b255e-92d1-4c3f-8ec6-79789993a902 tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.276263 Oct 04 21:05:38.863849 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 999/2002] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:05:37 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:49.101784 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:49.109672 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-06dceed1-8c54-4937-b57a-4eff90c2b8a8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1378580523", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0174c07f-0690-4847-842d-3c215843c7b7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1406504571", "security_groups": [{"name": "tempest-secgroup-smoke-498437900"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:49.877498 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-06dceed1-8c54-4937-b57a-4eff90c2b8a8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] validate_networks() for [('0174c07f-0690-4847-842d-3c215843c7b7', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:05:50.563813 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1843179884", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:50.612542 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:50.616299 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:50.728332 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-06dceed1-8c54-4937-b57a-4eff90c2b8a8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2eb6d597-8909-468c-8410-07b3f60cf282) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:05:51.010957 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2eb6d597-8909-468c-8410-07b3f60cf282) Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-06dceed1-8c54-4937-b57a-4eff90c2b8a8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:05:51.019525 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-06dceed1-8c54-4937-b57a-4eff90c2b8a8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Request method failure captured: Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 344 Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ9T7iZn6NtiviFSPRDxz-SEHKk_Q5hiVpwMr4x1Nr0KssspAFHrvzLuiEwNqpgfVhrnwaXGRFKLVSlheR7oAD2dXYG7Fxw_9vYSEfA1gq4w2-xlqdvmHX1pVBYqp9e_b_gi2frhcP_yLqMmQexgSBVpkUZELVAIHFJZbB7aqeMZ7FQ Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 2f27496d38be44c29c3cd5bc4ae008d8 Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1969028259 Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2f27496d38be44c29c3cd5bc4ae008d8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2f27496d38be44c29c3cd5bc4ae008d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2f27496d38be44c29c3cd5bc4ae008d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2f27496d38be44c29c3cd5bc4ae008d8"}]}] Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1969028259 Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 2f27496d38be44c29c3cd5bc4ae008d8 Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1969028259 Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestNetworkAdvancedServerOps-1969028259-project Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 626d1f96e801458eba55b56ff8fb3672 Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1969028259-project Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1378580523", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "0174c07f-0690-4847-842d-3c215843c7b7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1406504571", "security_groups": [{"name": "tempest-secgroup-smoke-498437900"}]}} Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1378580523', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '0174c07f-0690-4847-842d-3c215843c7b7'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1406504571', 'security_groups': [{'name': 'tempest-secgroup-smoke-498437900'}]}}} Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:05:51.028110 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2eb6d597-8909-468c-8410-07b3f60cf282) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:51.051863 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-06dceed1-8c54-4937-b57a-4eff90c2b8a8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-06dceed1-8c54-4937-b57a-4eff90c2b8a8 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.947731 Oct 04 21:05:51.059078 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1004/2003] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:49 2022] POST /compute/v2.1/servers => generated 214 bytes in 1951 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:05:52.755987 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:05:52.760109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:05:52.762204 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:05:52.763792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:05:52.768504 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:05:52.795535 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:52.796671 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:52.799024 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:52.802113 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:52.807419 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:52.807419 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:52.898703 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Getting quotas for project f1825a1177a04e78bd4d42c9ab83c051. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:05:52.924330 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Getting quotas for user 77c793eaa0c14d9886a6a8f2e721cf9e and project f1825a1177a04e78bd4d42c9ab83c051. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:05:53.013300 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Going to run 1 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:05:53.028060 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:05:53.434957 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-28f80ff1-a5e7-4811-8155-d1aaccdbb638 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.876024 Oct 04 21:05:53.434957 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1000/2004] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:05:53.481784 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2e0771eb-53a0-45fb-b122-c6a940f18e70 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:53.492799 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2e0771eb-53a0-45fb-b122-c6a940f18e70 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:54.084215 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-2e0771eb-53a0-45fb-b122-c6a940f18e70 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:54.164535 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2e0771eb-53a0-45fb-b122-c6a940f18e70 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1214 microversion: 2.1 time: 0.702379 Oct 04 21:05:54.166263 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1005/2005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:53 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1214 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:55.227113 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-887d929d-530c-46be-aeb5-9d5520216faf tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:55.228388 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-887d929d-530c-46be-aeb5-9d5520216faf tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:55.623796 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-887d929d-530c-46be-aeb5-9d5520216faf tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:55.653426 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-887d929d-530c-46be-aeb5-9d5520216faf tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1214 microversion: 2.1 time: 0.446794 Oct 04 21:05:55.661904 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1001/2006] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:55 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1214 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:56.718370 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a4661278-717d-4eea-8902-deccaa6b7587 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:56.725528 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a4661278-717d-4eea-8902-deccaa6b7587 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:57.429892 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a4661278-717d-4eea-8902-deccaa6b7587 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:57.444415 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a4661278-717d-4eea-8902-deccaa6b7587 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1214 microversion: 2.1 time: 0.741119 Oct 04 21:05:57.445967 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1006/2007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:56 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1214 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:58.504903 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c00a32ed-d315-4c10-9fa6-e149acb325b9 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:58.513294 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-c00a32ed-d315-4c10-9fa6-e149acb325b9 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:58.768321 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-c00a32ed-d315-4c10-9fa6-e149acb325b9 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:58.801105 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c00a32ed-d315-4c10-9fa6-e149acb325b9 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1214 microversion: 2.1 time: 0.304870 Oct 04 21:05:58.805937 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1002/2008] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:58 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1214 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:59.842042 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3b6e06a8-6ccd-48d5-a99d-0c96e235b4d1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:59.844347 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-3b6e06a8-6ccd-48d5-a99d-0c96e235b4d1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:59.859349 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3b6e06a8-6ccd-48d5-a99d-0c96e235b4d1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:59.861476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3b6e06a8-6ccd-48d5-a99d-0c96e235b4d1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:59.863317 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3b6e06a8-6ccd-48d5-a99d-0c96e235b4d1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:59.865135 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3b6e06a8-6ccd-48d5-a99d-0c96e235b4d1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:59.866389 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3b6e06a8-6ccd-48d5-a99d-0c96e235b4d1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:59.867517 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-3b6e06a8-6ccd-48d5-a99d-0c96e235b4d1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:00.164577 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-3b6e06a8-6ccd-48d5-a99d-0c96e235b4d1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:00.179094 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3b6e06a8-6ccd-48d5-a99d-0c96e235b4d1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1218 microversion: 2.1 time: 0.344500 Oct 04 21:06:00.181287 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1007/2009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:59 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1218 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:01.225497 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e6df4096-6f2b-4e34-a502-41d508bd88ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:01.229537 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e6df4096-6f2b-4e34-a502-41d508bd88ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:01.265573 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e6df4096-6f2b-4e34-a502-41d508bd88ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:01.268366 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e6df4096-6f2b-4e34-a502-41d508bd88ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:01.270316 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e6df4096-6f2b-4e34-a502-41d508bd88ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:01.278190 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e6df4096-6f2b-4e34-a502-41d508bd88ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:01.281070 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e6df4096-6f2b-4e34-a502-41d508bd88ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:01.287449 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e6df4096-6f2b-4e34-a502-41d508bd88ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:01.803268 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e6df4096-6f2b-4e34-a502-41d508bd88ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:01.834291 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e6df4096-6f2b-4e34-a502-41d508bd88ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1210 microversion: 2.1 time: 0.618301 Oct 04 21:06:01.863013 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1003/2010] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:01 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1210 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:02.910042 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-08edb389-ce8a-456b-a349-bb0ed1bf5b06 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:02.911380 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-08edb389-ce8a-456b-a349-bb0ed1bf5b06 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:02.947045 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08edb389-ce8a-456b-a349-bb0ed1bf5b06 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.947993 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08edb389-ce8a-456b-a349-bb0ed1bf5b06 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.948795 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08edb389-ce8a-456b-a349-bb0ed1bf5b06 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.950155 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08edb389-ce8a-456b-a349-bb0ed1bf5b06 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.966073 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08edb389-ce8a-456b-a349-bb0ed1bf5b06 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.967534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-08edb389-ce8a-456b-a349-bb0ed1bf5b06 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:03.376718 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-08edb389-ce8a-456b-a349-bb0ed1bf5b06 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:03.414912 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-08edb389-ce8a-456b-a349-bb0ed1bf5b06 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1266 microversion: 2.1 time: 0.505417 Oct 04 21:06:03.431494 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1008/2011] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:02 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1266 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:04.476299 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e611c43d-1b98-452f-9297-234d7844d187 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:04.482912 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e611c43d-1b98-452f-9297-234d7844d187 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:04.497700 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:04.547737 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e611c43d-1b98-452f-9297-234d7844d187 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:04.549668 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e611c43d-1b98-452f-9297-234d7844d187 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:04.550789 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e611c43d-1b98-452f-9297-234d7844d187 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:04.552930 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e611c43d-1b98-452f-9297-234d7844d187 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:04.556342 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e611c43d-1b98-452f-9297-234d7844d187 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:04.557532 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e611c43d-1b98-452f-9297-234d7844d187 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:05.026990 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e611c43d-1b98-452f-9297-234d7844d187 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:05.084148 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e611c43d-1b98-452f-9297-234d7844d187 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1284 microversion: 2.1 time: 0.595734 Oct 04 21:06:05.084148 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1004/2012] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:04 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1284 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:06.160610 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7cca6698-0fea-42a9-8997-54206f928c2e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.178463 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7cca6698-0fea-42a9-8997-54206f928c2e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:06.212532 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cca6698-0fea-42a9-8997-54206f928c2e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.213759 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cca6698-0fea-42a9-8997-54206f928c2e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.214804 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cca6698-0fea-42a9-8997-54206f928c2e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.216260 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cca6698-0fea-42a9-8997-54206f928c2e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.220150 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cca6698-0fea-42a9-8997-54206f928c2e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.221342 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7cca6698-0fea-42a9-8997-54206f928c2e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.732260 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7cca6698-0fea-42a9-8997-54206f928c2e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:06.777916 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7cca6698-0fea-42a9-8997-54206f928c2e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1272 microversion: 2.1 time: 0.656667 Oct 04 21:06:06.796255 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1009/2013] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:06 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1272 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:07.844391 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1f9f19d2-0171-4eda-ad88-1baafa130416 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:07.849414 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-1f9f19d2-0171-4eda-ad88-1baafa130416 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:07.901917 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f9f19d2-0171-4eda-ad88-1baafa130416 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:07.901917 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f9f19d2-0171-4eda-ad88-1baafa130416 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:07.921838 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f9f19d2-0171-4eda-ad88-1baafa130416 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:07.924786 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f9f19d2-0171-4eda-ad88-1baafa130416 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:07.931222 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f9f19d2-0171-4eda-ad88-1baafa130416 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:07.944241 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-1f9f19d2-0171-4eda-ad88-1baafa130416 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:08.553839 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-1f9f19d2-0171-4eda-ad88-1baafa130416 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:08.636563 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1f9f19d2-0171-4eda-ad88-1baafa130416 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1272 microversion: 2.1 time: 0.816176 Oct 04 21:06:08.647700 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1005/2014] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:07 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1272 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:09.708762 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1f0a0f25-01f0-4252-b3df-a3045fb8be85 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:09.710441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-1f0a0f25-01f0-4252-b3df-a3045fb8be85 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:09.722950 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:09.748488 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1f0a0f25-01f0-4252-b3df-a3045fb8be85 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.749125 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1f0a0f25-01f0-4252-b3df-a3045fb8be85 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.749934 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1f0a0f25-01f0-4252-b3df-a3045fb8be85 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.750754 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1f0a0f25-01f0-4252-b3df-a3045fb8be85 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.751394 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1f0a0f25-01f0-4252-b3df-a3045fb8be85 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.751946 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1f0a0f25-01f0-4252-b3df-a3045fb8be85 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:10.170654 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-1f0a0f25-01f0-4252-b3df-a3045fb8be85 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:10.193188 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1f0a0f25-01f0-4252-b3df-a3045fb8be85 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1272 microversion: 2.1 time: 0.493290 Oct 04 21:06:10.211069 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1010/2015] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:09 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1272 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:11.256352 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-915b2a73-c967-486a-9a4a-38eed207f1ac tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:11.265781 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-915b2a73-c967-486a-9a4a-38eed207f1ac tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:11.297712 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=10 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:11.344882 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-915b2a73-c967-486a-9a4a-38eed207f1ac tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:11.356667 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-915b2a73-c967-486a-9a4a-38eed207f1ac tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:11.360964 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-915b2a73-c967-486a-9a4a-38eed207f1ac tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.364922 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-915b2a73-c967-486a-9a4a-38eed207f1ac tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:11.371915 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-915b2a73-c967-486a-9a4a-38eed207f1ac tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:11.374350 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-915b2a73-c967-486a-9a4a-38eed207f1ac tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.732695 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-915b2a73-c967-486a-9a4a-38eed207f1ac tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:11.771253 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-915b2a73-c967-486a-9a4a-38eed207f1ac tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1272 microversion: 2.1 time: 0.527503 Oct 04 21:06:11.772826 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1006/2016] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:11 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1272 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:12.830226 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f5f185f9-18d7-4c90-97b7-17ca6993427e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:12.833595 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f5f185f9-18d7-4c90-97b7-17ca6993427e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:12.846295 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f5f185f9-18d7-4c90-97b7-17ca6993427e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.850228 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f5f185f9-18d7-4c90-97b7-17ca6993427e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.850228 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f5f185f9-18d7-4c90-97b7-17ca6993427e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.850228 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f5f185f9-18d7-4c90-97b7-17ca6993427e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.851203 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f5f185f9-18d7-4c90-97b7-17ca6993427e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.852770 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f5f185f9-18d7-4c90-97b7-17ca6993427e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:13.074267 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f5f185f9-18d7-4c90-97b7-17ca6993427e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:13.110290 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f5f185f9-18d7-4c90-97b7-17ca6993427e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1272 microversion: 2.1 time: 0.289969 Oct 04 21:06:13.111245 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1011/2017] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:12 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1272 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:14.162599 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3c07ad12-d8aa-4032-ac0c-83d9ae3969f3 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:14.163600 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-3c07ad12-d8aa-4032-ac0c-83d9ae3969f3 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:14.193728 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c07ad12-d8aa-4032-ac0c-83d9ae3969f3 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:14.199210 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c07ad12-d8aa-4032-ac0c-83d9ae3969f3 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:14.203912 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c07ad12-d8aa-4032-ac0c-83d9ae3969f3 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:14.203912 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c07ad12-d8aa-4032-ac0c-83d9ae3969f3 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:14.205050 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c07ad12-d8aa-4032-ac0c-83d9ae3969f3 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:14.206339 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3c07ad12-d8aa-4032-ac0c-83d9ae3969f3 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.031907 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-3c07ad12-d8aa-4032-ac0c-83d9ae3969f3 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:15.074332 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3c07ad12-d8aa-4032-ac0c-83d9ae3969f3 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 0.920282 Oct 04 21:06:15.076722 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1007/2018] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:14 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:16.141227 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bd3c2ead-54dc-4b8e-aefa-a7644663cd91 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:16.144289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-bd3c2ead-54dc-4b8e-aefa-a7644663cd91 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:16.163450 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:06:16.165738 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:06:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 (ip 10.222.0.78) !!! Oct 04 21:06:16.178843 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:06:16.186171 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:06:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 (ip 10.222.0.78) !!! Oct 04 21:06:16.196931 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd3c2ead-54dc-4b8e-aefa-a7644663cd91 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:16.198404 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd3c2ead-54dc-4b8e-aefa-a7644663cd91 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:16.199546 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd3c2ead-54dc-4b8e-aefa-a7644663cd91 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:16.201812 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd3c2ead-54dc-4b8e-aefa-a7644663cd91 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:16.203051 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd3c2ead-54dc-4b8e-aefa-a7644663cd91 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:16.204152 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-bd3c2ead-54dc-4b8e-aefa-a7644663cd91 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:18.566234 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-bd3c2ead-54dc-4b8e-aefa-a7644663cd91 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:18.618365 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bd3c2ead-54dc-4b8e-aefa-a7644663cd91 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 2.497465 Oct 04 21:06:18.624112 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1012/2019] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:16 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 2505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:19.672317 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-30b38db2-6c62-465e-943a-88bd818d50c7 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:19.690673 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-30b38db2-6c62-465e-943a-88bd818d50c7 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:19.737129 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-30b38db2-6c62-465e-943a-88bd818d50c7 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:19.743923 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-30b38db2-6c62-465e-943a-88bd818d50c7 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:19.750211 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-30b38db2-6c62-465e-943a-88bd818d50c7 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:19.755963 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-30b38db2-6c62-465e-943a-88bd818d50c7 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:19.760458 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-30b38db2-6c62-465e-943a-88bd818d50c7 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:19.765779 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-30b38db2-6c62-465e-943a-88bd818d50c7 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:21.028276 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-30b38db2-6c62-465e-943a-88bd818d50c7 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:21.070499 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=37 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:21.106200 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-30b38db2-6c62-465e-943a-88bd818d50c7 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 1.446200 Oct 04 21:06:21.114271 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1008/2020] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:19 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:22.164182 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-87f21bd9-29aa-4f7f-984c-40ef185e5a76 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:22.171270 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-87f21bd9-29aa-4f7f-984c-40ef185e5a76 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:22.186258 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:22.209629 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87f21bd9-29aa-4f7f-984c-40ef185e5a76 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:22.231098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87f21bd9-29aa-4f7f-984c-40ef185e5a76 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:22.231098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87f21bd9-29aa-4f7f-984c-40ef185e5a76 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:22.231098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87f21bd9-29aa-4f7f-984c-40ef185e5a76 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:22.231098 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87f21bd9-29aa-4f7f-984c-40ef185e5a76 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:22.232647 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87f21bd9-29aa-4f7f-984c-40ef185e5a76 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:22.965214 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-87f21bd9-29aa-4f7f-984c-40ef185e5a76 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:22.996772 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-87f21bd9-29aa-4f7f-984c-40ef185e5a76 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 0.843374 Oct 04 21:06:23.013183 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1013/2021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:22 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:23.765743 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c36df0b1-3b58-4afd-b28f-d6a692d3d0d9 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Calling method '.version_select at 0x7f77eeb368b0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:24.068576 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c36df0b1-3b58-4afd-b28f-d6a692d3d0d9 tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1406504571" status: 202 len: 0 microversion: 2.1 time: 0.313621 Oct 04 21:06:24.085267 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1014/2022] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Oct 4 21:06:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1406504571 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:06:24.099566 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ef9a00c5-c70e-4648-a194-2f45fd6725f5 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:24.101362 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ef9a00c5-c70e-4648-a194-2f45fd6725f5 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:24.125534 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ef9a00c5-c70e-4648-a194-2f45fd6725f5 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.130591 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ef9a00c5-c70e-4648-a194-2f45fd6725f5 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.132319 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ef9a00c5-c70e-4648-a194-2f45fd6725f5 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.134104 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ef9a00c5-c70e-4648-a194-2f45fd6725f5 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.135345 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ef9a00c5-c70e-4648-a194-2f45fd6725f5 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.136711 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ef9a00c5-c70e-4648-a194-2f45fd6725f5 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.438524 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-97c29aef-6959-4e12-a5c7-3629bc06caaa req-ce3f2966-84eb-435c-8256-5b0b5e005099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5caffef-3784-4343-9a47-bb934f2b2214", "tag": "1c154906-993f-4652-add1-a70d59e80af4"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:24.464980 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:24.517823 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-97c29aef-6959-4e12-a5c7-3629bc06caaa req-ce3f2966-84eb-435c-8256-5b0b5e005099 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.524086 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-97c29aef-6959-4e12-a5c7-3629bc06caaa req-ce3f2966-84eb-435c-8256-5b0b5e005099 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.524870 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-97c29aef-6959-4e12-a5c7-3629bc06caaa req-ce3f2966-84eb-435c-8256-5b0b5e005099 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.623288 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-97c29aef-6959-4e12-a5c7-3629bc06caaa req-ce3f2966-84eb-435c-8256-5b0b5e005099 service nova] Creating event network-changed:1c154906-993f-4652-add1-a70d59e80af4 for instance e5caffef-3784-4343-9a47-bb934f2b2214 on n-h1-852085-12 Oct 04 21:06:24.644929 n-d-852085-12 devstack@n-api.service[123540]: ERROR oslo.messaging._drivers.impl_rabbit [req-97c29aef-6959-4e12-a5c7-3629bc06caaa req-ce3f2966-84eb-435c-8256-5b0b5e005099 service nova] [ae17015a-107b-41c6-aa6b-06f867a0bc32] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:06:25.658887 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [req-97c29aef-6959-4e12-a5c7-3629bc06caaa req-ce3f2966-84eb-435c-8256-5b0b5e005099 service nova] [ae17015a-107b-41c6-aa6b-06f867a0bc32] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 37432. Oct 04 21:06:25.667026 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-97c29aef-6959-4e12-a5c7-3629bc06caaa req-ce3f2966-84eb-435c-8256-5b0b5e005099 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 2.204853 Oct 04 21:06:25.677189 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1009/2023] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:25.717714 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-1f3df104-a220-40f8-8aaa-1429570e938b tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Action: 'create', calling method: .version_select at 0x7f77ef2094c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-825189224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKlwvl1og7OKQnI0IvuRA87Lxi3hy8lstQ4CYVj6aIsclDb56dAyKOql1XWbVtadULXxEKPz6MKAPOfK2562kLQsMqhw12c2IoxEI9FJ9tbab9KRvej2afMtyH229zkog=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:25.737840 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ef9a00c5-c70e-4648-a194-2f45fd6725f5 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:25.763778 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ef9a00c5-c70e-4648-a194-2f45fd6725f5 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 1.675610 Oct 04 21:06:25.768863 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1015/2024] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:24 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:25.858906 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-1f3df104-a220-40f8-8aaa-1429570e938b tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Getting quotas for project 2f27496d38be44c29c3cd5bc4ae008d8. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:06:25.898578 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-1f3df104-a220-40f8-8aaa-1429570e938b tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Getting quotas for user 626d1f96e801458eba55b56ff8fb3672 and project 2f27496d38be44c29c3cd5bc4ae008d8. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:06:26.127412 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-1f3df104-a220-40f8-8aaa-1429570e938b tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.446418 Oct 04 21:06:26.129739 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1010/2025] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:06:25 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:26.824141 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8ce71b64-a5d2-4f69-b405-b53b640cc935 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:26.831960 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8ce71b64-a5d2-4f69-b405-b53b640cc935 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:26.869792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8ce71b64-a5d2-4f69-b405-b53b640cc935 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:26.873492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8ce71b64-a5d2-4f69-b405-b53b640cc935 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:26.875204 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8ce71b64-a5d2-4f69-b405-b53b640cc935 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:26.879531 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8ce71b64-a5d2-4f69-b405-b53b640cc935 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:26.886645 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8ce71b64-a5d2-4f69-b405-b53b640cc935 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:26.886645 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8ce71b64-a5d2-4f69-b405-b53b640cc935 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:27.489105 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6f47ea9a-5a00-4ab1-b1a6-5b5f55d64e78 tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-2078502807-access_point-874366685", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "8f1fda65-0ab5-4b30-9102-f4b35461052c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1622478477", "security_groups": [{"name": "tempest-secgroup_access--1471753423"}, {"name": "tempest-secgroup_general--1911175366"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:29.052780 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8ce71b64-a5d2-4f69-b405-b53b640cc935 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:29.111589 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8ce71b64-a5d2-4f69-b405-b53b640cc935 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 2.298997 Oct 04 21:06:29.123434 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1016/2026] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:26 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:29.213055 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-6f47ea9a-5a00-4ab1-b1a6-5b5f55d64e78 tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] validate_networks() for [('8f1fda65-0ab5-4b30-9102-f4b35461052c', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:06:30.221478 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-87ae145e-dc0a-490c-b0c0-9caee5ea3bf2 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:30.225168 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-87ae145e-dc0a-490c-b0c0-9caee5ea3bf2 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:30.278155 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87ae145e-dc0a-490c-b0c0-9caee5ea3bf2 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:30.278155 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87ae145e-dc0a-490c-b0c0-9caee5ea3bf2 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:30.278155 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87ae145e-dc0a-490c-b0c0-9caee5ea3bf2 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:30.288240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87ae145e-dc0a-490c-b0c0-9caee5ea3bf2 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:30.296259 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87ae145e-dc0a-490c-b0c0-9caee5ea3bf2 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:30.312409 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87ae145e-dc0a-490c-b0c0-9caee5ea3bf2 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-6f47ea9a-5a00-4ab1-b1a6-5b5f55d64e78 tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-96154fdc-ee12-4961-abe8-40791b6ca6d2) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:06:30.351082 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-96154fdc-ee12-4961-abe8-40791b6ca6d2) Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-6f47ea9a-5a00-4ab1-b1a6-5b5f55d64e78 tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:06:30.357561 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6f47ea9a-5a00-4ab1-b1a6-5b5f55d64e78 tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] Request method failure captured: Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 470 Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKAaTF-MuIaXDxtbxsRsWoi0rYLn2nFF4y7URi-E2XGF3e13meZfdsbPLdjiV3dFah-EHeB5_PdbAsRUv9vPEOIt6oolDBMIhIlHmhyMRjkOv6ZhzvImjgvXvaSIAK5Uqd9YN462sBPVKd8OizWviU3rywUg-NKxlY2pX_yfV-DRBRM Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 42290e303c56447082419baf9e037472 Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-2078502807 Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_42290e303c56447082419baf9e037472", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/42290e303c56447082419baf9e037472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/42290e303c56447082419baf9e037472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/42290e303c56447082419baf9e037472"}]}] Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestSecurityGroupsBasicOps-2078502807 Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 42290e303c56447082419baf9e037472 Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-2078502807 Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestSecurityGroupsBasicOps-2078502807-project Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 8784a9c574a34c7dad4d96760dad1c7f Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestSecurityGroupsBasicOps-2078502807-project Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-2078502807-access_point-874366685", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "8f1fda65-0ab5-4b30-9102-f4b35461052c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1622478477", "security_groups": [{"name": "tempest-secgroup_access--1471753423"}, {"name": "tempest-secgroup_general--1911175366"}]}, "os:scheduler_hints": {"different_host": []}} Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-server-tempest-TestSecurityGroupsBasicOps-2078502807-access_point-874366685', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '8f1fda65-0ab5-4b30-9102-f4b35461052c'}], 'key_name': 'tempest-TestSecurityGroupsBasicOps-1622478477', 'security_groups': [{'name': 'tempest-secgroup_access--1471753423'}, {'name': 'tempest-secgroup_general--1911175366'}]}, 'os:scheduler_hints': {'different_host': []}}} Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:06:30.371935 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-96154fdc-ee12-4961-abe8-40791b6ca6d2) Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:30.385657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6f47ea9a-5a00-4ab1-b1a6-5b5f55d64e78 tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6f47ea9a-5a00-4ab1-b1a6-5b5f55d64e78 tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.885996 Oct 04 21:06:30.415685 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1011/2027] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:06:27 2022] POST /compute/v2.1/servers => generated 214 bytes in 2889 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 21:06:30.476777 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=55 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:31.059566 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-87ae145e-dc0a-490c-b0c0-9caee5ea3bf2 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:31.134952 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-87ae145e-dc0a-490c-b0c0-9caee5ea3bf2 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 0.948917 Oct 04 21:06:31.168392 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1017/2028] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:30 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:32.208339 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-01b6f75c-cb3b-42f9-83ed-e9b972b5c42e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:32.213997 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-01b6f75c-cb3b-42f9-83ed-e9b972b5c42e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:32.255662 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-01b6f75c-cb3b-42f9-83ed-e9b972b5c42e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:32.258425 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-01b6f75c-cb3b-42f9-83ed-e9b972b5c42e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:32.259792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-01b6f75c-cb3b-42f9-83ed-e9b972b5c42e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:32.262993 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-01b6f75c-cb3b-42f9-83ed-e9b972b5c42e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:32.268687 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-01b6f75c-cb3b-42f9-83ed-e9b972b5c42e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:32.270070 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-01b6f75c-cb3b-42f9-83ed-e9b972b5c42e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.742676 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-01b6f75c-cb3b-42f9-83ed-e9b972b5c42e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:33.776743 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-01b6f75c-cb3b-42f9-83ed-e9b972b5c42e tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 1.592845 Oct 04 21:06:33.790844 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1012/2029] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:32 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:34.835754 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c47b6753-0d65-4b0a-ac31-69030b38ba12 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:34.845161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-c47b6753-0d65-4b0a-ac31-69030b38ba12 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:34.904156 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c47b6753-0d65-4b0a-ac31-69030b38ba12 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:34.905082 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c47b6753-0d65-4b0a-ac31-69030b38ba12 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:34.906163 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c47b6753-0d65-4b0a-ac31-69030b38ba12 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:34.930021 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c47b6753-0d65-4b0a-ac31-69030b38ba12 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:34.931113 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c47b6753-0d65-4b0a-ac31-69030b38ba12 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:34.932307 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-c47b6753-0d65-4b0a-ac31-69030b38ba12 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:36.966308 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-c47b6753-0d65-4b0a-ac31-69030b38ba12 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:37.027721 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c47b6753-0d65-4b0a-ac31-69030b38ba12 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 2.200826 Oct 04 21:06:37.039219 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1018/2030] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:34 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:38.077876 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6579d303-f926-4d76-b9ca-278867a4ede8 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:38.078888 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-6579d303-f926-4d76-b9ca-278867a4ede8 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:38.093847 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:38.101182 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6579d303-f926-4d76-b9ca-278867a4ede8 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:38.148300 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6579d303-f926-4d76-b9ca-278867a4ede8 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:38.149127 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6579d303-f926-4d76-b9ca-278867a4ede8 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.047s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:38.150577 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6579d303-f926-4d76-b9ca-278867a4ede8 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:38.151598 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6579d303-f926-4d76-b9ca-278867a4ede8 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:38.152361 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6579d303-f926-4d76-b9ca-278867a4ede8 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:39.416094 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-6579d303-f926-4d76-b9ca-278867a4ede8 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:39.445868 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6579d303-f926-4d76-b9ca-278867a4ede8 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 1.375027 Oct 04 21:06:39.471735 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1013/2031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:38 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:40.487818 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5d818de1-4a98-44a8-bd9b-bba4a56299f0 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:40.489381 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-5d818de1-4a98-44a8-bd9b-bba4a56299f0 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:40.540043 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5d818de1-4a98-44a8-bd9b-bba4a56299f0 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:40.541286 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5d818de1-4a98-44a8-bd9b-bba4a56299f0 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:40.542107 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5d818de1-4a98-44a8-bd9b-bba4a56299f0 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:40.543532 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5d818de1-4a98-44a8-bd9b-bba4a56299f0 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:40.544393 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5d818de1-4a98-44a8-bd9b-bba4a56299f0 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:40.545168 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5d818de1-4a98-44a8-bd9b-bba4a56299f0 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:41.793504 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5d818de1-4a98-44a8-bd9b-bba4a56299f0 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:41.838893 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5d818de1-4a98-44a8-bd9b-bba4a56299f0 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 1.352695 Oct 04 21:06:41.855126 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1019/2032] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:40 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:42.125634 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-dda5ec03-0747-472c-913c-c30868d2e976 req-0a02fce8-0dc2-41e8-9356-9ecd2090fb41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5caffef-3784-4343-9a47-bb934f2b2214", "name": "network-vif-plugged", "status": "completed", "tag": "1c154906-993f-4652-add1-a70d59e80af4"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:42.174610 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-dda5ec03-0747-472c-913c-c30868d2e976 req-0a02fce8-0dc2-41e8-9356-9ecd2090fb41 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:42.184880 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-dda5ec03-0747-472c-913c-c30868d2e976 req-0a02fce8-0dc2-41e8-9356-9ecd2090fb41 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:42.185714 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-dda5ec03-0747-472c-913c-c30868d2e976 req-0a02fce8-0dc2-41e8-9356-9ecd2090fb41 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:42.236704 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-dda5ec03-0747-472c-913c-c30868d2e976 req-0a02fce8-0dc2-41e8-9356-9ecd2090fb41 service nova] Creating event network-vif-plugged:1c154906-993f-4652-add1-a70d59e80af4 for instance e5caffef-3784-4343-9a47-bb934f2b2214 on n-h1-852085-12 Oct 04 21:06:42.258575 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-dda5ec03-0747-472c-913c-c30868d2e976 req-0a02fce8-0dc2-41e8-9356-9ecd2090fb41 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.665087 Oct 04 21:06:42.264550 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1014/2033] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:42.893568 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cbe22f51-2b48-4ebf-93a2-2059fe074d87 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:42.896871 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cbe22f51-2b48-4ebf-93a2-2059fe074d87 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:42.926436 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cbe22f51-2b48-4ebf-93a2-2059fe074d87 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:42.935543 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cbe22f51-2b48-4ebf-93a2-2059fe074d87 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:42.937400 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cbe22f51-2b48-4ebf-93a2-2059fe074d87 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:42.938772 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cbe22f51-2b48-4ebf-93a2-2059fe074d87 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:42.941466 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cbe22f51-2b48-4ebf-93a2-2059fe074d87 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:42.944618 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cbe22f51-2b48-4ebf-93a2-2059fe074d87 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:44.224886 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-cbe22f51-2b48-4ebf-93a2-2059fe074d87 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:44.315354 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cbe22f51-2b48-4ebf-93a2-2059fe074d87 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 1.430509 Oct 04 21:06:44.334902 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1020/2034] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:42 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:45.367808 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7e04552a-50c0-44ec-b43e-70d1acf8421c tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:45.371385 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7e04552a-50c0-44ec-b43e-70d1acf8421c tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:45.387880 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7e04552a-50c0-44ec-b43e-70d1acf8421c tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:45.389229 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7e04552a-50c0-44ec-b43e-70d1acf8421c tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:45.390813 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7e04552a-50c0-44ec-b43e-70d1acf8421c tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:45.393687 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7e04552a-50c0-44ec-b43e-70d1acf8421c tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:45.394641 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7e04552a-50c0-44ec-b43e-70d1acf8421c tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:45.395727 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7e04552a-50c0-44ec-b43e-70d1acf8421c tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:46.031528 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7e04552a-50c0-44ec-b43e-70d1acf8421c tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:46.057059 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7e04552a-50c0-44ec-b43e-70d1acf8421c tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 0.697820 Oct 04 21:06:46.094303 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1015/2035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:45 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:47.110133 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-628e02a2-29bb-48a6-9d0a-6ced8968e000 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:47.116806 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-628e02a2-29bb-48a6-9d0a-6ced8968e000 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:47.162238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-628e02a2-29bb-48a6-9d0a-6ced8968e000 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:47.162238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-628e02a2-29bb-48a6-9d0a-6ced8968e000 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:47.162238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-628e02a2-29bb-48a6-9d0a-6ced8968e000 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:47.162238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-628e02a2-29bb-48a6-9d0a-6ced8968e000 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:47.162238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-628e02a2-29bb-48a6-9d0a-6ced8968e000 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:47.162238 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-628e02a2-29bb-48a6-9d0a-6ced8968e000 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:50.057023 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-628e02a2-29bb-48a6-9d0a-6ced8968e000 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:50.096536 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-628e02a2-29bb-48a6-9d0a-6ced8968e000 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1314 microversion: 2.1 time: 3.000794 Oct 04 21:06:50.101075 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1021/2036] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:47 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1314 bytes in 3009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:51.154600 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f8010857-842e-424e-85de-ce80939cb66f tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:51.156915 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f8010857-842e-424e-85de-ce80939cb66f tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:51.215289 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8010857-842e-424e-85de-ce80939cb66f tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:51.222682 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8010857-842e-424e-85de-ce80939cb66f tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:51.227983 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8010857-842e-424e-85de-ce80939cb66f tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:51.229446 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8010857-842e-424e-85de-ce80939cb66f tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:51.232019 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8010857-842e-424e-85de-ce80939cb66f tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:51.258231 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f8010857-842e-424e-85de-ce80939cb66f tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.527203 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f8010857-842e-424e-85de-ce80939cb66f tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:53.543175 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=28 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:53.603159 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f8010857-842e-424e-85de-ce80939cb66f tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1462 microversion: 2.1 time: 2.459756 Oct 04 21:06:53.610811 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1016/2037] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:51 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1462 bytes in 2472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:53.659023 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-eb23c8b1-9a7c-416c-af51-da3bd6e6d9f6 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb41016e-cd2a-4575-b2cf-995a04d7b12f", "device": "/dev/sdb"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:53.666196 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-eb23c8b1-9a7c-416c-af51-da3bd6e6d9f6 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:53.672280 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:53.715503 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eb23c8b1-9a7c-416c-af51-da3bd6e6d9f6 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.716483 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eb23c8b1-9a7c-416c-af51-da3bd6e6d9f6 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.717210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eb23c8b1-9a7c-416c-af51-da3bd6e6d9f6 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.718652 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eb23c8b1-9a7c-416c-af51-da3bd6e6d9f6 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.719632 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eb23c8b1-9a7c-416c-af51-da3bd6e6d9f6 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.720393 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-eb23c8b1-9a7c-416c-af51-da3bd6e6d9f6 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:55.802214 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-eb23c8b1-9a7c-416c-af51-da3bd6e6d9f6 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "POST /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.150345 Oct 04 21:06:55.804884 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1022/2038] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Oct 4 21:06:53 2022] POST /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214/os-volume_attachments => generated 194 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:07:01.232467 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d4dd9d34-e600-40e3-8945-025f2991ce5d tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] Calling method '.version_select at 0x7f77ef28c700>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:01.297215 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:01.400229 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d4dd9d34-e600-40e3-8945-025f2991ce5d tempest-TestSecurityGroupsBasicOps-2078502807 tempest-TestSecurityGroupsBasicOps-2078502807-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1622478477" status: 202 len: 0 microversion: 2.1 time: 0.185131 Oct 04 21:07:01.402097 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1017/2039] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 4 21:07:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1622478477 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:07:20.022299 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:20.025525 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:20.746324 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f232ce3a-3d96-4a2e-a652-038027126efd tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1747736045", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "a474691d-037a-419a-8b70-0073c7bbfc01"}], "key_name": "tempest-TestNetworkAdvancedServerOps-825189224", "security_groups": [{"name": "tempest-secgroup-smoke-2100757578"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:21.686210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-f232ce3a-3d96-4a2e-a652-038027126efd tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] validate_networks() for [('a474691d-037a-419a-8b70-0073c7bbfc01', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-f232ce3a-3d96-4a2e-a652-038027126efd tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6d6138f2-73b5-4fcc-bbd7-a1a63497911b) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:07:23.439574 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6d6138f2-73b5-4fcc-bbd7-a1a63497911b) Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-f232ce3a-3d96-4a2e-a652-038027126efd tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:07:23.448020 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f232ce3a-3d96-4a2e-a652-038027126efd tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Request method failure captured: Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 344 Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPJ9T7iZn6NtiviFSPRDxz-SEHKk_Q5hiVpwMr4x1Nr0KssspAFHrvzLuiEwNqpgfVhrnwaXGRFKLVSlheR7oAD2dXYG7Fxw_9vYSEfA1gq4w2-xlqdvmHX1pVBYqp9e_b_gi2frhcP_yLqMmQexgSBVpkUZELVAIHFJZbB7aqeMZ7FQ Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 2f27496d38be44c29c3cd5bc4ae008d8 Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1969028259 Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2f27496d38be44c29c3cd5bc4ae008d8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2f27496d38be44c29c3cd5bc4ae008d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2f27496d38be44c29c3cd5bc4ae008d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2f27496d38be44c29c3cd5bc4ae008d8"}]}] Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1969028259 Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 2f27496d38be44c29c3cd5bc4ae008d8 Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1969028259 Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestNetworkAdvancedServerOps-1969028259-project Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 626d1f96e801458eba55b56ff8fb3672 Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1969028259-project Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1747736045", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "a474691d-037a-419a-8b70-0073c7bbfc01"}], "key_name": "tempest-TestNetworkAdvancedServerOps-825189224", "security_groups": [{"name": "tempest-secgroup-smoke-2100757578"}]}} Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1747736045', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'a474691d-037a-419a-8b70-0073c7bbfc01'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-825189224', 'security_groups': [{'name': 'tempest-secgroup-smoke-2100757578'}]}}} Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:07:23.453311 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6d6138f2-73b5-4fcc-bbd7-a1a63497911b) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:23.462170 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f232ce3a-3d96-4a2e-a652-038027126efd tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:23.473396 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f232ce3a-3d96-4a2e-a652-038027126efd tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.473620 Oct 04 21:07:23.485365 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1023/2040] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:19 2022] POST /compute/v2.1/servers => generated 214 bytes in 3494 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:07:46.542418 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4b1745ce-1f87-4af8-80d6-9aa31f78151e tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] Calling method '.version_select at 0x7f77f7331dc0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:46.621251 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:46.822174 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4b1745ce-1f87-4af8-80d6-9aa31f78151e tempest-TestNetworkAdvancedServerOps-1969028259 tempest-TestNetworkAdvancedServerOps-1969028259-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-825189224" status: 202 len: 0 microversion: 2.1 time: 0.292663 Oct 04 21:07:46.843101 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1018/2041] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Oct 4 21:07:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-825189224 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:08:17.911813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:18.556358 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-71f01cf2-a8d0-4a19-a9c0-e44c5fc33515 tempest-VolumesActionsTest-828316693 tempest-VolumesActionsTest-828316693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1208116277", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "e326a398-50f6-4558-9e2b-c19efe40e775"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:18.744049 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-71f01cf2-a8d0-4a19-a9c0-e44c5fc33515 tempest-VolumesActionsTest-828316693 tempest-VolumesActionsTest-828316693-project] validate_networks() for [('e326a398-50f6-4558-9e2b-c19efe40e775', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-71f01cf2-a8d0-4a19-a9c0-e44c5fc33515 tempest-VolumesActionsTest-828316693 tempest-VolumesActionsTest-828316693-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-49573964-61dc-4c62-b972-386b44476c5d) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:08:20.856481 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-49573964-61dc-4c62-b972-386b44476c5d) Oct 04 21:08:20.865444 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:08:20.871170 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-71f01cf2-a8d0-4a19-a9c0-e44c5fc33515 tempest-VolumesActionsTest-828316693 tempest-VolumesActionsTest-828316693-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:08:20.871170 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-71f01cf2-a8d0-4a19-a9c0-e44c5fc33515 tempest-VolumesActionsTest-828316693 tempest-VolumesActionsTest-828316693-project] Request method failure captured: Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 206 Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKC2wYagsBTnpvz4osH41CDk_koJ4Vsn2nt_7XZy6aoc9ZGLQGa0AybkqMFFL7UTEFERmaDIIh4mfwGqgykG46OfziLmjkfOdHB4OMqWqlLIPdTsG_IN-8_nILwAuRuzSelQvXT6VR5Uk_WKM2xFejBCkvoE7X9pdEmk6yCCTF-wKxc Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: c709d51ca1644fd088da2b983c59270f Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-VolumesActionsTest-828316693 Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c709d51ca1644fd088da2b983c59270f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c709d51ca1644fd088da2b983c59270f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c709d51ca1644fd088da2b983c59270f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c709d51ca1644fd088da2b983c59270f"}]}] Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-VolumesActionsTest-828316693 Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: c709d51ca1644fd088da2b983c59270f Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-VolumesActionsTest-828316693 Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-VolumesActionsTest-828316693-project Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 24457d9efc564d55b1f5cc583d280881 Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-VolumesActionsTest-828316693-project Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-VolumesActionsTest-instance-1208116277", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "e326a398-50f6-4558-9e2b-c19efe40e775"}]}} Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-1208116277', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'e326a398-50f6-4558-9e2b-c19efe40e775'}]}}} Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:08:20.886605 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-49573964-61dc-4c62-b972-386b44476c5d) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:08:20.894534 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-71f01cf2-a8d0-4a19-a9c0-e44c5fc33515 tempest-VolumesActionsTest-828316693 tempest-VolumesActionsTest-828316693-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:08:20.908595 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:20.925469 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-71f01cf2-a8d0-4a19-a9c0-e44c5fc33515 tempest-VolumesActionsTest-828316693 tempest-VolumesActionsTest-828316693-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.000022 Oct 04 21:08:20.927567 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1024/2042] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:17 2022] POST /compute/v2.1/servers => generated 214 bytes in 3029 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:11:32.802462 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:11:32.803754 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:11:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214/os-volume_attachments/eb41016e-cd2a-4575-b2cf-995a04d7b12f (ip 10.222.0.78) !!! Oct 04 21:11:32.806712 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:11:32.810073 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:11:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214/os-volume_attachments/eb41016e-cd2a-4575-b2cf-995a04d7b12f (ip 10.222.0.78) !!! Oct 04 21:11:32.813083 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:11:32.816047 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:11:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214/os-volume_attachments/eb41016e-cd2a-4575-b2cf-995a04d7b12f (ip 10.222.0.78) !!! Oct 04 21:11:32.840678 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d5065fdc-b0af-4232-96eb-725f53fb4da1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:32.842629 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-d5065fdc-b0af-4232-96eb-725f53fb4da1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:32.895920 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5065fdc-b0af-4232-96eb-725f53fb4da1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:32.901455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5065fdc-b0af-4232-96eb-725f53fb4da1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:32.901455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5065fdc-b0af-4232-96eb-725f53fb4da1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:32.901455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5065fdc-b0af-4232-96eb-725f53fb4da1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:32.901455 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5065fdc-b0af-4232-96eb-725f53fb4da1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:32.904525 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-d5065fdc-b0af-4232-96eb-725f53fb4da1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:34.727229 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-d5065fdc-b0af-4232-96eb-725f53fb4da1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lazy-loading 'services' on Instance uuid e5caffef-3784-4343-9a47-bb934f2b2214 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:35.478107 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d5065fdc-b0af-4232-96eb-725f53fb4da1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214/os-volume_attachments/eb41016e-cd2a-4575-b2cf-995a04d7b12f" status: 202 len: 0 microversion: 2.1 time: 2.677797 Oct 04 21:11:35.482298 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1019/2043] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Oct 4 21:11:32 2022] DELETE /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214/os-volume_attachments/eb41016e-cd2a-4575-b2cf-995a04d7b12f => generated 0 bytes in 2688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:11:54.292084 n-d-852085-12 devstack@n-api.service[123539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d5edc17b-4d95-44e5-91e5-59bc85f612b8] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:11:54.294269 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:54.296477 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:11:54.297056 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:11:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 (ip 10.222.0.78) !!! Oct 04 21:11:54.302196 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:11:54.303095 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:11:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 (ip 10.222.0.78) !!! Oct 04 21:11:54.304917 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:11:54.307415 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:11:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 (ip 10.222.0.78) !!! Oct 04 21:11:54.346577 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d53987d6-3f4a-47bc-8b38-abf20a9bb80b tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:54.356123 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d53987d6-3f4a-47bc-8b38-abf20a9bb80b tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:54.445077 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d53987d6-3f4a-47bc-8b38-abf20a9bb80b tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:54.445077 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d53987d6-3f4a-47bc-8b38-abf20a9bb80b tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:54.445077 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d53987d6-3f4a-47bc-8b38-abf20a9bb80b tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:54.449550 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d53987d6-3f4a-47bc-8b38-abf20a9bb80b tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:54.452578 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d53987d6-3f4a-47bc-8b38-abf20a9bb80b tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:54.455761 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d53987d6-3f4a-47bc-8b38-abf20a9bb80b tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:54.608549 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d53987d6-3f4a-47bc-8b38-abf20a9bb80b tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:11:55.307889 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] [d5edc17b-4d95-44e5-91e5-59bc85f612b8] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 42524. Oct 04 21:11:55.327457 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d53987d6-3f4a-47bc-8b38-abf20a9bb80b tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 204 len: 0 microversion: 2.1 time: 1.038725 Oct 04 21:11:55.351753 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1025/2044] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 21:11:54 2022] DELETE /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 0 bytes in 1064 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:11:55.373067 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-dff9c4de-e2dc-4cc3-b865-d42109ae66ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:55.376264 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-dff9c4de-e2dc-4cc3-b865-d42109ae66ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:55.409523 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:55.413470 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:55.424496 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dff9c4de-e2dc-4cc3-b865-d42109ae66ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:55.426773 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dff9c4de-e2dc-4cc3-b865-d42109ae66ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:55.430388 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dff9c4de-e2dc-4cc3-b865-d42109ae66ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:55.436797 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dff9c4de-e2dc-4cc3-b865-d42109ae66ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:55.440377 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dff9c4de-e2dc-4cc3-b865-d42109ae66ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:55.444777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-dff9c4de-e2dc-4cc3-b865-d42109ae66ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:56.933469 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-dff9c4de-e2dc-4cc3-b865-d42109ae66ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:56.967973 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-dff9c4de-e2dc-4cc3-b865-d42109ae66ed tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1468 microversion: 2.1 time: 1.608417 Oct 04 21:11:56.974893 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1020/2045] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:55 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1468 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:58.056160 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fb5ee1f8-dc00-4a3b-9272-ffd5cf93a964 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:58.060905 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-fb5ee1f8-dc00-4a3b-9272-ffd5cf93a964 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:58.112253 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fb5ee1f8-dc00-4a3b-9272-ffd5cf93a964 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:58.113223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fb5ee1f8-dc00-4a3b-9272-ffd5cf93a964 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:58.114055 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fb5ee1f8-dc00-4a3b-9272-ffd5cf93a964 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:58.119210 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fb5ee1f8-dc00-4a3b-9272-ffd5cf93a964 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:58.132453 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fb5ee1f8-dc00-4a3b-9272-ffd5cf93a964 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:58.134961 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fb5ee1f8-dc00-4a3b-9272-ffd5cf93a964 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:00.115162 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-fb5ee1f8-dc00-4a3b-9272-ffd5cf93a964 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:00.165797 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fb5ee1f8-dc00-4a3b-9272-ffd5cf93a964 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1468 microversion: 2.1 time: 2.150262 Oct 04 21:12:00.179230 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1026/2046] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:58 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1468 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:01.150978 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-bbc92f04-3ba3-40bd-8999-af7da8a9f8c8 req-48352473-19a2-462b-8e94-6cfc120f5057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5caffef-3784-4343-9a47-bb934f2b2214", "name": "network-vif-deleted", "tag": "1c154906-993f-4652-add1-a70d59e80af4"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:01.216307 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f0f68371-2f40-4e40-be29-dc7b66f1d2c1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:01.220684 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f0f68371-2f40-4e40-be29-dc7b66f1d2c1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:01.236395 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-bbc92f04-3ba3-40bd-8999-af7da8a9f8c8 req-48352473-19a2-462b-8e94-6cfc120f5057 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:01.237043 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-bbc92f04-3ba3-40bd-8999-af7da8a9f8c8 req-48352473-19a2-462b-8e94-6cfc120f5057 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:01.237892 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-bbc92f04-3ba3-40bd-8999-af7da8a9f8c8 req-48352473-19a2-462b-8e94-6cfc120f5057 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:01.266322 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f0f68371-2f40-4e40-be29-dc7b66f1d2c1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:01.267583 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f0f68371-2f40-4e40-be29-dc7b66f1d2c1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:01.268593 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f0f68371-2f40-4e40-be29-dc7b66f1d2c1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:01.270180 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f0f68371-2f40-4e40-be29-dc7b66f1d2c1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:01.271911 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f0f68371-2f40-4e40-be29-dc7b66f1d2c1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:01.276694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f0f68371-2f40-4e40-be29-dc7b66f1d2c1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:01.371348 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-bbc92f04-3ba3-40bd-8999-af7da8a9f8c8 req-48352473-19a2-462b-8e94-6cfc120f5057 service nova] Creating event network-vif-deleted:1c154906-993f-4652-add1-a70d59e80af4 for instance e5caffef-3784-4343-9a47-bb934f2b2214 on n-h1-852085-12 Oct 04 21:12:01.404029 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-bbc92f04-3ba3-40bd-8999-af7da8a9f8c8 req-48352473-19a2-462b-8e94-6cfc120f5057 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.679229 Oct 04 21:12:01.413637 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1021/2047] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:12:01.715922 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f0f68371-2f40-4e40-be29-dc7b66f1d2c1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:01.738906 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f0f68371-2f40-4e40-be29-dc7b66f1d2c1 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1299 microversion: 2.1 time: 0.527879 Oct 04 21:12:01.742628 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1027/2048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:01 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1299 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:02.797864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:02.801107 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:02.834545 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:02.839109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:02.839109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:02.839109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:02.852332 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:02.853813 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:03.034687 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:03.035870 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:03.037032 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:03.038093 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.instance [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lazy-loading 'fault' on Instance uuid e5caffef-3784-4343-9a47-bb934f2b2214 {{(pid=123540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:12:03.295017 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c793eaa0c14d9886a6a8f2e721cf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1825a1177a04e78bd4d42c9ab83c051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:03.328441 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6508f752-fa5c-4064-b651-dc5371c9f2d4 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 200 len: 1304 microversion: 2.1 time: 0.543589 Oct 04 21:12:03.343721 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1022/2049] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:02 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 1304 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:04.392363 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1c6cfe8b-9bfd-45ad-bf70-e055785b8c97 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:04.393605 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-1c6cfe8b-9bfd-45ad-bf70-e055785b8c97 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] [instance: e5caffef-3784-4343-9a47-bb934f2b2214] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:04.457189 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c6cfe8b-9bfd-45ad-bf70-e055785b8c97 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.458157 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c6cfe8b-9bfd-45ad-bf70-e055785b8c97 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.458939 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c6cfe8b-9bfd-45ad-bf70-e055785b8c97 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.488074 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c6cfe8b-9bfd-45ad-bf70-e055785b8c97 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.491535 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c6cfe8b-9bfd-45ad-bf70-e055785b8c97 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.514995 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-1c6cfe8b-9bfd-45ad-bf70-e055785b8c97 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.666169 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-1c6cfe8b-9bfd-45ad-bf70-e055785b8c97 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] HTTP exception thrown: Instance e5caffef-3784-4343-9a47-bb934f2b2214 could not be found. Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1c6cfe8b-9bfd-45ad-bf70-e055785b8c97 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Request method failure captured: Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: request: GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 HTTP/1.1 Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 0 Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKAlkhVC5n08ywIFtkjfln43mVOzerHIMFet1CZ__ZBnXkffiZjtqzQ5gkoapY_F_2seJpkM6Pi0YzukIdPBQLfGZAYg0fGXq08IdzmJJWlekhbDJpOSmczQi_B87fo9VjPxF9Gg8ve3oaPg37-LaJNFegnmpflasyznqJCgMZC075k Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: f1825a1177a04e78bd4d42c9ab83c051 Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-VolumesBackupsTest-153564717 Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f1825a1177a04e78bd4d42c9ab83c051", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1825a1177a04e78bd4d42c9ab83c051"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f1825a1177a04e78bd4d42c9ab83c051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f1825a1177a04e78bd4d42c9ab83c051"}]}] Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-VolumesBackupsTest-153564717 Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: f1825a1177a04e78bd4d42c9ab83c051 Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-VolumesBackupsTest-153564717 Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-VolumesBackupsTest-153564717-project Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 77c793eaa0c14d9886a6a8f2e721cf9e Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-VolumesBackupsTest-153564717-project Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: exception: Instance e5caffef-3784-4343-9a47-bb934f2b2214 could not be found. Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': 'e5caffef-3784-4343-9a47-bb934f2b2214'} Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5caffef-3784-4343-9a47-bb934f2b2214 could not be found. Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5caffef-3784-4343-9a47-bb934f2b2214 could not be found. Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:04.681822 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:12:04.694856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:04.694856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:04.694856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:04.694856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:04.694856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:04.694856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5caffef-3784-4343-9a47-bb934f2b2214 could not be found. Oct 04 21:12:04.694856 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:12:04.694856 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-1c6cfe8b-9bfd-45ad-bf70-e055785b8c97 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] Returning 404 to user: Instance e5caffef-3784-4343-9a47-bb934f2b2214 could not be found. {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:04.710918 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-1c6cfe8b-9bfd-45ad-bf70-e055785b8c97 tempest-VolumesBackupsTest-153564717 tempest-VolumesBackupsTest-153564717-project] 10.222.0.78 "GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214" status: 404 len: 111 microversion: 2.1 time: 0.326460 Oct 04 21:12:04.715320 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1028/2050] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:04 2022] GET /compute/v2.1/servers/e5caffef-3784-4343-9a47-bb934f2b2214 => generated 111 bytes in 332 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:10.149818 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=8 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:10.151525 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=16 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:10.153818 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:15:10.154062 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:15:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates (ip 10.222.0.78) !!! Oct 04 21:15:10.157876 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:15:10.158151 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:15:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates (ip 10.222.0.78) !!! Oct 04 21:15:10.162632 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:15:10.162945 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:15:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates (ip 10.222.0.78) !!! Oct 04 21:15:10.949556 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-8ec98ceb-9232-455d-80dc-b13603cba18e tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1657214873", "availability_zone": "foo_zone"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:10.971568 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.objects.aggregate [None req-8ec98ceb-9232-455d-80dc-b13603cba18e tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Generated uuid 3ccc8bbb-fb05-4f5d-8454-9c688ec19ad5 for aggregate {{(pid=123540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:15:11.221460 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-8ec98ceb-9232-455d-80dc-b13603cba18e tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 1.079957 Oct 04 21:15:11.244418 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1023/2051] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Oct 4 21:15:10 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:11.247065 n-d-852085-12 devstack@n-api.service[123539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d5edc17b-4d95-44e5-91e5-59bc85f612b8] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 21:15:11.248221 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:11.249682 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:11.251733 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:15:11.254180 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:15:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates/19/action (ip 10.222.0.78) !!! Oct 04 21:15:11.266141 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:15:11.266401 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:15:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates/19/action (ip 10.222.0.78) !!! Oct 04 21:15:11.278522 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:15:11.278808 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:15:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates/19/action (ip 10.222.0.78) !!! Oct 04 21:15:11.322690 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d4e1b048-a08b-4f72-815c-4d9d0f103963 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:11.820924 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d4e1b048-a08b-4f72-815c-4d9d0f103963 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.563974 Oct 04 21:15:11.825745 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1029/2052] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 21:15:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:11.864912 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3f54969a-d92b-433c-b4ca-f5005f5dd1a6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:11.882505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3f54969a-d92b-433c-b4ca-f5005f5dd1a6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:11.889710 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3f54969a-d92b-433c-b4ca-f5005f5dd1a6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:11.892075 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3f54969a-d92b-433c-b4ca-f5005f5dd1a6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:11.899454 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3f54969a-d92b-433c-b4ca-f5005f5dd1a6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:11.902974 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3f54969a-d92b-433c-b4ca-f5005f5dd1a6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:11.906095 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-3f54969a-d92b-433c-b4ca-f5005f5dd1a6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:12.017941 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3f54969a-d92b-433c-b4ca-f5005f5dd1a6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.176048 Oct 04 21:15:12.047560 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-12e78045-48d6-4a4e-953c-e796a668e1a4 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:12.049363 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1024/2053] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Oct 4 21:15:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:15:12.087819 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-12e78045-48d6-4a4e-953c-e796a668e1a4 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.053625 Oct 04 21:15:12.103740 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1030/2054] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 4 21:15:12 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:12.114721 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4ea4f019-992a-4bc6-a2e1-145637dc0d41 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852085-12"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:12.161945 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4ea4f019-992a-4bc6-a2e1-145637dc0d41 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:12.163327 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4ea4f019-992a-4bc6-a2e1-145637dc0d41 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:12.167050 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4ea4f019-992a-4bc6-a2e1-145637dc0d41 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:13.740587 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4ea4f019-992a-4bc6-a2e1-145637dc0d41 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 1.634830 Oct 04 21:15:13.747315 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1025/2055] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 21:15:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:13.762196 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5755ca6a-31e6-46b1-bad0-1645178a6d40 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:13.849741 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] [d5edc17b-4d95-44e5-91e5-59bc85f612b8] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 45852. Oct 04 21:15:13.856980 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5755ca6a-31e6-46b1-bad0-1645178a6d40 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.101255 Oct 04 21:15:13.867823 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1031/2056] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 21:15:13 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:13.891359 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-35b12863-c6e4-46da-a8da-10934e46ca4e tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-634378454", "availability_zone": "foo_zone"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:14.420118 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-35b12863-c6e4-46da-a8da-10934e46ca4e tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.530188 Oct 04 21:15:14.429480 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1026/2057] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Oct 4 21:15:13 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:14.455810 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7e91da75-b28b-4de6-8adb-43eef5b7a9f4 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:14.785491 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7e91da75-b28b-4de6-8adb-43eef5b7a9f4 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.337885 Oct 04 21:15:14.788431 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1032/2058] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 21:15:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:14.827508 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-89639202-d25e-48f1-8c66-2b5cfdd9775f tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:14.903346 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-89639202-d25e-48f1-8c66-2b5cfdd9775f tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.096684 Oct 04 21:15:14.907292 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1027/2059] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 21:15:14 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:14.936060 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4f8f99eb-6e81-4531-9c78-7b9b93aa60b6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852085-12"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:15.041703 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f8f99eb-6e81-4531-9c78-7b9b93aa60b6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.049288 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f8f99eb-6e81-4531-9c78-7b9b93aa60b6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.050704 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-4f8f99eb-6e81-4531-9c78-7b9b93aa60b6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:16.111037 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4f8f99eb-6e81-4531-9c78-7b9b93aa60b6 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 1.191691 Oct 04 21:15:16.117961 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1033/2060] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Oct 4 21:15:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:16.140670 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-69601cb8-e0f4-4e91-ab32-3a3ab735bb56 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:16.432081 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-69601cb8-e0f4-4e91-ab32-3a3ab735bb56 tempest-TestAggregatesBasicOps-1507823365 tempest-TestAggregatesBasicOps-1507823365-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.295858 Oct 04 21:15:16.439124 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1028/2061] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 21:15:16 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:16:20.239902 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:20.242591 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:20.773783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4cefb061-2c2a-4a3d-a32f-66f26bbc7c9c tempest-TestServerAdvancedOps-1771817085 tempest-TestServerAdvancedOps-1771817085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-18978799", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "6f08fc01-db8d-439f-b50e-4d115b3e90cc"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:21.173462 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-4cefb061-2c2a-4a3d-a32f-66f26bbc7c9c tempest-TestServerAdvancedOps-1771817085 tempest-TestServerAdvancedOps-1771817085-project] validate_networks() for [('6f08fc01-db8d-439f-b50e-4d115b3e90cc', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-4cefb061-2c2a-4a3d-a32f-66f26bbc7c9c tempest-TestServerAdvancedOps-1771817085 tempest-TestServerAdvancedOps-1771817085-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b9cd2933-854f-479e-81d7-d1853176a7a2) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:16:22.550791 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b9cd2933-854f-479e-81d7-d1853176a7a2) Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-4cefb061-2c2a-4a3d-a32f-66f26bbc7c9c tempest-TestServerAdvancedOps-1771817085 tempest-TestServerAdvancedOps-1771817085-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4cefb061-2c2a-4a3d-a32f-66f26bbc7c9c tempest-TestServerAdvancedOps-1771817085 tempest-TestServerAdvancedOps-1771817085-project] Request method failure captured: Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 205 Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKKaoRDvyevvtZhDaNm15VOV5da2duBFhPOfSDU1CGpXaFb3klLy7yJMCLy6T9LsERHEiZmbwcKxSTBebhYsB8H2e5XxKWgEdIELmYJ6FOa3NKkcHIv-ymyiELP6Plfzinlm9JZCSqu5dlKsz2VHWOMbybmlXb2ieWMoidmprULGmuc Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: cad18cb30abe49648a8eb22002663311 Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestServerAdvancedOps-1771817085 Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cad18cb30abe49648a8eb22002663311", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cad18cb30abe49648a8eb22002663311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cad18cb30abe49648a8eb22002663311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cad18cb30abe49648a8eb22002663311"}]}] Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestServerAdvancedOps-1771817085 Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: cad18cb30abe49648a8eb22002663311 Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestServerAdvancedOps-1771817085 Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestServerAdvancedOps-1771817085-project Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: bd86d19e5c794a81ae9639c3de3e79a1 Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestServerAdvancedOps-1771817085-project Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestServerAdvancedOps-server-18978799", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "6f08fc01-db8d-439f-b50e-4d115b3e90cc"}]}} Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestServerAdvancedOps-server-18978799', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '6f08fc01-db8d-439f-b50e-4d115b3e90cc'}]}}} Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:22.560933 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:16:22.576367 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b9cd2933-854f-479e-81d7-d1853176a7a2) Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-4cefb061-2c2a-4a3d-a32f-66f26bbc7c9c tempest-TestServerAdvancedOps-1771817085 tempest-TestServerAdvancedOps-1771817085-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:22.591215 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-4cefb061-2c2a-4a3d-a32f-66f26bbc7c9c tempest-TestServerAdvancedOps-1771817085 tempest-TestServerAdvancedOps-1771817085-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.360999 Oct 04 21:16:22.608402 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1034/2062] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:16:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 2381 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:17:07.477835 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:07.482810 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=6 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:07.486363 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:07.512465 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fbe607fd-29f4-44b3-830e-94338284d6ec tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-390734037", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "825e3c2b-366c-469a-a5db-d054606a0903", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "798c0142-6487-4be9-a55d-44c8d2cb7e55"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:08.835661 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-fbe607fd-29f4-44b3-830e-94338284d6ec tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] validate_networks() for [('798c0142-6487-4be9-a55d-44c8d2cb7e55', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-fbe607fd-29f4-44b3-830e-94338284d6ec tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3dc00a71-f7e0-430f-ad59-367ebad97fbf) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:17:09.735294 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3dc00a71-f7e0-430f-ad59-367ebad97fbf) Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-fbe607fd-29f4-44b3-830e-94338284d6ec tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:09.742630 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fbe607fd-29f4-44b3-830e-94338284d6ec tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Request method failure captured: Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 353 Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKKr_9dQ_gSDmK7tAdhDKEiFBCSasSn9_J49GHYLW3Ko89j40ekaHF9WgOl3ajqdLcMqGSFv1hKOWnxg6IsPvwN_n23R-tMKOoV8F6UBmYccsX-qNrQ3K9Sw-4ORW16eM19aFwphM9Ye2s2rgMmhGRQq-tsVlYV5DuI7DdOQ_9Uum9g Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 06b106a291b44599bb30d5040d82a3cb Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06b106a291b44599bb30d5040d82a3cb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06b106a291b44599bb30d5040d82a3cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06b106a291b44599bb30d5040d82a3cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06b106a291b44599bb30d5040d82a3cb"}]}] Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 06b106a291b44599bb30d5040d82a3cb Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestVolumeBootPattern-1045107375-project Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 586e44616297471eaf68e3eee955f48a Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestVolumeBootPattern-1045107375-project Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-TestVolumeBootPattern-server-390734037", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "825e3c2b-366c-469a-a5db-d054606a0903", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "798c0142-6487-4be9-a55d-44c8d2cb7e55"}]}} Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-390734037', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '825e3c2b-366c-469a-a5db-d054606a0903'}], 'networks': [{'uuid': '798c0142-6487-4be9-a55d-44c8d2cb7e55'}]}}} Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:17:09.765286 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3dc00a71-f7e0-430f-ad59-367ebad97fbf) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:09.772893 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-fbe607fd-29f4-44b3-830e-94338284d6ec tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-fbe607fd-29f4-44b3-830e-94338284d6ec tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.278143 Oct 04 21:17:09.784016 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1029/2063] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:07 2022] POST /compute/v2.1/servers => generated 214 bytes in 2298 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:17:33.652263 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:33.699707 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5de593f2-4bf1-42ea-b37d-130d25d464c4 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1123100448", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e49cb545-861f-429f-8a65-ee2363756f8b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "798c0142-6487-4be9-a55d-44c8d2cb7e55"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:35.309768 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-5de593f2-4bf1-42ea-b37d-130d25d464c4 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] validate_networks() for [('798c0142-6487-4be9-a55d-44c8d2cb7e55', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-5de593f2-4bf1-42ea-b37d-130d25d464c4 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-db929c11-a16e-49e6-ad8d-644d8835f396) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:17:36.616592 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-db929c11-a16e-49e6-ad8d-644d8835f396) Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-5de593f2-4bf1-42ea-b37d-130d25d464c4 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:36.625804 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5de593f2-4bf1-42ea-b37d-130d25d464c4 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Request method failure captured: Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 354 Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKKr_9dQ_gSDmK7tAdhDKEiFBCSasSn9_J49GHYLW3Ko89j40ekaHF9WgOl3ajqdLcMqGSFv1hKOWnxg6IsPvwN_n23R-tMKOoV8F6UBmYccsX-qNrQ3K9Sw-4ORW16eM19aFwphM9Ye2s2rgMmhGRQq-tsVlYV5DuI7DdOQ_9Uum9g Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 06b106a291b44599bb30d5040d82a3cb Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06b106a291b44599bb30d5040d82a3cb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06b106a291b44599bb30d5040d82a3cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06b106a291b44599bb30d5040d82a3cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06b106a291b44599bb30d5040d82a3cb"}]}] Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 06b106a291b44599bb30d5040d82a3cb Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestVolumeBootPattern-1045107375-project Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 586e44616297471eaf68e3eee955f48a Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestVolumeBootPattern-1045107375-project Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1123100448", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e49cb545-861f-429f-8a65-ee2363756f8b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "798c0142-6487-4be9-a55d-44c8d2cb7e55"}]}} Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1123100448', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': 'e49cb545-861f-429f-8a65-ee2363756f8b'}], 'networks': [{'uuid': '798c0142-6487-4be9-a55d-44c8d2cb7e55'}]}}} Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:17:36.643099 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-db929c11-a16e-49e6-ad8d-644d8835f396) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:36.649943 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5de593f2-4bf1-42ea-b37d-130d25d464c4 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:36.662636 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5de593f2-4bf1-42ea-b37d-130d25d464c4 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.999578 Oct 04 21:17:36.673334 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1035/2064] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 3028 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:17:39.031087 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:39.551282 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-bd96676b-cd51-485f-8e03-e3ed5fed4674 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] Action: 'create', calling method: .version_select at 0x7f77eed98ee0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-188037783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtLEsPy0O9izSBLRrUXS07fqUxQRad/JgClVwyx7uxg5IK82iNrTfxqR0OCS6wRyUchzEMoEl54LGOZEjK0RnJ2C+S7BDiMV83qKQZhbzcRKqT1+kMDrM/QoSy2VWnOfQ=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:39.581161 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9f679e7a-31c8-4b02-872b-7dad7ced42b4 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:39.591886 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9f679e7a-31c8-4b02-872b-7dad7ced42b4 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:39.601466 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9f679e7a-31c8-4b02-872b-7dad7ced42b4 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:39.603254 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9f679e7a-31c8-4b02-872b-7dad7ced42b4 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:39.605319 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9f679e7a-31c8-4b02-872b-7dad7ced42b4 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:39.618878 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9f679e7a-31c8-4b02-872b-7dad7ced42b4 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:39.620406 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-9f679e7a-31c8-4b02-872b-7dad7ced42b4 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:39.684821 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-bd96676b-cd51-485f-8e03-e3ed5fed4674 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] Getting quotas for project 2e5de3cd23f54af491e3e2ee52f16035. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:17:39.738933 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-bd96676b-cd51-485f-8e03-e3ed5fed4674 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] Getting quotas for user 1b2e783f973b4c0a88f2b8517041f8a7 and project 2e5de3cd23f54af491e3e2ee52f16035. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:17:39.888554 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9f679e7a-31c8-4b02-872b-7dad7ced42b4 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.917098 Oct 04 21:17:39.893445 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1030/2065] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Oct 4 21:17:38 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:40.071326 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-bd96676b-cd51-485f-8e03-e3ed5fed4674 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.580632 Oct 04 21:17:40.073294 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1036/2066] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:17:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:17:40.449530 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f6edcf8a-7ea3-497b-8d42-2f145fabde29 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-314120185", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "availability_zone": "nova:n-h2-852085-12", "networks": [{"uuid": "aec13732-ceb2-486d-92ff-f58cae5932a7"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:40.740670 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-f6edcf8a-7ea3-497b-8d42-2f145fabde29 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] validate_networks() for [('aec13732-ceb2-486d-92ff-f58cae5932a7', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-f6edcf8a-7ea3-497b-8d42-2f145fabde29 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-30f97455-be28-4839-a718-716ebc90b22a) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:17:42.304633 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-30f97455-be28-4839-a718-716ebc90b22a) Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-f6edcf8a-7ea3-497b-8d42-2f145fabde29 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:42.313588 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f6edcf8a-7ea3-497b-8d42-2f145fabde29 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] Request method failure captured: Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 248 Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKLyknlVcNN8gx69U9yYyM4DnivJOYGixHbUqdTIfFSuWousGVc9h9uNUIbFilNWYfzJSj3aidwFGmRx2m7MynPUAdBbLkT6KSBXjjvVZEz9x_ABWDEOW3U1dyBBz6SJcMQ5D93fYSaC9kvs5lLfySz406Sdz8ajZofF5s-527aZ4dE Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 897a1e4fc0a84a1b96300ca5991a7ccf Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestServerMultinode-865395786 Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_897a1e4fc0a84a1b96300ca5991a7ccf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/897a1e4fc0a84a1b96300ca5991a7ccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/897a1e4fc0a84a1b96300ca5991a7ccf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/897a1e4fc0a84a1b96300ca5991a7ccf"}]}] Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestServerMultinode-865395786 Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 897a1e4fc0a84a1b96300ca5991a7ccf Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestServerMultinode-865395786 Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestServerMultinode-865395786-project-admin Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 632426a265d34946baa4e6e7daf50991 Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestServerMultinode-865395786-project-admin Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-TestServerMultinode-server-314120185", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "availability_zone": "nova:n-h2-852085-12", "networks": [{"uuid": "aec13732-ceb2-486d-92ff-f58cae5932a7"}]}} Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-TestServerMultinode-server-314120185', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'aec13732-ceb2-486d-92ff-f58cae5932a7'}]}}} Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:17:42.325141 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-30f97455-be28-4839-a718-716ebc90b22a) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:17:42.333678 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:42.341889 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:17:42.353535 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f6edcf8a-7ea3-497b-8d42-2f145fabde29 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:42.353535 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:42.361272 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f6edcf8a-7ea3-497b-8d42-2f145fabde29 tempest-TestServerMultinode-865395786 tempest-TestServerMultinode-865395786-project-admin] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.923957 Oct 04 21:17:42.369082 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1031/2067] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:40 2022] POST /compute/v2.1/servers => generated 214 bytes in 1931 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:17:48.809554 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6915e99c-b14f-4fc8-9475-c3dcc37d53f4 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-961654632", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "19ddff67-bac3-4423-a8ca-e24a378e67ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-188037783", "security_groups": [{"name": "tempest-secgroup-smoke-1603307822"}], "networks": [{"uuid": "124623e3-9f94-4b2f-9597-82851ed5391b"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:49.414139 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-6915e99c-b14f-4fc8-9475-c3dcc37d53f4 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] validate_networks() for [('124623e3-9f94-4b2f-9597-82851ed5391b', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:49.817810 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-6915e99c-b14f-4fc8-9475-c3dcc37d53f4 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-183ddc68-e1cc-4d65-9515-661c9e5daab9) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:17:50.677270 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-183ddc68-e1cc-4d65-9515-661c9e5daab9) Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-6915e99c-b14f-4fc8-9475-c3dcc37d53f4 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:50.686197 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6915e99c-b14f-4fc8-9475-c3dcc37d53f4 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] Request method failure captured: Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 448 Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKDN9rI1hfbPxTri9CGvgrR-2bFhcn0Hw9hLZV7MDhjf4ecZ2qGce54e2nG2hV2BtTRK9Wwad5anPWgrmpBW1sKnt0ktw1cQw5o1WcZ4buU3YwWP9w_mby3zpPpIl9AmOPJEb99oJRqlE7fjT75GKRQBfC4S7C-MQPpaOyBkP6nj32M Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 2e5de3cd23f54af491e3e2ee52f16035 Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestVolumeBackupRestore-1711409639 Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2e5de3cd23f54af491e3e2ee52f16035", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2e5de3cd23f54af491e3e2ee52f16035"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2e5de3cd23f54af491e3e2ee52f16035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2e5de3cd23f54af491e3e2ee52f16035"}]}] Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestVolumeBackupRestore-1711409639 Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 2e5de3cd23f54af491e3e2ee52f16035 Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1711409639 Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestVolumeBackupRestore-1711409639-project Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 1b2e783f973b4c0a88f2b8517041f8a7 Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestVolumeBackupRestore-1711409639-project Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestVolumeBackupRestore-server-961654632", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "19ddff67-bac3-4423-a8ca-e24a378e67ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-188037783", "security_groups": [{"name": "tempest-secgroup-smoke-1603307822"}], "networks": [{"uuid": "124623e3-9f94-4b2f-9597-82851ed5391b"}]}} Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBackupRestore-server-961654632', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'volume_id': '19ddff67-bac3-4423-a8ca-e24a378e67ea', 'delete_on_termination': False}], 'key_name': 'tempest-TestVolumeBackupRestore-188037783', 'security_groups': [{'name': 'tempest-secgroup-smoke-1603307822'}], 'networks': [{'uuid': '124623e3-9f94-4b2f-9597-82851ed5391b'}]}}} Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:17:50.707467 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-183ddc68-e1cc-4d65-9515-661c9e5daab9) Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:50.717452 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6915e99c-b14f-4fc8-9475-c3dcc37d53f4 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6915e99c-b14f-4fc8-9475-c3dcc37d53f4 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.902289 Oct 04 21:17:50.737591 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1037/2068] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:48 2022] POST /compute/v2.1/servers => generated 214 bytes in 1917 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:17:51.874750 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bc9966d3-c5b1-42c2-81c9-840ca23dde45 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] Calling method '.version_select at 0x7f77f7582af0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:51.881512 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:51.884629 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:51.885829 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=8 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:52.149373 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bc9966d3-c5b1-42c2-81c9-840ca23dde45 tempest-TestVolumeBackupRestore-1711409639 tempest-TestVolumeBackupRestore-1711409639-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-188037783" status: 202 len: 0 microversion: 2.1 time: 0.291238 Oct 04 21:17:52.157873 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1032/2069] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 21:17:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-188037783 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:18:51.171265 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:51.178827 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e90df0b9-4443-4e10-85f7-a59b4abe4115 tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1523563228", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "976bd4b4-7883-4dce-971d-3c0bf0316858"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:51.349142 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-e90df0b9-4443-4e10-85f7-a59b4abe4115 tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] validate_networks() for [('976bd4b4-7883-4dce-971d-3c0bf0316858', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-e90df0b9-4443-4e10-85f7-a59b4abe4115 tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-44afd46f-ced7-437d-8313-e9382a5aaea3) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:18:52.562000 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-44afd46f-ced7-437d-8313-e9382a5aaea3) Oct 04 21:18:52.568341 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:18:52.575587 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-e90df0b9-4443-4e10-85f7-a59b4abe4115 tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:18:52.575587 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e90df0b9-4443-4e10-85f7-a59b4abe4115 tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] Request method failure captured: Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 206 Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKM0YdzC2y09wrmErHVc5Kl7Dv9HjoFpU7b6LdhnE-Sb5zcyOdn--vpyfaWVDqTxFHKaHlWpzIbUpFSmhcOBQht6r3S0EqTX7406A2JZpFsNFezHJMyb2UCD5f4iC8TPUcruqIXxPzjfEGMSv38agiNhI6BZIF2Z-t56GTMHr41vQrg Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: d3fac9b31f4a46eaae79ae4e7dfc1b9c Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-VolumesActionsTest-273780053 Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d3fac9b31f4a46eaae79ae4e7dfc1b9c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3fac9b31f4a46eaae79ae4e7dfc1b9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3fac9b31f4a46eaae79ae4e7dfc1b9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d3fac9b31f4a46eaae79ae4e7dfc1b9c"}]}] Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-VolumesActionsTest-273780053 Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: d3fac9b31f4a46eaae79ae4e7dfc1b9c Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-VolumesActionsTest-273780053 Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-VolumesActionsTest-273780053-project Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 27d950f664e5445b81b8135876754702 Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-VolumesActionsTest-273780053-project Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-VolumesActionsTest-instance-1523563228", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "976bd4b4-7883-4dce-971d-3c0bf0316858"}]}} Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-1523563228', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '976bd4b4-7883-4dce-971d-3c0bf0316858'}]}}} Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:18:52.580901 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-44afd46f-ced7-437d-8313-e9382a5aaea3) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:18:52.588379 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e90df0b9-4443-4e10-85f7-a59b4abe4115 tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:52.597847 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e90df0b9-4443-4e10-85f7-a59b4abe4115 tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.420665 Oct 04 21:18:52.652892 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1038/2070] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:18:51 2022] POST /compute/v2.1/servers => generated 214 bytes in 1468 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:18:52.924486 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-af856f9b-6b05-4ffa-a5ca-c02c28656fdf tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-514007986", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "976bd4b4-7883-4dce-971d-3c0bf0316858"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:52.948085 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:18:52.948480 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:18:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 21:18:52.958228 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:18:52.958544 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:18:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 21:18:53.063383 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-af856f9b-6b05-4ffa-a5ca-c02c28656fdf tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] validate_networks() for [('976bd4b4-7883-4dce-971d-3c0bf0316858', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-af856f9b-6b05-4ffa-a5ca-c02c28656fdf tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd82e15c-57ec-4d10-be8d-2158f5f118c4) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:18:53.526657 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd82e15c-57ec-4d10-be8d-2158f5f118c4) Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-af856f9b-6b05-4ffa-a5ca-c02c28656fdf tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:18:53.534077 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-af856f9b-6b05-4ffa-a5ca-c02c28656fdf tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] Request method failure captured: Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 205 Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKM0YdzC2y09wrmErHVc5Kl7Dv9HjoFpU7b6LdhnE-Sb5zcyOdn--vpyfaWVDqTxFHKaHlWpzIbUpFSmhcOBQht6r3S0EqTX7406A2JZpFsNFezHJMyb2UCD5f4iC8TPUcruqIXxPzjfEGMSv38agiNhI6BZIF2Z-t56GTMHr41vQrg Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: d3fac9b31f4a46eaae79ae4e7dfc1b9c Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-VolumesActionsTest-273780053 Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d3fac9b31f4a46eaae79ae4e7dfc1b9c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3fac9b31f4a46eaae79ae4e7dfc1b9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3fac9b31f4a46eaae79ae4e7dfc1b9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d3fac9b31f4a46eaae79ae4e7dfc1b9c"}]}] Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-VolumesActionsTest-273780053 Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: d3fac9b31f4a46eaae79ae4e7dfc1b9c Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-VolumesActionsTest-273780053 Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-VolumesActionsTest-273780053-project Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 27d950f664e5445b81b8135876754702 Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-VolumesActionsTest-273780053-project Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-VolumesActionsTest-instance-514007986", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "976bd4b4-7883-4dce-971d-3c0bf0316858"}]}} Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-514007986', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '976bd4b4-7883-4dce-971d-3c0bf0316858'}]}}} Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:18:53.540602 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd82e15c-57ec-4d10-be8d-2158f5f118c4) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:18:53.555631 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-af856f9b-6b05-4ffa-a5ca-c02c28656fdf tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-af856f9b-6b05-4ffa-a5ca-c02c28656fdf tempest-VolumesActionsTest-273780053 tempest-VolumesActionsTest-273780053-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.633634 Oct 04 21:18:53.562662 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1033/2071] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:18:52 2022] POST /compute/v2.1/servers => generated 214 bytes in 642 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:19:15.209303 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:15.214334 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:19:15.214670 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:19:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 21:19:15.217928 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:19:15.218203 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:19:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 21:19:15.236612 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c8117e2d-73fe-445c-9e50-45bc357b0e78 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-209356276", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b3b283e9-919e-44c7-8851-2ccea704bd58", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "798c0142-6487-4be9-a55d-44c8d2cb7e55"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:15.628744 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-c8117e2d-73fe-445c-9e50-45bc357b0e78 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] validate_networks() for [('798c0142-6487-4be9-a55d-44c8d2cb7e55', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-c8117e2d-73fe-445c-9e50-45bc357b0e78 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cda4d8c8-73a5-4b65-827c-1cf16419e982) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:19:16.313177 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cda4d8c8-73a5-4b65-827c-1cf16419e982) Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-c8117e2d-73fe-445c-9e50-45bc357b0e78 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:19:16.322512 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c8117e2d-73fe-445c-9e50-45bc357b0e78 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Request method failure captured: Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 354 Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKKr_9dQ_gSDmK7tAdhDKEiFBCSasSn9_J49GHYLW3Ko89j40ekaHF9WgOl3ajqdLcMqGSFv1hKOWnxg6IsPvwN_n23R-tMKOoV8F6UBmYccsX-qNrQ3K9Sw-4ORW16eM19aFwphM9Ye2s2rgMmhGRQq-tsVlYV5DuI7DdOQ_9Uum9g Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 06b106a291b44599bb30d5040d82a3cb Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06b106a291b44599bb30d5040d82a3cb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06b106a291b44599bb30d5040d82a3cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06b106a291b44599bb30d5040d82a3cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06b106a291b44599bb30d5040d82a3cb"}]}] Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 06b106a291b44599bb30d5040d82a3cb Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestVolumeBootPattern-1045107375-project Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 586e44616297471eaf68e3eee955f48a Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestVolumeBootPattern-1045107375-project Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestVolumeBootPattern-server-209356276", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b3b283e9-919e-44c7-8851-2ccea704bd58", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "798c0142-6487-4be9-a55d-44c8d2cb7e55"}]}} Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-209356276', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'snapshot', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'snapshot_id': 'b3b283e9-919e-44c7-8851-2ccea704bd58'}], 'networks': [{'uuid': '798c0142-6487-4be9-a55d-44c8d2cb7e55'}]}}} Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:19:16.334755 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cda4d8c8-73a5-4b65-827c-1cf16419e982) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:16.341332 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:19:16.365381 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:19:16.373011 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c8117e2d-73fe-445c-9e50-45bc357b0e78 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:19:16.373011 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:16.373934 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c8117e2d-73fe-445c-9e50-45bc357b0e78 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.168593 Oct 04 21:19:16.374773 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1039/2072] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:19:15 2022] POST /compute/v2.1/servers => generated 214 bytes in 1170 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:20:28.020511 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:28.029149 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6b8e275f-824b-46da-985b-d59b35e3fadb tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1206322198", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fa5fb187-28f2-4dcd-ae67-d7437841af27", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "798c0142-6487-4be9-a55d-44c8d2cb7e55"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:28.315367 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-6b8e275f-824b-46da-985b-d59b35e3fadb tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] validate_networks() for [('798c0142-6487-4be9-a55d-44c8d2cb7e55', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-6b8e275f-824b-46da-985b-d59b35e3fadb tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f96d7af1-e41c-4ce3-9922-9b513c555f45) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:20:28.905494 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f96d7af1-e41c-4ce3-9922-9b513c555f45) Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-6b8e275f-824b-46da-985b-d59b35e3fadb tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6b8e275f-824b-46da-985b-d59b35e3fadb tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Request method failure captured: Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 367 Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKKr_9dQ_gSDmK7tAdhDKEiFBCSasSn9_J49GHYLW3Ko89j40ekaHF9WgOl3ajqdLcMqGSFv1hKOWnxg6IsPvwN_n23R-tMKOoV8F6UBmYccsX-qNrQ3K9Sw-4ORW16eM19aFwphM9Ye2s2rgMmhGRQq-tsVlYV5DuI7DdOQ_9Uum9g Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 06b106a291b44599bb30d5040d82a3cb Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06b106a291b44599bb30d5040d82a3cb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06b106a291b44599bb30d5040d82a3cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06b106a291b44599bb30d5040d82a3cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06b106a291b44599bb30d5040d82a3cb"}]}] Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 06b106a291b44599bb30d5040d82a3cb Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestVolumeBootPattern-1045107375-project Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 586e44616297471eaf68e3eee955f48a Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestVolumeBootPattern-1045107375-project Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1206322198", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fa5fb187-28f2-4dcd-ae67-d7437841af27", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "798c0142-6487-4be9-a55d-44c8d2cb7e55"}]}} Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:20:28.913570 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-volume-backed-server-1206322198', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': 'fa5fb187-28f2-4dcd-ae67-d7437841af27'}], 'networks': [{'uuid': '798c0142-6487-4be9-a55d-44c8d2cb7e55'}]}}} Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:20:28.926765 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f96d7af1-e41c-4ce3-9922-9b513c555f45) Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-6b8e275f-824b-46da-985b-d59b35e3fadb tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-6b8e275f-824b-46da-985b-d59b35e3fadb tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.896855 Oct 04 21:20:28.934786 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1034/2073] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:20:28 2022] POST /compute/v2.1/servers => generated 214 bytes in 907 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:20:38.567476 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:38.604371 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0b2ecd49-2a8b-473d-9310-e37e5031312c tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Action: 'create', calling method: .version_select at 0x7f77eea95ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-410849085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGegs8p4PVd7nKlw+89lU4gL6K2vcy0kEGd4gmlZJ2+759mpSzAF8+Aod3ry96y1ROCrJA9QJqm+zZ1Z4VpOnYrYqmBnoqy0p0qrbnmpJv3Rj3ptmJdj4C+ZBgYzYF4dAg=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:38.725100 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-0b2ecd49-2a8b-473d-9310-e37e5031312c tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Getting quotas for project 06b106a291b44599bb30d5040d82a3cb. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:38.766705 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-0b2ecd49-2a8b-473d-9310-e37e5031312c tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Getting quotas for user 586e44616297471eaf68e3eee955f48a and project 06b106a291b44599bb30d5040d82a3cb. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:38.903358 n-d-852085-12 devstack@n-api.service[123539]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0b2ecd49-2a8b-473d-9310-e37e5031312c tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] [c422e810-783e-4280-bbf8-739652fec542] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:20:39.428444 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e72f90fa-b8a8-4f2c-830f-f3d4ee046f35 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Action: 'create', calling method: .version_select at 0x7f77f74c5160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1861678137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKZajOrotySZYZomv8kw+FWm4M6BU8QZ9+oIJ71aSbjzrDZCm+DTNhVFn44xb9kGlCfeFhD/oJlU+gSwyRxpwD1U18lJZdRTuPDTU0jCbd8u0wCMADBeGPMY7jY23k0tA=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:39.466184 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:20:39.479565 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:20:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:20:39.482801 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:39.603733 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-e72f90fa-b8a8-4f2c-830f-f3d4ee046f35 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Getting quotas for project be36678756d4429b91d971abf8fdcdd1. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:39.627478 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-e72f90fa-b8a8-4f2c-830f-f3d4ee046f35 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Getting quotas for user dc367e6de31d47e4aa924b4da0d826c8 and project be36678756d4429b91d971abf8fdcdd1. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:39.828837 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e72f90fa-b8a8-4f2c-830f-f3d4ee046f35 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.411484 Oct 04 21:20:39.830702 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1035/2074] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:20:39 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:20:39.941584 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [None req-0b2ecd49-2a8b-473d-9310-e37e5031312c tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] [c422e810-783e-4280-bbf8-739652fec542] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 52956. Oct 04 21:20:40.122854 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0b2ecd49-2a8b-473d-9310-e37e5031312c tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.556967 Oct 04 21:20:40.127013 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1040/2075] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:20:38 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:45.764631 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ca72fc78-5fe1-425b-8151-680b2764ed91 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-661481791", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "9117a828-a129-4df1-96d5-b5ba21b94347"}], "key_name": "tempest-TestNetworkBasicOps-1861678137", "security_groups": [{"name": "tempest-secgroup-smoke-323967812"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:46.114753 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-ca72fc78-5fe1-425b-8151-680b2764ed91 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] validate_networks() for [('9117a828-a129-4df1-96d5-b5ba21b94347', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-ca72fc78-5fe1-425b-8151-680b2764ed91 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-35c0c0d2-cc56-4350-bd40-c7b1e0ea282b) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:20:46.612145 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-35c0c0d2-cc56-4350-bd40-c7b1e0ea282b) Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-ca72fc78-5fe1-425b-8151-680b2764ed91 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:20:46.624400 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ca72fc78-5fe1-425b-8151-680b2764ed91 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Request method failure captured: Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 325 Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKOSurfWJE0E3UxXaHuG8lv6VwxwMYzEy6fiD_ZXe80_d0ct_Je_smBpPaCdVyb-ywCmH5tojo1jTGckXuq8GzjS6AoLFAuk2fN7emnLKYPQDc-Y1bnH0AWBxW8_tX9qeJgVsFDSBqOTchNjuNF3FXb8-zH3B44z0mcf3a6uagvlROk Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: be36678756d4429b91d971abf8fdcdd1 Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestNetworkBasicOps-342040419 Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_be36678756d4429b91d971abf8fdcdd1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be36678756d4429b91d971abf8fdcdd1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be36678756d4429b91d971abf8fdcdd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/be36678756d4429b91d971abf8fdcdd1"}]}] Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestNetworkBasicOps-342040419 Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: be36678756d4429b91d971abf8fdcdd1 Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestNetworkBasicOps-342040419 Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestNetworkBasicOps-342040419-project Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: dc367e6de31d47e4aa924b4da0d826c8 Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestNetworkBasicOps-342040419-project Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-TestNetworkBasicOps-server-661481791", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "9117a828-a129-4df1-96d5-b5ba21b94347"}], "key_name": "tempest-TestNetworkBasicOps-1861678137", "security_groups": [{"name": "tempest-secgroup-smoke-323967812"}]}} Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkBasicOps-server-661481791', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '9117a828-a129-4df1-96d5-b5ba21b94347'}], 'key_name': 'tempest-TestNetworkBasicOps-1861678137', 'security_groups': [{'name': 'tempest-secgroup-smoke-323967812'}]}}} Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:20:46.632228 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-35c0c0d2-cc56-4350-bd40-c7b1e0ea282b) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:20:46.640930 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-ca72fc78-5fe1-425b-8151-680b2764ed91 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:20:46.652386 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-ca72fc78-5fe1-425b-8151-680b2764ed91 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.892049 Oct 04 21:20:46.658518 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1036/2076] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:20:45 2022] POST /compute/v2.1/servers => generated 214 bytes in 905 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:20:47.287279 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-399b68c4-1dc4-4dc5-ae26-bae41e7989eb tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Calling method '.version_select at 0x7f77eeaaa0d0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:47.463659 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-399b68c4-1dc4-4dc5-ae26-bae41e7989eb tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1861678137" status: 202 len: 0 microversion: 2.1 time: 0.200336 Oct 04 21:20:47.464647 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1041/2077] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 4 21:20:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1861678137 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:13.200559 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-21e3312d-5b88-4daa-afa7-3c20fad84108 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Action: 'create', calling method: .version_select at 0x7f77eeb0f700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-55072171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi78N4zFXh2ZbEvuCGVEmVqc8O1jkE7KVSabC2OusAPwz0oq0iuvkeZyTjWTs0V0cTgu9NRSEFNHUh+Yf2+otUvp7d7Ien3dPvpS7x+cjVzC3aWdiaUTyb1kWL+NIiomA=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:13.269638 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:13.270578 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:13.330143 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-21e3312d-5b88-4daa-afa7-3c20fad84108 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Getting quotas for project be36678756d4429b91d971abf8fdcdd1. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:13.378516 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-21e3312d-5b88-4daa-afa7-3c20fad84108 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Getting quotas for user dc367e6de31d47e4aa924b4da0d826c8 and project be36678756d4429b91d971abf8fdcdd1. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:13.645990 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-21e3312d-5b88-4daa-afa7-3c20fad84108 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.456666 Oct 04 21:21:13.647083 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1037/2078] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:21:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:20.391798 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:20.396488 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:20.426455 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-895cd745-a75e-43b6-88e3-90c7cffb94bc tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1364761342", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "7100c14e-1e77-4a3c-bfe4-abb194c80f28"}], "key_name": "tempest-TestNetworkBasicOps-55072171", "security_groups": [{"name": "tempest-secgroup-smoke-656974808"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:20.912794 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-895cd745-a75e-43b6-88e3-90c7cffb94bc tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] validate_networks() for [('7100c14e-1e77-4a3c-bfe4-abb194c80f28', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-895cd745-a75e-43b6-88e3-90c7cffb94bc tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5cd3788b-409a-4a5d-bb4d-754faded396e) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:21:21.458224 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5cd3788b-409a-4a5d-bb4d-754faded396e) Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-895cd745-a75e-43b6-88e3-90c7cffb94bc tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:21:21.473176 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-895cd745-a75e-43b6-88e3-90c7cffb94bc tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Request method failure captured: Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 324 Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKOSurfWJE0E3UxXaHuG8lv6VwxwMYzEy6fiD_ZXe80_d0ct_Je_smBpPaCdVyb-ywCmH5tojo1jTGckXuq8GzjS6AoLFAuk2fN7emnLKYPQDc-Y1bnH0AWBxW8_tX9qeJgVsFDSBqOTchNjuNF3FXb8-zH3B44z0mcf3a6uagvlROk Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: be36678756d4429b91d971abf8fdcdd1 Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestNetworkBasicOps-342040419 Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_be36678756d4429b91d971abf8fdcdd1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be36678756d4429b91d971abf8fdcdd1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be36678756d4429b91d971abf8fdcdd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/be36678756d4429b91d971abf8fdcdd1"}]}] Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestNetworkBasicOps-342040419 Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: be36678756d4429b91d971abf8fdcdd1 Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestNetworkBasicOps-342040419 Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestNetworkBasicOps-342040419-project Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: dc367e6de31d47e4aa924b4da0d826c8 Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestNetworkBasicOps-342040419-project Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestNetworkBasicOps-server-1364761342", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "7100c14e-1e77-4a3c-bfe4-abb194c80f28"}], "key_name": "tempest-TestNetworkBasicOps-55072171", "security_groups": [{"name": "tempest-secgroup-smoke-656974808"}]}} Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkBasicOps-server-1364761342', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '7100c14e-1e77-4a3c-bfe4-abb194c80f28'}], 'key_name': 'tempest-TestNetworkBasicOps-55072171', 'security_groups': [{'name': 'tempest-secgroup-smoke-656974808'}]}}} Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:21:21.478949 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5cd3788b-409a-4a5d-bb4d-754faded396e) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:21.485192 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-895cd745-a75e-43b6-88e3-90c7cffb94bc tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-895cd745-a75e-43b6-88e3-90c7cffb94bc tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.092461 Oct 04 21:21:21.492743 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1042/2079] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:21:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 1100 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:21:22.080776 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b57279f2-d889-404b-aa0b-9b36db223d89 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] Calling method '.version_select at 0x7f77eeb0f0d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:22.253408 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b57279f2-d889-404b-aa0b-9b36db223d89 tempest-TestNetworkBasicOps-342040419 tempest-TestNetworkBasicOps-342040419-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-55072171" status: 202 len: 0 microversion: 2.1 time: 0.179721 Oct 04 21:21:22.254418 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1038/2080] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 21:21:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-55072171 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:43.146315 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:43.156597 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a7129ec7-c7fa-47cb-8041-d0e7a2293579 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1689319404", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-410849085", "security_groups": [{"name": "tempest-secgroup-smoke-321772679"}], "block_device_mapping_v2": [{"uuid": "bd8ef6f4-6c11-4b35-ac60-14653415a4f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "798c0142-6487-4be9-a55d-44c8d2cb7e55"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:43.391858 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-a7129ec7-c7fa-47cb-8041-d0e7a2293579 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] validate_networks() for [('798c0142-6487-4be9-a55d-44c8d2cb7e55', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-a7129ec7-c7fa-47cb-8041-d0e7a2293579 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f1f9fac5-95d5-454e-91a7-de74bca17e42) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:21:43.863035 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f1f9fac5-95d5-454e-91a7-de74bca17e42) Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-a7129ec7-c7fa-47cb-8041-d0e7a2293579 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a7129ec7-c7fa-47cb-8041-d0e7a2293579 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Request method failure captured: Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 476 Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKKr_9dQ_gSDmK7tAdhDKEiFBCSasSn9_J49GHYLW3Ko89j40ekaHF9WgOl3ajqdLcMqGSFv1hKOWnxg6IsPvwN_n23R-tMKOoV8F6UBmYccsX-qNrQ3K9Sw-4ORW16eM19aFwphM9Ye2s2rgMmhGRQq-tsVlYV5DuI7DdOQ_9Uum9g Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 06b106a291b44599bb30d5040d82a3cb Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06b106a291b44599bb30d5040d82a3cb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06b106a291b44599bb30d5040d82a3cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06b106a291b44599bb30d5040d82a3cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06b106a291b44599bb30d5040d82a3cb"}]}] Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 06b106a291b44599bb30d5040d82a3cb Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1045107375 Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestVolumeBootPattern-1045107375-project Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 586e44616297471eaf68e3eee955f48a Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestVolumeBootPattern-1045107375-project Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1689319404", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-410849085", "security_groups": [{"name": "tempest-secgroup-smoke-321772679"}], "block_device_mapping_v2": [{"uuid": "bd8ef6f4-6c11-4b35-ac60-14653415a4f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "798c0142-6487-4be9-a55d-44c8d2cb7e55"}]}} Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:21:43.872351 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1689319404', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-410849085', 'security_groups': [{'name': 'tempest-secgroup-smoke-321772679'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': 'bd8ef6f4-6c11-4b35-ac60-14653415a4f7'}], 'networks': [{'uuid': '798c0142-6487-4be9-a55d-44c8d2cb7e55'}]}}} Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:21:43.902354 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f1f9fac5-95d5-454e-91a7-de74bca17e42) Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a7129ec7-c7fa-47cb-8041-d0e7a2293579 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a7129ec7-c7fa-47cb-8041-d0e7a2293579 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.731280 Oct 04 21:21:43.913945 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1043/2081] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:21:43 2022] POST /compute/v2.1/servers => generated 214 bytes in 747 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:21:49.351518 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:49.354095 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:49.365826 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-93e0ac9c-35c7-4522-81b2-d7e148938191 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] Calling method '.version_select at 0x7f77eec978b0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:49.607929 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-93e0ac9c-35c7-4522-81b2-d7e148938191 tempest-TestVolumeBootPattern-1045107375 tempest-TestVolumeBootPattern-1045107375-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-410849085" status: 202 len: 0 microversion: 2.1 time: 0.258370 Oct 04 21:21:49.622123 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1039/2082] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 21:21:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-410849085 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:22:08.199496 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:08.218645 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-551f6a70-d10d-4856-8bd5-f15ff40b5305 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1733246378", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "ef5b989d-e9a3-4739-9912-c35576cecbc1"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:08.497583 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-551f6a70-d10d-4856-8bd5-f15ff40b5305 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] validate_networks() for [('ef5b989d-e9a3-4739-9912-c35576cecbc1', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-551f6a70-d10d-4856-8bd5-f15ff40b5305 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b1189a60-8c8a-42d6-8836-f6436e08a260) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:22:09.455409 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b1189a60-8c8a-42d6-8836-f6436e08a260) Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-551f6a70-d10d-4856-8bd5-f15ff40b5305 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-551f6a70-d10d-4856-8bd5-f15ff40b5305 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] Request method failure captured: Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 211 Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKMkhhw592Sj_h9JxO-YD_zFyBqO51b1irzlsQjL6XeeVEHfuWraBoMyNkBM0Yl9HG_H3GI6o-AkITb3VT1MpHI0DJEjH_3vUP7TBpG3VJqLyzxDwptYZrhUss8EXkBdl9TRX350vTnpMZdKwALrUfjZoD525kCjEz95wuabWR3jU3Y Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 407a5520d21e46e8bcaddabf536fadcd Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1089610052 Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_407a5520d21e46e8bcaddabf536fadcd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/407a5520d21e46e8bcaddabf536fadcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/407a5520d21e46e8bcaddabf536fadcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/407a5520d21e46e8bcaddabf536fadcd"}]}] Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-VolumesSnapshotTestJSON-1089610052 Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 407a5520d21e46e8bcaddabf536fadcd Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1089610052 Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-VolumesSnapshotTestJSON-1089610052-project Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 9d9040fc0de14e1583a9f614c47096f6 Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-VolumesSnapshotTestJSON-1089610052-project Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1733246378", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "ef5b989d-e9a3-4739-9912-c35576cecbc1"}]}} Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:22:09.463117 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-VolumesSnapshotTestJSON-instance-1733246378', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'ef5b989d-e9a3-4739-9912-c35576cecbc1'}]}}} Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:22:09.481260 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b1189a60-8c8a-42d6-8836-f6436e08a260) Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-551f6a70-d10d-4856-8bd5-f15ff40b5305 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-551f6a70-d10d-4856-8bd5-f15ff40b5305 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.270067 Oct 04 21:22:09.504871 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1044/2083] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:22:08 2022] POST /compute/v2.1/servers => generated 214 bytes in 1274 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 21:22:27.049064 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-46929566-f191-4773-9544-8c7a794f1fe4 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1655674146", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "ef5b989d-e9a3-4739-9912-c35576cecbc1"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:27.089945 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:22:27.090653 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 21:22:27.092817 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:22:27.093443 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 21:22:27.696092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-46929566-f191-4773-9544-8c7a794f1fe4 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] validate_networks() for [('ef5b989d-e9a3-4739-9912-c35576cecbc1', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-46929566-f191-4773-9544-8c7a794f1fe4 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ca6c6415-0f57-432a-8748-72ab24d2f58d) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:22:28.021191 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ca6c6415-0f57-432a-8748-72ab24d2f58d) Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-46929566-f191-4773-9544-8c7a794f1fe4 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-46929566-f191-4773-9544-8c7a794f1fe4 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] Request method failure captured: Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 211 Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKMkhhw592Sj_h9JxO-YD_zFyBqO51b1irzlsQjL6XeeVEHfuWraBoMyNkBM0Yl9HG_H3GI6o-AkITb3VT1MpHI0DJEjH_3vUP7TBpG3VJqLyzxDwptYZrhUss8EXkBdl9TRX350vTnpMZdKwALrUfjZoD525kCjEz95wuabWR3jU3Y Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 407a5520d21e46e8bcaddabf536fadcd Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1089610052 Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_407a5520d21e46e8bcaddabf536fadcd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/407a5520d21e46e8bcaddabf536fadcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/407a5520d21e46e8bcaddabf536fadcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/407a5520d21e46e8bcaddabf536fadcd"}]}] Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-VolumesSnapshotTestJSON-1089610052 Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 407a5520d21e46e8bcaddabf536fadcd Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1089610052 Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-VolumesSnapshotTestJSON-1089610052-project Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 9d9040fc0de14e1583a9f614c47096f6 Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-VolumesSnapshotTestJSON-1089610052-project Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1655674146", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "ef5b989d-e9a3-4739-9912-c35576cecbc1"}]}} Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:22:28.031125 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-VolumesSnapshotTestJSON-instance-1655674146', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'ef5b989d-e9a3-4739-9912-c35576cecbc1'}]}}} Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:22:28.049980 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ca6c6415-0f57-432a-8748-72ab24d2f58d) Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-46929566-f191-4773-9544-8c7a794f1fe4 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-46929566-f191-4773-9544-8c7a794f1fe4 tempest-VolumesSnapshotTestJSON-1089610052 tempest-VolumesSnapshotTestJSON-1089610052-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.988247 Oct 04 21:22:28.057909 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1040/2084] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:22:27 2022] POST /compute/v2.1/servers => generated 214 bytes in 991 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:25:19.550279 n-d-852085-12 devstack@n-api.service[123539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d5edc17b-4d95-44e5-91e5-59bc85f612b8] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 21:25:19.551265 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:19.553314 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:25:19.553584 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:25:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:25:19.555447 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:25:19.555967 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:25:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:25:19.557948 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:25:19.558429 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:25:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:25:20.217060 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7d22ab8e-ac06-4566-aed2-916e2110fa83 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] Action: 'create', calling method: .version_select at 0x7f77eea95e50>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1938209820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuaXnIOhKi3P8YuuJPPNfD8tD3wKbKFvWdJd9jSOkd/C6ocXtqetkf1kWdAmZx3WbhjsYiUWyLsYxN/WohAPSK88R808UkqkJKeqN5y8zQTGadf4XzN+IqNb6jfkQ4MZA=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:20.246395 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-7d22ab8e-ac06-4566-aed2-916e2110fa83 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] Getting quotas for project c1ea0b0d12fc499dad11f4c35209eb91. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:25:20.257281 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-7d22ab8e-ac06-4566-aed2-916e2110fa83 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] Getting quotas for user f4fc078c2ec240ae86abfe7c2882e900 and project c1ea0b0d12fc499dad11f4c35209eb91. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:25:20.416358 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7d22ab8e-ac06-4566-aed2-916e2110fa83 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.876707 Oct 04 21:25:20.424986 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1045/2085] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:25:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:26.433274 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:26.437015 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:25:26.437015 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:25:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 21:25:26.453864 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-422206a2-e5e2-4c8f-b7d4-7a461552bca8 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-25244086", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1938209820", "security_groups": [{"name": "tempest-secgroup-smoke-921917678"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "81b3a6ac-f2e2-482b-b52b-eba8b37600c8"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:26.724889 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-422206a2-e5e2-4c8f-b7d4-7a461552bca8 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] validate_networks() for [('81b3a6ac-f2e2-482b-b52b-eba8b37600c8', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-422206a2-e5e2-4c8f-b7d4-7a461552bca8 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-eb8f8f4d-1e5c-4282-9ec4-5014f31f722f) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:25:27.240126 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-eb8f8f4d-1e5c-4282-9ec4-5014f31f722f) Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-422206a2-e5e2-4c8f-b7d4-7a461552bca8 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:25:27.249841 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-422206a2-e5e2-4c8f-b7d4-7a461552bca8 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] Request method failure captured: Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 412 Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKSwVRztiofLw-3u-0Ouo59ukzOKNm3vfm7MTARxM1efIMcWkrodJOySuGzaWqfevpp0n2DbCRcsXsTldsM8kw5j3t4gH8f0IPjcp_gpYE0s6zel4GHVv9hLYljfckhGDb_v2R3rseffvic80gS2crFvo_sPIHKbt_Dd5Tx6rMU6Yrg Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: c1ea0b0d12fc499dad11f4c35209eb91 Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestServerBasicOps-520885855 Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c1ea0b0d12fc499dad11f4c35209eb91", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c1ea0b0d12fc499dad11f4c35209eb91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c1ea0b0d12fc499dad11f4c35209eb91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c1ea0b0d12fc499dad11f4c35209eb91"}]}] Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestServerBasicOps-520885855 Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: c1ea0b0d12fc499dad11f4c35209eb91 Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestServerBasicOps-520885855 Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestServerBasicOps-520885855-project Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: f4fc078c2ec240ae86abfe7c2882e900 Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestServerBasicOps-520885855-project Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-TestServerBasicOps-server-25244086", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1938209820", "security_groups": [{"name": "tempest-secgroup-smoke-921917678"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "81b3a6ac-f2e2-482b-b52b-eba8b37600c8"}]}} Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-TestServerBasicOps-server-25244086', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'key_name': 'tempest-TestServerBasicOps-1938209820', 'security_groups': [{'name': 'tempest-secgroup-smoke-921917678'}], 'config_drive': True, 'metadata': {'meta1': 'data1', 'meta2': 'data2', 'metaN': 'dataN'}, 'networks': [{'uuid': '81b3a6ac-f2e2-482b-b52b-eba8b37600c8'}]}}} Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:25:27.254910 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-eb8f8f4d-1e5c-4282-9ec4-5014f31f722f) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:25:27.263671 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-422206a2-e5e2-4c8f-b7d4-7a461552bca8 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-422206a2-e5e2-4c8f-b7d4-7a461552bca8 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.824623 Oct 04 21:25:27.271898 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1041/2086] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:25:26 2022] POST /compute/v2.1/servers => generated 214 bytes in 829 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:25:27.821534 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] [d5edc17b-4d95-44e5-91e5-59bc85f612b8] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58844. Oct 04 21:25:27.833357 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6c2b5f7f-955a-43eb-9fb8-4630b466c4a4 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] Calling method '.version_select at 0x7f77eeb36820>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:28.046789 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6c2b5f7f-955a-43eb-9fb8-4630b466c4a4 tempest-TestServerBasicOps-520885855 tempest-TestServerBasicOps-520885855-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1938209820" status: 202 len: 0 microversion: 2.1 time: 0.244085 Oct 04 21:25:28.047912 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1046/2087] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 4 21:25:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1938209820 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:26:01.609036 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-194539753", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:01.625888 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:01.721652 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] validate_networks() for None {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:26:02.043381 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Flavor limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:26:02.044325 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Image limits 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:26:02.045231 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Flavor pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:26:02.046002 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Image pref 0:0:0 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:26:02.046776 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.virt.hardware [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:26:02.065378 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:02.066312 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:02.067045 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:02.071968 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:02.073160 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:02.073983 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:02.115987 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Getting quotas for project 3554296c0d504bf1afa4e5bb65dba76a. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:26:02.128092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Getting quotas for user 437f84236b164941b2899041c73917bc and project 3554296c0d504bf1afa4e5bb65dba76a. Resources: {'cores', 'ram', 'instances'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:26:02.155752 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Going to run 1 instances... {{(pid=123540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:26:02.160733 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:26:02.324961 n-d-852085-12 devstack@n-api.service[123540]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [b8da489d-d71c-4dcb-b29b-50e43213488a] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:26:03.335477 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [b8da489d-d71c-4dcb-b29b-50e43213488a] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 59324. Oct 04 21:26:03.342682 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bf6a6a6d-6f0e-41b8-bda5-7b52af115632 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.742516 Oct 04 21:26:03.343883 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1042/2088] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:26:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:26:03.359972 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:03.362204 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:03.371564 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fc41f7cf-aa94-470c-b4ca-7339d14dc8ef tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:03.375602 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-fc41f7cf-aa94-470c-b4ca-7339d14dc8ef tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:03.861036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-fc41f7cf-aa94-470c-b4ca-7339d14dc8ef tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:03.873114 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fc41f7cf-aa94-470c-b4ca-7339d14dc8ef tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1214 microversion: 2.1 time: 0.515940 Oct 04 21:26:03.874382 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1047/2089] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:03 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1214 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:04.904929 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-150d04c4-2bcd-417a-a1da-d65160342ad6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:04.906067 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-150d04c4-2bcd-417a-a1da-d65160342ad6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:05.016973 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-150d04c4-2bcd-417a-a1da-d65160342ad6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:05.033183 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-150d04c4-2bcd-417a-a1da-d65160342ad6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1214 microversion: 2.1 time: 0.135160 Oct 04 21:26:05.034553 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1043/2090] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:04 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:06.075802 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-33bb87bb-68d0-4d39-8050-ab87852b2808 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:06.077077 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-33bb87bb-68d0-4d39-8050-ab87852b2808 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:06.182639 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-33bb87bb-68d0-4d39-8050-ab87852b2808 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:06.192246 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-33bb87bb-68d0-4d39-8050-ab87852b2808 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1214 microversion: 2.1 time: 0.124973 Oct 04 21:26:06.193001 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1048/2091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:06 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:07.224329 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f764f537-4f5e-4e82-9028-d44985daae68 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:07.225499 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f764f537-4f5e-4e82-9028-d44985daae68 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:07.328440 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f764f537-4f5e-4e82-9028-d44985daae68 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:07.346506 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f764f537-4f5e-4e82-9028-d44985daae68 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1214 microversion: 2.1 time: 0.129257 Oct 04 21:26:07.347958 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1044/2092] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:07 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:08.384137 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7feb13cf-fa0f-4311-b398-283d18aacf84 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:08.385251 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7feb13cf-fa0f-4311-b398-283d18aacf84 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:08.409390 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7feb13cf-fa0f-4311-b398-283d18aacf84 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:08.410204 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7feb13cf-fa0f-4311-b398-283d18aacf84 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:08.410875 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7feb13cf-fa0f-4311-b398-283d18aacf84 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:08.413610 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7feb13cf-fa0f-4311-b398-283d18aacf84 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:08.414472 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7feb13cf-fa0f-4311-b398-283d18aacf84 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:08.415232 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7feb13cf-fa0f-4311-b398-283d18aacf84 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:08.550899 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7feb13cf-fa0f-4311-b398-283d18aacf84 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:08.572757 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7feb13cf-fa0f-4311-b398-283d18aacf84 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1210 microversion: 2.1 time: 0.196429 Oct 04 21:26:08.573768 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1049/2093] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:08 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1210 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:09.611766 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-351cd92b-f544-4da1-88ce-9f6d151a005d tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:09.613914 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-351cd92b-f544-4da1-88ce-9f6d151a005d tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:09.639051 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-351cd92b-f544-4da1-88ce-9f6d151a005d tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:09.641304 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-351cd92b-f544-4da1-88ce-9f6d151a005d tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:09.644013 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-351cd92b-f544-4da1-88ce-9f6d151a005d tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:09.648313 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-351cd92b-f544-4da1-88ce-9f6d151a005d tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:09.649350 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-351cd92b-f544-4da1-88ce-9f6d151a005d tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:09.650106 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-351cd92b-f544-4da1-88ce-9f6d151a005d tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:09.857166 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-351cd92b-f544-4da1-88ce-9f6d151a005d tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:09.872563 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-351cd92b-f544-4da1-88ce-9f6d151a005d tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1284 microversion: 2.1 time: 0.273306 Oct 04 21:26:09.873607 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1045/2094] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:09 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1284 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:10.917012 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-b0fbbae4-df9f-4062-b767-8d55555928a6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:10.918078 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-b0fbbae4-df9f-4062-b767-8d55555928a6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:10.925779 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b0fbbae4-df9f-4062-b767-8d55555928a6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:10.926366 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b0fbbae4-df9f-4062-b767-8d55555928a6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:10.926857 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b0fbbae4-df9f-4062-b767-8d55555928a6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:10.927766 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b0fbbae4-df9f-4062-b767-8d55555928a6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:10.928278 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b0fbbae4-df9f-4062-b767-8d55555928a6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:10.928756 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-b0fbbae4-df9f-4062-b767-8d55555928a6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:11.026993 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-b0fbbae4-df9f-4062-b767-8d55555928a6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:11.040969 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-b0fbbae4-df9f-4062-b767-8d55555928a6 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1272 microversion: 2.1 time: 0.129943 Oct 04 21:26:11.041838 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1050/2095] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:10 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:12.081935 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-e9f3c90f-c1fb-4bcf-9300-e4ad9c5e6d80 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:12.083193 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-e9f3c90f-c1fb-4bcf-9300-e4ad9c5e6d80 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:12.095314 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e9f3c90f-c1fb-4bcf-9300-e4ad9c5e6d80 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:12.096627 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e9f3c90f-c1fb-4bcf-9300-e4ad9c5e6d80 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:12.097764 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e9f3c90f-c1fb-4bcf-9300-e4ad9c5e6d80 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:12.099355 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e9f3c90f-c1fb-4bcf-9300-e4ad9c5e6d80 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:12.100561 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e9f3c90f-c1fb-4bcf-9300-e4ad9c5e6d80 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:12.101735 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-e9f3c90f-c1fb-4bcf-9300-e4ad9c5e6d80 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:12.103327 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:12.395437 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-e9f3c90f-c1fb-4bcf-9300-e4ad9c5e6d80 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:12.411122 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-e9f3c90f-c1fb-4bcf-9300-e4ad9c5e6d80 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1314 microversion: 2.1 time: 0.337800 Oct 04 21:26:12.472577 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1046/2096] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:12 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:13.276982 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-1cb537a2-419c-4e56-a809-1839b986ac79 req-213c4751-460b-4689-b5ab-146a48d0d4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63447013-ba5e-4665-a929-9f5e42de0ba4", "tag": "85e05b4d-765b-4e20-bb8a-14fe600f6d16"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:13.309052 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-1cb537a2-419c-4e56-a809-1839b986ac79 req-213c4751-460b-4689-b5ab-146a48d0d4f1 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:13.310813 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-1cb537a2-419c-4e56-a809-1839b986ac79 req-213c4751-460b-4689-b5ab-146a48d0d4f1 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:13.311781 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-1cb537a2-419c-4e56-a809-1839b986ac79 req-213c4751-460b-4689-b5ab-146a48d0d4f1 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:13.334399 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-1cb537a2-419c-4e56-a809-1839b986ac79 req-213c4751-460b-4689-b5ab-146a48d0d4f1 service nova] Creating event network-changed:85e05b4d-765b-4e20-bb8a-14fe600f6d16 for instance 63447013-ba5e-4665-a929-9f5e42de0ba4 on n-h1-852085-12 Oct 04 21:26:13.345988 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-1cb537a2-419c-4e56-a809-1839b986ac79 req-213c4751-460b-4689-b5ab-146a48d0d4f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234703 Oct 04 21:26:13.347277 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1051/2097] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:13.463701 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-deebe5d6-08fc-474b-9f2d-898b7fba0b39 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:13.466036 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-deebe5d6-08fc-474b-9f2d-898b7fba0b39 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:13.478267 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-deebe5d6-08fc-474b-9f2d-898b7fba0b39 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:13.480240 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-deebe5d6-08fc-474b-9f2d-898b7fba0b39 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:13.481317 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-deebe5d6-08fc-474b-9f2d-898b7fba0b39 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:13.482828 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-deebe5d6-08fc-474b-9f2d-898b7fba0b39 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:13.483930 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-deebe5d6-08fc-474b-9f2d-898b7fba0b39 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:13.484725 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-deebe5d6-08fc-474b-9f2d-898b7fba0b39 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:13.730882 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-deebe5d6-08fc-474b-9f2d-898b7fba0b39 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:13.749917 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-deebe5d6-08fc-474b-9f2d-898b7fba0b39 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1314 microversion: 2.1 time: 0.294610 Oct 04 21:26:13.752151 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1047/2098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:13 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:14.801779 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-a0650012-f20f-4e1d-95b1-f32035135611 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:14.803383 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-a0650012-f20f-4e1d-95b1-f32035135611 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:14.816924 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a0650012-f20f-4e1d-95b1-f32035135611 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:14.817927 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a0650012-f20f-4e1d-95b1-f32035135611 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:14.818787 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a0650012-f20f-4e1d-95b1-f32035135611 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:14.820546 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a0650012-f20f-4e1d-95b1-f32035135611 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:14.821630 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a0650012-f20f-4e1d-95b1-f32035135611 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:14.822872 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-a0650012-f20f-4e1d-95b1-f32035135611 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:15.088192 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-a0650012-f20f-4e1d-95b1-f32035135611 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:15.103878 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-a0650012-f20f-4e1d-95b1-f32035135611 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1314 microversion: 2.1 time: 0.312114 Oct 04 21:26:15.104774 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1052/2099] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:14 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:16.145442 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-22eb4a5b-4de6-4a36-b007-189d4002a296 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:16.146641 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-22eb4a5b-4de6-4a36-b007-189d4002a296 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:16.160342 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-22eb4a5b-4de6-4a36-b007-189d4002a296 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.163506 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-22eb4a5b-4de6-4a36-b007-189d4002a296 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.163506 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-22eb4a5b-4de6-4a36-b007-189d4002a296 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.163905 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-22eb4a5b-4de6-4a36-b007-189d4002a296 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.164765 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-22eb4a5b-4de6-4a36-b007-189d4002a296 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.165575 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-22eb4a5b-4de6-4a36-b007-189d4002a296 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.455664 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-22eb4a5b-4de6-4a36-b007-189d4002a296 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:16.475661 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-22eb4a5b-4de6-4a36-b007-189d4002a296 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1314 microversion: 2.1 time: 0.339762 Oct 04 21:26:16.478037 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1048/2100] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:16 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:17.521858 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-f810bc2c-a4ad-4bf0-8b04-f12ec400a3a9 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:17.523024 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-f810bc2c-a4ad-4bf0-8b04-f12ec400a3a9 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:17.529509 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:17.541687 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f810bc2c-a4ad-4bf0-8b04-f12ec400a3a9 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:17.542783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f810bc2c-a4ad-4bf0-8b04-f12ec400a3a9 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:17.543632 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f810bc2c-a4ad-4bf0-8b04-f12ec400a3a9 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:17.545061 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f810bc2c-a4ad-4bf0-8b04-f12ec400a3a9 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:17.546090 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f810bc2c-a4ad-4bf0-8b04-f12ec400a3a9 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:17.546901 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-f810bc2c-a4ad-4bf0-8b04-f12ec400a3a9 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:17.826957 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-f810bc2c-a4ad-4bf0-8b04-f12ec400a3a9 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:17.842679 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-f810bc2c-a4ad-4bf0-8b04-f12ec400a3a9 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1314 microversion: 2.1 time: 0.330995 Oct 04 21:26:17.846076 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1053/2101] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:17 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:18.884505 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a07cd149-c97a-458d-88ed-12a88784f03c tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:18.885764 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a07cd149-c97a-458d-88ed-12a88784f03c tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:18.889150 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=10 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:18.898403 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a07cd149-c97a-458d-88ed-12a88784f03c tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:18.900489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a07cd149-c97a-458d-88ed-12a88784f03c tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:18.900489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a07cd149-c97a-458d-88ed-12a88784f03c tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:18.901061 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a07cd149-c97a-458d-88ed-12a88784f03c tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:18.901881 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a07cd149-c97a-458d-88ed-12a88784f03c tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:18.902678 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a07cd149-c97a-458d-88ed-12a88784f03c tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:19.176875 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a07cd149-c97a-458d-88ed-12a88784f03c tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:19.193747 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a07cd149-c97a-458d-88ed-12a88784f03c tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1314 microversion: 2.1 time: 0.315235 Oct 04 21:26:19.194859 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1049/2102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:18 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:19.832231 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-01670738-ffde-4c90-8d9b-d4bd8eb91d3a req-c9842b30-6292-4d6e-8a51-7e0d8001cdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63447013-ba5e-4665-a929-9f5e42de0ba4", "name": "network-vif-plugged", "status": "completed", "tag": "85e05b4d-765b-4e20-bb8a-14fe600f6d16"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:19.846654 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-01670738-ffde-4c90-8d9b-d4bd8eb91d3a req-c9842b30-6292-4d6e-8a51-7e0d8001cdc2 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:19.847455 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-01670738-ffde-4c90-8d9b-d4bd8eb91d3a req-c9842b30-6292-4d6e-8a51-7e0d8001cdc2 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:19.848424 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-01670738-ffde-4c90-8d9b-d4bd8eb91d3a req-c9842b30-6292-4d6e-8a51-7e0d8001cdc2 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:19.872341 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-01670738-ffde-4c90-8d9b-d4bd8eb91d3a req-c9842b30-6292-4d6e-8a51-7e0d8001cdc2 service nova] Creating event network-vif-plugged:85e05b4d-765b-4e20-bb8a-14fe600f6d16 for instance 63447013-ba5e-4665-a929-9f5e42de0ba4 on n-h1-852085-12 Oct 04 21:26:19.881918 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-01670738-ffde-4c90-8d9b-d4bd8eb91d3a req-c9842b30-6292-4d6e-8a51-7e0d8001cdc2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173034 Oct 04 21:26:19.883782 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1054/2103] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:20.239452 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-53e040db-fc8e-42de-a9ca-f5b7d9492121 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:20.245227 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-53e040db-fc8e-42de-a9ca-f5b7d9492121 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:20.252734 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-53e040db-fc8e-42de-a9ca-f5b7d9492121 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:20.253684 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-53e040db-fc8e-42de-a9ca-f5b7d9492121 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:20.254453 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-53e040db-fc8e-42de-a9ca-f5b7d9492121 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:20.255731 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-53e040db-fc8e-42de-a9ca-f5b7d9492121 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:20.256600 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-53e040db-fc8e-42de-a9ca-f5b7d9492121 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:20.257396 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-53e040db-fc8e-42de-a9ca-f5b7d9492121 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:20.546568 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-53e040db-fc8e-42de-a9ca-f5b7d9492121 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:20.561940 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-53e040db-fc8e-42de-a9ca-f5b7d9492121 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1314 microversion: 2.1 time: 0.329872 Oct 04 21:26:20.565403 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1050/2104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:20 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:21.615372 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-87540c7f-7219-499f-91af-30a11d840a4e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:21.616477 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-87540c7f-7219-499f-91af-30a11d840a4e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:21.630794 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87540c7f-7219-499f-91af-30a11d840a4e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:21.631753 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87540c7f-7219-499f-91af-30a11d840a4e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:21.632681 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87540c7f-7219-499f-91af-30a11d840a4e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:21.634087 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87540c7f-7219-499f-91af-30a11d840a4e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:21.635172 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87540c7f-7219-499f-91af-30a11d840a4e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:21.635962 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-87540c7f-7219-499f-91af-30a11d840a4e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:22.000834 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-87540c7f-7219-499f-91af-30a11d840a4e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:22.016801 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-87540c7f-7219-499f-91af-30a11d840a4e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1314 microversion: 2.1 time: 0.416676 Oct 04 21:26:22.021608 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1055/2105] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:21 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:23.055498 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7fc25da5-6a0c-4013-95ed-3e477398389e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:23.056330 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-7fc25da5-6a0c-4013-95ed-3e477398389e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:23.065002 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7fc25da5-6a0c-4013-95ed-3e477398389e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:23.065555 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7fc25da5-6a0c-4013-95ed-3e477398389e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:23.066146 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7fc25da5-6a0c-4013-95ed-3e477398389e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:23.067000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7fc25da5-6a0c-4013-95ed-3e477398389e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:23.067565 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7fc25da5-6a0c-4013-95ed-3e477398389e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:23.068355 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-7fc25da5-6a0c-4013-95ed-3e477398389e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:23.331887 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-7fc25da5-6a0c-4013-95ed-3e477398389e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:23.347058 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7fc25da5-6a0c-4013-95ed-3e477398389e tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1463 microversion: 2.1 time: 0.296028 Oct 04 21:26:23.348228 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1051/2106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:23 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1463 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:23.436761 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d3e120c9-a831-4831-89aa-3df1e6d6e879 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:23.437692 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d3e120c9-a831-4831-89aa-3df1e6d6e879 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:23.450145 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d3e120c9-a831-4831-89aa-3df1e6d6e879 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:23.451092 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d3e120c9-a831-4831-89aa-3df1e6d6e879 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:23.451978 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d3e120c9-a831-4831-89aa-3df1e6d6e879 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:23.453367 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d3e120c9-a831-4831-89aa-3df1e6d6e879 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:23.454510 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d3e120c9-a831-4831-89aa-3df1e6d6e879 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:23.455346 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-d3e120c9-a831-4831-89aa-3df1e6d6e879 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:23.506700 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d3e120c9-a831-4831-89aa-3df1e6d6e879 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Going to try to terminate instance {{(pid=123539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:26:23.971940 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d3e120c9-a831-4831-89aa-3df1e6d6e879 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "DELETE /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 204 len: 0 microversion: 2.1 time: 0.542026 Oct 04 21:26:23.973062 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1056/2107] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 21:26:23 2022] DELETE /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:26:23.988706 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-965f1c1b-b929-42ed-be4e-980e8e889425 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:23.990209 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-965f1c1b-b929-42ed-be4e-980e8e889425 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:24.002728 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-965f1c1b-b929-42ed-be4e-980e8e889425 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:24.003712 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-965f1c1b-b929-42ed-be4e-980e8e889425 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:24.004526 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-965f1c1b-b929-42ed-be4e-980e8e889425 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:24.005967 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-965f1c1b-b929-42ed-be4e-980e8e889425 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:24.006848 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-965f1c1b-b929-42ed-be4e-980e8e889425 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:24.007777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-965f1c1b-b929-42ed-be4e-980e8e889425 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:24.250376 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-965f1c1b-b929-42ed-be4e-980e8e889425 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:24.266895 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-965f1c1b-b929-42ed-be4e-980e8e889425 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1469 microversion: 2.1 time: 0.286513 Oct 04 21:26:24.268067 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1052/2108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:23 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1469 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:25.315340 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-fe0ab163-4dbc-4bfd-9fb3-703289fa6b78 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:25.316371 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-fe0ab163-4dbc-4bfd-9fb3-703289fa6b78 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:25.328160 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fe0ab163-4dbc-4bfd-9fb3-703289fa6b78 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:25.329039 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fe0ab163-4dbc-4bfd-9fb3-703289fa6b78 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:25.329783 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fe0ab163-4dbc-4bfd-9fb3-703289fa6b78 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:25.331110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fe0ab163-4dbc-4bfd-9fb3-703289fa6b78 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:25.331881 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fe0ab163-4dbc-4bfd-9fb3-703289fa6b78 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:25.332554 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-fe0ab163-4dbc-4bfd-9fb3-703289fa6b78 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:25.601134 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-fe0ab163-4dbc-4bfd-9fb3-703289fa6b78 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:25.615099 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-fe0ab163-4dbc-4bfd-9fb3-703289fa6b78 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1469 microversion: 2.1 time: 0.307954 Oct 04 21:26:25.617285 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1057/2109] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:25 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1469 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:26.619054 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-c919d8d2-5c43-4f5d-a727-97e286576287 req-419659d7-8802-417a-8c72-fc88da742189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63447013-ba5e-4665-a929-9f5e42de0ba4", "name": "network-vif-deleted", "tag": "85e05b4d-765b-4e20-bb8a-14fe600f6d16"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:26.639674 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-c919d8d2-5c43-4f5d-a727-97e286576287 req-419659d7-8802-417a-8c72-fc88da742189 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:26.640650 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-c919d8d2-5c43-4f5d-a727-97e286576287 req-419659d7-8802-417a-8c72-fc88da742189 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.641368 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-c919d8d2-5c43-4f5d-a727-97e286576287 req-419659d7-8802-417a-8c72-fc88da742189 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.658538 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cf279696-4d52-4e3b-bb8b-8b19ced6cd30 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:26.659745 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cf279696-4d52-4e3b-bb8b-8b19ced6cd30 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:26.668795 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-c919d8d2-5c43-4f5d-a727-97e286576287 req-419659d7-8802-417a-8c72-fc88da742189 service nova] Creating event network-vif-deleted:85e05b4d-765b-4e20-bb8a-14fe600f6d16 for instance 63447013-ba5e-4665-a929-9f5e42de0ba4 on n-h1-852085-12 Oct 04 21:26:26.676430 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cf279696-4d52-4e3b-bb8b-8b19ced6cd30 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:26.677076 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cf279696-4d52-4e3b-bb8b-8b19ced6cd30 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.677353 n-d-852085-12 devstack@n-api.service[123540]: ERROR oslo.messaging._drivers.impl_rabbit [req-c919d8d2-5c43-4f5d-a727-97e286576287 req-419659d7-8802-417a-8c72-fc88da742189 service nova] [ae17015a-107b-41c6-aa6b-06f867a0bc32] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:26:26.677810 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cf279696-4d52-4e3b-bb8b-8b19ced6cd30 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.679530 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cf279696-4d52-4e3b-bb8b-8b19ced6cd30 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:26.680607 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cf279696-4d52-4e3b-bb8b-8b19ced6cd30 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.697009 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cf279696-4d52-4e3b-bb8b-8b19ced6cd30 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.797536 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-cf279696-4d52-4e3b-bb8b-8b19ced6cd30 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:26.815845 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cf279696-4d52-4e3b-bb8b-8b19ced6cd30 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1427 microversion: 2.1 time: 0.161963 Oct 04 21:26:26.816942 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1058/2110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:26 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1427 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:27.697528 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [req-c919d8d2-5c43-4f5d-a727-97e286576287 req-419659d7-8802-417a-8c72-fc88da742189 service nova] [ae17015a-107b-41c6-aa6b-06f867a0bc32] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 59714. Oct 04 21:26:27.704733 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-c919d8d2-5c43-4f5d-a727-97e286576287 req-419659d7-8802-417a-8c72-fc88da742189 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.098379 Oct 04 21:26:27.712117 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1053/2111] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:27.862217 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:27.863464 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:27.876191 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.877040 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.877774 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.879260 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.885781 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.885781 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.947223 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.948118 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.948943 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.949777 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lazy-loading 'fault' on Instance uuid 63447013-ba5e-4665-a929-9f5e42de0ba4 {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:26:28.030289 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437f84236b164941b2899041c73917bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3554296c0d504bf1afa4e5bb65dba76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:28.048443 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-17efd0e8-dea9-4c43-8a69-a97efe30dd18 tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 200 len: 1304 microversion: 2.1 time: 0.193521 Oct 04 21:26:28.052099 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1059/2112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:27 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 1304 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:29.094464 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-49fc5748-5e11-4582-a1ff-086870cbafdd tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:29.095934 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-49fc5748-5e11-4582-a1ff-086870cbafdd tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] [instance: 63447013-ba5e-4665-a929-9f5e42de0ba4] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:29.108692 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49fc5748-5e11-4582-a1ff-086870cbafdd tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:29.110056 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49fc5748-5e11-4582-a1ff-086870cbafdd tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:29.111543 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49fc5748-5e11-4582-a1ff-086870cbafdd tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:29.113470 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49fc5748-5e11-4582-a1ff-086870cbafdd tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:29.114647 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49fc5748-5e11-4582-a1ff-086870cbafdd tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:29.115461 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-49fc5748-5e11-4582-a1ff-086870cbafdd tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:29.147603 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-49fc5748-5e11-4582-a1ff-086870cbafdd tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] HTTP exception thrown: Instance 63447013-ba5e-4665-a929-9f5e42de0ba4 could not be found. Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-49fc5748-5e11-4582-a1ff-086870cbafdd tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Request method failure captured: Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 HTTP/1.1 Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKTl5J3o1ghXCd7TSY4d-uRZppm51a5dagXP7a-UL8NrINUvsbvdMG_b4sWv0kxvJvh2vWyZ9b7xgpZpy_zJ4ppJZa-vSqnJ9Cd2QGbcpOkSjq5uKkTWlgDgV-HxDlx50oQHz9zFi7zZMGoyf1sHbqv5CSYviYnf9w06YEA2M6sOd_M Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 3554296c0d504bf1afa4e5bb65dba76a Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-VolumesNegativeTest-228047462 Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3554296c0d504bf1afa4e5bb65dba76a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3554296c0d504bf1afa4e5bb65dba76a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3554296c0d504bf1afa4e5bb65dba76a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3554296c0d504bf1afa4e5bb65dba76a"}]}] Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-VolumesNegativeTest-228047462 Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 3554296c0d504bf1afa4e5bb65dba76a Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-VolumesNegativeTest-228047462 Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-VolumesNegativeTest-228047462-project Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 437f84236b164941b2899041c73917bc Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-VolumesNegativeTest-228047462-project Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 63447013-ba5e-4665-a929-9f5e42de0ba4 could not be found. Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '63447013-ba5e-4665-a929-9f5e42de0ba4'} Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63447013-ba5e-4665-a929-9f5e42de0ba4 could not be found. Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63447013-ba5e-4665-a929-9f5e42de0ba4 could not be found. Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:29.150953 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:26:29.162733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:29.162733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:29.162733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:29.162733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:26:29.162733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:26:29.162733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63447013-ba5e-4665-a929-9f5e42de0ba4 could not be found. Oct 04 21:26:29.162733 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:26:29.162733 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-49fc5748-5e11-4582-a1ff-086870cbafdd tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] Returning 404 to user: Instance 63447013-ba5e-4665-a929-9f5e42de0ba4 could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:26:29.162733 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-49fc5748-5e11-4582-a1ff-086870cbafdd tempest-VolumesNegativeTest-228047462 tempest-VolumesNegativeTest-228047462-project] 10.222.0.78 "GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4" status: 404 len: 111 microversion: 2.1 time: 0.068406 Oct 04 21:26:29.162733 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1054/2113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:29 2022] GET /compute/v2.1/servers/63447013-ba5e-4665-a929-9f5e42de0ba4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:27:05.430667 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:05.432213 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:05.665477 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-652763544", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:05.768499 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] validate_networks() for None {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:27:06.160013 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Flavor limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:27:06.160792 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Image limits 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:27:06.161750 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Flavor pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:27:06.162547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Image pref 0:0:0 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:27:06.163480 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.virt.hardware [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:27:06.181623 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:06.183019 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:06.188406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:06.188406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:06.188406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:06.188406 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:06.222802 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Getting quotas for project 49486f6954e340efbf04c7b4ae8098fb. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:27:06.234928 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Getting quotas for user 48eda3a284964e5785742149f90b2477 and project 49486f6954e340efbf04c7b4ae8098fb. Resources: {'cores', 'ram', 'instances'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:27:06.267759 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Going to run 1 instances... {{(pid=123539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:27:06.272607 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72e89793-9b3c-463e-96d2-f69d6ab1a9d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:27:06.512622 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-cd5543d5-abdc-4cdd-a9d2-3eaa9ead7e36 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091034 Oct 04 21:27:06.513788 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1060/2114] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:27:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:27:06.539039 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-151fcbaf-65ee-4eef-906c-fdd32c6770a1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:06.541567 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-151fcbaf-65ee-4eef-906c-fdd32c6770a1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:06.551955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:06.552420 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=54 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:06.657000 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-151fcbaf-65ee-4eef-906c-fdd32c6770a1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:06.671942 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-151fcbaf-65ee-4eef-906c-fdd32c6770a1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1221 microversion: 2.1 time: 0.140629 Oct 04 21:27:06.673263 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1055/2115] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:06 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1221 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:07.717026 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d2e7e458-ef97-4795-9bed-88d169cb8ae0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:07.719241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-d2e7e458-ef97-4795-9bed-88d169cb8ae0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:07.823661 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-d2e7e458-ef97-4795-9bed-88d169cb8ae0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:07.846647 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d2e7e458-ef97-4795-9bed-88d169cb8ae0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1221 microversion: 2.1 time: 0.130119 Oct 04 21:27:07.846647 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1061/2116] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:07 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:08.889758 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4e394fd7-03b3-4221-97f3-61cd2db8c3d0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:08.890840 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4e394fd7-03b3-4221-97f3-61cd2db8c3d0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:08.907489 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e394fd7-03b3-4221-97f3-61cd2db8c3d0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:08.908552 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e394fd7-03b3-4221-97f3-61cd2db8c3d0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:08.909662 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e394fd7-03b3-4221-97f3-61cd2db8c3d0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:08.911028 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e394fd7-03b3-4221-97f3-61cd2db8c3d0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:08.912092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e394fd7-03b3-4221-97f3-61cd2db8c3d0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:08.912982 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4e394fd7-03b3-4221-97f3-61cd2db8c3d0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:09.037759 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4e394fd7-03b3-4221-97f3-61cd2db8c3d0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:09.054771 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4e394fd7-03b3-4221-97f3-61cd2db8c3d0 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1225 microversion: 2.1 time: 0.173538 Oct 04 21:27:09.055878 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1056/2117] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:08 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:10.097730 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-20e5e828-3989-4bd0-b082-d66ac7a30454 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:10.098712 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-20e5e828-3989-4bd0-b082-d66ac7a30454 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:10.109526 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20e5e828-3989-4bd0-b082-d66ac7a30454 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:10.110263 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20e5e828-3989-4bd0-b082-d66ac7a30454 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:10.110890 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20e5e828-3989-4bd0-b082-d66ac7a30454 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:10.111789 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20e5e828-3989-4bd0-b082-d66ac7a30454 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:10.112417 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20e5e828-3989-4bd0-b082-d66ac7a30454 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:10.113056 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-20e5e828-3989-4bd0-b082-d66ac7a30454 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:10.196329 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-20e5e828-3989-4bd0-b082-d66ac7a30454 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:10.207123 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-20e5e828-3989-4bd0-b082-d66ac7a30454 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1273 microversion: 2.1 time: 0.116503 Oct 04 21:27:10.207824 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1062/2118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:10 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:11.233955 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f280e0c2-0be4-4baa-92e9-ae9a5f8204fa tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:11.234608 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f280e0c2-0be4-4baa-92e9-ae9a5f8204fa tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:11.241761 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f280e0c2-0be4-4baa-92e9-ae9a5f8204fa tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:11.242298 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f280e0c2-0be4-4baa-92e9-ae9a5f8204fa tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:11.242777 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f280e0c2-0be4-4baa-92e9-ae9a5f8204fa tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:11.243554 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f280e0c2-0be4-4baa-92e9-ae9a5f8204fa tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:11.244016 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f280e0c2-0be4-4baa-92e9-ae9a5f8204fa tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:11.244451 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f280e0c2-0be4-4baa-92e9-ae9a5f8204fa tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:11.325507 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f280e0c2-0be4-4baa-92e9-ae9a5f8204fa tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:11.335942 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f280e0c2-0be4-4baa-92e9-ae9a5f8204fa tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1279 microversion: 2.1 time: 0.106389 Oct 04 21:27:11.336956 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1057/2119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:11 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1279 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:12.378407 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ebadb8ce-72b5-491d-af6f-934b9efb5d9c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:12.380811 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ebadb8ce-72b5-491d-af6f-934b9efb5d9c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:12.397497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ebadb8ce-72b5-491d-af6f-934b9efb5d9c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:12.397497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ebadb8ce-72b5-491d-af6f-934b9efb5d9c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:12.398274 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ebadb8ce-72b5-491d-af6f-934b9efb5d9c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:12.400338 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ebadb8ce-72b5-491d-af6f-934b9efb5d9c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:12.401180 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ebadb8ce-72b5-491d-af6f-934b9efb5d9c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:12.402224 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ebadb8ce-72b5-491d-af6f-934b9efb5d9c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:12.671021 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ebadb8ce-72b5-491d-af6f-934b9efb5d9c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:12.688510 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ebadb8ce-72b5-491d-af6f-934b9efb5d9c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1321 microversion: 2.1 time: 0.318165 Oct 04 21:27:12.690348 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1063/2120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:12 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:13.728628 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-ea1a5f5f-8b3a-4195-a218-6271c96dafae tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:13.730082 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-ea1a5f5f-8b3a-4195-a218-6271c96dafae tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:13.738739 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-ce495f6c-160c-4264-bbad-b649754e8831 req-55cc6435-9921-4c4b-92bd-db497d67edfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260be7b2-1bfe-4b9c-b3c2-914d3274dcdf", "tag": "5815ef59-98a3-4877-800b-df28baf43ee7"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:13.759271 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-ce495f6c-160c-4264-bbad-b649754e8831 req-55cc6435-9921-4c4b-92bd-db497d67edfe service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:13.760895 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ea1a5f5f-8b3a-4195-a218-6271c96dafae tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:13.761137 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-ce495f6c-160c-4264-bbad-b649754e8831 req-55cc6435-9921-4c4b-92bd-db497d67edfe service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:13.761989 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-ce495f6c-160c-4264-bbad-b649754e8831 req-55cc6435-9921-4c4b-92bd-db497d67edfe service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:13.762209 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ea1a5f5f-8b3a-4195-a218-6271c96dafae tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:13.762873 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ea1a5f5f-8b3a-4195-a218-6271c96dafae tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:13.764304 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ea1a5f5f-8b3a-4195-a218-6271c96dafae tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:13.765120 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ea1a5f5f-8b3a-4195-a218-6271c96dafae tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:13.765838 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-ea1a5f5f-8b3a-4195-a218-6271c96dafae tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:13.785833 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-ce495f6c-160c-4264-bbad-b649754e8831 req-55cc6435-9921-4c4b-92bd-db497d67edfe service nova] Creating event network-changed:5815ef59-98a3-4877-800b-df28baf43ee7 for instance 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf on n-h1-852085-12 Oct 04 21:27:13.797440 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-ce495f6c-160c-4264-bbad-b649754e8831 req-55cc6435-9921-4c4b-92bd-db497d67edfe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077852 Oct 04 21:27:13.798796 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1058/2121] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:14.035638 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-ea1a5f5f-8b3a-4195-a218-6271c96dafae tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:14.050890 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-ea1a5f5f-8b3a-4195-a218-6271c96dafae tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1321 microversion: 2.1 time: 0.329611 Oct 04 21:27:14.051970 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1064/2122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:13 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:15.090792 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-094e01a6-dfaf-4763-be29-3ee54589256e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:15.092281 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-094e01a6-dfaf-4763-be29-3ee54589256e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:15.101240 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-094e01a6-dfaf-4763-be29-3ee54589256e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:15.101967 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-094e01a6-dfaf-4763-be29-3ee54589256e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:15.102539 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-094e01a6-dfaf-4763-be29-3ee54589256e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:15.103674 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-094e01a6-dfaf-4763-be29-3ee54589256e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:15.104827 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-094e01a6-dfaf-4763-be29-3ee54589256e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:15.105397 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-094e01a6-dfaf-4763-be29-3ee54589256e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:15.309674 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-094e01a6-dfaf-4763-be29-3ee54589256e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:15.325286 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-094e01a6-dfaf-4763-be29-3ee54589256e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1321 microversion: 2.1 time: 0.239926 Oct 04 21:27:15.326429 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1059/2123] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:15 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:16.358144 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5b97a9fd-7585-4186-8a8e-3894e4e915b3 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:16.359254 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-5b97a9fd-7585-4186-8a8e-3894e4e915b3 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:16.363738 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:16.373366 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5b97a9fd-7585-4186-8a8e-3894e4e915b3 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.376344 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5b97a9fd-7585-4186-8a8e-3894e4e915b3 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.376344 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5b97a9fd-7585-4186-8a8e-3894e4e915b3 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.376344 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5b97a9fd-7585-4186-8a8e-3894e4e915b3 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.377297 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5b97a9fd-7585-4186-8a8e-3894e4e915b3 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.378063 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5b97a9fd-7585-4186-8a8e-3894e4e915b3 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.592323 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5b97a9fd-7585-4186-8a8e-3894e4e915b3 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:16.606460 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5b97a9fd-7585-4186-8a8e-3894e4e915b3 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1321 microversion: 2.1 time: 0.256100 Oct 04 21:27:16.607463 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1065/2124] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:16 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:17.651074 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f1e2e2ff-2c18-466d-96f4-a0fbd50f7da2 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:17.652418 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f1e2e2ff-2c18-466d-96f4-a0fbd50f7da2 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:17.656408 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:17.666562 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1e2e2ff-2c18-466d-96f4-a0fbd50f7da2 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.681666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1e2e2ff-2c18-466d-96f4-a0fbd50f7da2 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.681666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1e2e2ff-2c18-466d-96f4-a0fbd50f7da2 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:17.681666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1e2e2ff-2c18-466d-96f4-a0fbd50f7da2 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.681666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1e2e2ff-2c18-466d-96f4-a0fbd50f7da2 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.681666 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f1e2e2ff-2c18-466d-96f4-a0fbd50f7da2 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:17.922151 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-f1e2e2ff-2c18-466d-96f4-a0fbd50f7da2 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:17.932528 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f1e2e2ff-2c18-466d-96f4-a0fbd50f7da2 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1321 microversion: 2.1 time: 0.288802 Oct 04 21:27:17.933320 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1060/2125] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:17 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:18.977857 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-81287839-07dd-4362-8566-d34bed58c526 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:18.979430 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-81287839-07dd-4362-8566-d34bed58c526 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:18.984147 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=8 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:18.993133 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-81287839-07dd-4362-8566-d34bed58c526 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:18.997968 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-81287839-07dd-4362-8566-d34bed58c526 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:18.997968 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-81287839-07dd-4362-8566-d34bed58c526 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:18.997968 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-81287839-07dd-4362-8566-d34bed58c526 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:18.997968 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-81287839-07dd-4362-8566-d34bed58c526 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:18.998722 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-81287839-07dd-4362-8566-d34bed58c526 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:19.260817 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-81287839-07dd-4362-8566-d34bed58c526 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:19.277358 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-81287839-07dd-4362-8566-d34bed58c526 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1321 microversion: 2.1 time: 0.307522 Oct 04 21:27:19.283907 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1066/2126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:18 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:20.310053 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-a7cb657d-29e9-4e26-bee0-00842137cd9a tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:20.311400 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-a7cb657d-29e9-4e26-bee0-00842137cd9a tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:20.322992 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a7cb657d-29e9-4e26-bee0-00842137cd9a tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.324095 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a7cb657d-29e9-4e26-bee0-00842137cd9a tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.324729 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a7cb657d-29e9-4e26-bee0-00842137cd9a tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.326040 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a7cb657d-29e9-4e26-bee0-00842137cd9a tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.326922 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a7cb657d-29e9-4e26-bee0-00842137cd9a tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.327717 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-a7cb657d-29e9-4e26-bee0-00842137cd9a tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.590585 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-a7cb657d-29e9-4e26-bee0-00842137cd9a tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:20.608600 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-a7cb657d-29e9-4e26-bee0-00842137cd9a tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1321 microversion: 2.1 time: 0.305976 Oct 04 21:27:20.609692 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1061/2127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:20 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:21.654112 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7b0af02e-287d-4b02-90de-d26bd9a28f1e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:21.655638 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-7b0af02e-287d-4b02-90de-d26bd9a28f1e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:21.669773 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7b0af02e-287d-4b02-90de-d26bd9a28f1e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:21.670471 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7b0af02e-287d-4b02-90de-d26bd9a28f1e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:21.671375 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7b0af02e-287d-4b02-90de-d26bd9a28f1e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:21.675036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7b0af02e-287d-4b02-90de-d26bd9a28f1e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:21.675036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7b0af02e-287d-4b02-90de-d26bd9a28f1e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:21.675036 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-7b0af02e-287d-4b02-90de-d26bd9a28f1e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:21.864447 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [req-6a34a50a-c1aa-434a-827d-93df4951cc8f req-cb9499b8-4d71-402c-b2bd-e9b8ea662721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260be7b2-1bfe-4b9c-b3c2-914d3274dcdf", "name": "network-vif-plugged", "status": "completed", "tag": "5815ef59-98a3-4877-800b-df28baf43ee7"}]} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:21.888347 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-6a34a50a-c1aa-434a-827d-93df4951cc8f req-cb9499b8-4d71-402c-b2bd-e9b8ea662721 service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:21.889443 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-6a34a50a-c1aa-434a-827d-93df4951cc8f req-cb9499b8-4d71-402c-b2bd-e9b8ea662721 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:21.890322 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [req-6a34a50a-c1aa-434a-827d-93df4951cc8f req-cb9499b8-4d71-402c-b2bd-e9b8ea662721 service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:21.915003 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.compute.server_external_events [req-6a34a50a-c1aa-434a-827d-93df4951cc8f req-cb9499b8-4d71-402c-b2bd-e9b8ea662721 service nova] Creating event network-vif-plugged:5815ef59-98a3-4877-800b-df28baf43ee7 for instance 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf on n-h1-852085-12 Oct 04 21:27:21.926054 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [req-6a34a50a-c1aa-434a-827d-93df4951cc8f req-cb9499b8-4d71-402c-b2bd-e9b8ea662721 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072859 Oct 04 21:27:21.927396 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1062/2128] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:21.940441 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-7b0af02e-287d-4b02-90de-d26bd9a28f1e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:21.957000 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7b0af02e-287d-4b02-90de-d26bd9a28f1e tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1321 microversion: 2.1 time: 0.310492 Oct 04 21:27:21.958271 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1067/2129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:21 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:23.004617 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4feb25dd-c9ab-4d68-ac1d-68d8e6de6d2b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:23.006109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-4feb25dd-c9ab-4d68-ac1d-68d8e6de6d2b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:23.019028 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4feb25dd-c9ab-4d68-ac1d-68d8e6de6d2b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:23.019982 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4feb25dd-c9ab-4d68-ac1d-68d8e6de6d2b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:23.020773 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4feb25dd-c9ab-4d68-ac1d-68d8e6de6d2b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:23.022087 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4feb25dd-c9ab-4d68-ac1d-68d8e6de6d2b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:23.022969 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4feb25dd-c9ab-4d68-ac1d-68d8e6de6d2b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:23.023761 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-4feb25dd-c9ab-4d68-ac1d-68d8e6de6d2b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:23.300046 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-4feb25dd-c9ab-4d68-ac1d-68d8e6de6d2b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:23.316224 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4feb25dd-c9ab-4d68-ac1d-68d8e6de6d2b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1321 microversion: 2.1 time: 0.319750 Oct 04 21:27:23.317338 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1063/2130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:22 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:24.362288 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-21b1856a-8277-4760-9b3e-fea614511644 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:24.363595 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-21b1856a-8277-4760-9b3e-fea614511644 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:24.376794 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-21b1856a-8277-4760-9b3e-fea614511644 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.377690 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-21b1856a-8277-4760-9b3e-fea614511644 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.378492 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-21b1856a-8277-4760-9b3e-fea614511644 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.379795 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-21b1856a-8277-4760-9b3e-fea614511644 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.380641 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-21b1856a-8277-4760-9b3e-fea614511644 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.381410 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-21b1856a-8277-4760-9b3e-fea614511644 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.638831 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-21b1856a-8277-4760-9b3e-fea614511644 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:24.648882 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-21b1856a-8277-4760-9b3e-fea614511644 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1471 microversion: 2.1 time: 0.294644 Oct 04 21:27:24.649580 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1068/2131] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:24 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1471 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:24.757405 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9fa23a58-1cd3-42fe-8089-ac6c6b2a1543 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Calling method '.version_select at 0x7f77ef2095e0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:24.862927 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9fa23a58-1cd3-42fe-8089-ac6c6b2a1543 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/39d99c8623964f299bab3664296b77f9" status: 200 len: 371 microversion: 2.1 time: 0.189014 Oct 04 21:27:24.863712 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1064/2132] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 21:27:24 2022] GET /compute/v2.1/os-quota-sets/39d99c8623964f299bab3664296b77f9 => generated 371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:27:24.883119 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3ec440f7-51c4-47a5-8047-793fd8351cde tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-223866353", "id": 668516573, "os-flavor-access:is_public": "True"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:25.044274 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3ec440f7-51c4-47a5-8047-793fd8351cde tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.169084 Oct 04 21:27:25.045103 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1069/2133] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:27:24 2022] POST /compute/v2.1/flavors => generated 434 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:25.064170 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "668516573"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:25.068410 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:25.079573 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:25.080473 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:25.081285 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:25.082291 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:25.082984 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:25.083953 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a08e723c-d5ca-4322-97ff-dfd8b7a3469a) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:27:25.279448 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a08e723c-d5ca-4322-97ff-dfd8b7a3469a) Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Request method failure captured: Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf/action HTTP/1.1 Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 38 Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKUpJjXXExN1Uht3ggy1mQzT0CrKyDB8zxna1mHgOQeGb5egt0EuzSC_oswELKDx11OrUbcM4BI0XkpsaUfo4lZ8BUE4nI3SdENVpztsld6Nbl8h4H9O6_nNNXcVqsCqYLdp1vFJHrr1QqTK0lCSoHm9oCm5vu7k1JXwHxt-ARxSSww Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 39d99c8623964f299bab3664296b77f9 Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-898749961 Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Role: admin,reader,member Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: admin,reader,member Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_39d99c8623964f299bab3664296b77f9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39d99c8623964f299bab3664296b77f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39d99c8623964f299bab3664296b77f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/39d99c8623964f299bab3664296b77f9"}]}] Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersAdminNegativeTestJSON-898749961 Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 39d99c8623964f299bab3664296b77f9 Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-898749961 Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersAdminNegativeTestJSON-898749961-project-admin Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 0846761655a5458ab05dd995ae4a2e77 Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersAdminNegativeTestJSON-898749961-project-admin Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: {"resize": {"flavorRef": "668516573"}} Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '260be7b2-1bfe-4b9c-b3c2-914d3274dcdf', 'body': {'resize': {'flavorRef': '668516573'}}} Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 21:27:25.287837 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:27:25.297734 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a08e723c-d5ca-4322-97ff-dfd8b7a3469a) Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-751e9d3b-08ba-4173-aa36-359c3b1f7abd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf/action" status: 500 len: 214 microversion: 2.1 time: 0.232781 Oct 04 21:27:25.305224 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1065/2134] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 21:27:25 2022] POST /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf/action => generated 214 bytes in 236 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:27:25.354912 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-07348983-62ff-41fe-8774-c5222a4c6a88 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:25.497033 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-07348983-62ff-41fe-8774-c5222a4c6a88 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/668516573" status: 202 len: 0 microversion: 2.1 time: 0.149670 Oct 04 21:27:25.498297 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1070/2135] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 21:27:25 2022] DELETE /compute/v2.1/flavors/668516573 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:27:25.513848 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c6a4718a-3acf-48ff-b78f-728f5d4e872e tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:25.564364 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c6a4718a-3acf-48ff-b78f-728f5d4e872e tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051742 Oct 04 21:27:25.564364 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1066/2136] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 21:27:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:25.605630 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c45c3439-09ea-4354-982f-5947c9df32cc tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Calling method '.version_select at 0x7f77eeaa1ee0>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:25.741668 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c45c3439-09ea-4354-982f-5947c9df32cc tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/39d99c8623964f299bab3664296b77f9" status: 200 len: 371 microversion: 2.1 time: 0.143604 Oct 04 21:27:25.742734 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1071/2137] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 21:27:25 2022] GET /compute/v2.1/os-quota-sets/39d99c8623964f299bab3664296b77f9 => generated 371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:25.765795 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0ce50337-4070-4198-9437-864b206f2de2 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-954449565", "id": 2093954831, "os-flavor-access:is_public": "True"}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:25.901993 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0ce50337-4070-4198-9437-864b206f2de2 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.143702 Oct 04 21:27:25.903112 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1067/2138] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:27:25 2022] POST /compute/v2.1/flavors => generated 436 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:25.925723 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2093954831"}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:25.929824 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:25.941475 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:25.942346 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:25.943127 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:25.944466 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:25.945403 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:25.946090 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2776d568-1207-4ebc-abb3-7820fadbf21f) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:27:26.134442 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2776d568-1207-4ebc-abb3-7820fadbf21f) Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Request method failure captured: Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf/action HTTP/1.1 Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 39 Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKUpJjXXExN1Uht3ggy1mQzT0CrKyDB8zxna1mHgOQeGb5egt0EuzSC_oswELKDx11OrUbcM4BI0XkpsaUfo4lZ8BUE4nI3SdENVpztsld6Nbl8h4H9O6_nNNXcVqsCqYLdp1vFJHrr1QqTK0lCSoHm9oCm5vu7k1JXwHxt-ARxSSww Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 39d99c8623964f299bab3664296b77f9 Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-898749961 Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Role: admin,reader,member Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: admin,reader,member Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_39d99c8623964f299bab3664296b77f9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39d99c8623964f299bab3664296b77f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/39d99c8623964f299bab3664296b77f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/39d99c8623964f299bab3664296b77f9"}]}] Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersAdminNegativeTestJSON-898749961 Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 39d99c8623964f299bab3664296b77f9 Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-898749961 Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersAdminNegativeTestJSON-898749961-project-admin Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 0846761655a5458ab05dd995ae4a2e77 Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersAdminNegativeTestJSON-898749961-project-admin Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: {"resize": {"flavorRef": "2093954831"}} Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'id': '260be7b2-1bfe-4b9c-b3c2-914d3274dcdf', 'body': {'resize': {'flavorRef': '2093954831'}}} Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 21:27:26.142584 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:27:26.152391 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2776d568-1207-4ebc-abb3-7820fadbf21f) Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2f69d7ea-d1a6-434d-b26a-d9d87c762be8 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf/action" status: 500 len: 214 microversion: 2.1 time: 0.223238 Oct 04 21:27:26.160643 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1072/2139] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Oct 4 21:27:25 2022] POST /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf/action => generated 214 bytes in 226 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:27:26.164948 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-870b2596-8405-4ae7-9a4e-0ad8a576cc31 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:26.354859 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-870b2596-8405-4ae7-9a4e-0ad8a576cc31 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2093954831" status: 202 len: 0 microversion: 2.1 time: 0.203310 Oct 04 21:27:26.355956 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1068/2140] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Oct 4 21:27:26 2022] DELETE /compute/v2.1/flavors/2093954831 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:27:26.370430 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-0e290125-2e06-418b-9447-f25ab0559245 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:26.412237 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-0e290125-2e06-418b-9447-f25ab0559245 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048447 Oct 04 21:27:26.413214 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1073/2141] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 21:27:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:26.454181 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-361dce51-9eb3-49cf-b629-0d22ea41862c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:26.454939 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-361dce51-9eb3-49cf-b629-0d22ea41862c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:26.466838 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-361dce51-9eb3-49cf-b629-0d22ea41862c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:26.467787 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-361dce51-9eb3-49cf-b629-0d22ea41862c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:26.468599 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-361dce51-9eb3-49cf-b629-0d22ea41862c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:26.469878 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-361dce51-9eb3-49cf-b629-0d22ea41862c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:26.470671 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-361dce51-9eb3-49cf-b629-0d22ea41862c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:26.471405 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-361dce51-9eb3-49cf-b629-0d22ea41862c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:26.520839 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-361dce51-9eb3-49cf-b629-0d22ea41862c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Going to try to terminate instance {{(pid=123540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:27:27.010196 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-361dce51-9eb3-49cf-b629-0d22ea41862c tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "DELETE /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 204 len: 0 microversion: 2.1 time: 0.561743 Oct 04 21:27:27.016748 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1069/2142] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:26 2022] DELETE /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:27:27.035871 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5ea555ce-85b7-49e6-80ed-c6f0b2d6131b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:27.035871 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-5ea555ce-85b7-49e6-80ed-c6f0b2d6131b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:27.048252 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5ea555ce-85b7-49e6-80ed-c6f0b2d6131b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:27.049196 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5ea555ce-85b7-49e6-80ed-c6f0b2d6131b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:27.050024 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5ea555ce-85b7-49e6-80ed-c6f0b2d6131b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:27.051536 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5ea555ce-85b7-49e6-80ed-c6f0b2d6131b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:27.052450 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5ea555ce-85b7-49e6-80ed-c6f0b2d6131b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:27.053214 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-5ea555ce-85b7-49e6-80ed-c6f0b2d6131b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:27.314653 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-5ea555ce-85b7-49e6-80ed-c6f0b2d6131b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:27.324273 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5ea555ce-85b7-49e6-80ed-c6f0b2d6131b tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1477 microversion: 2.1 time: 0.300318 Oct 04 21:27:27.324870 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1074/2143] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:27 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1477 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:28.362392 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-04b1121d-5446-4fd1-a3fd-74f72efe7caf tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:28.363816 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-04b1121d-5446-4fd1-a3fd-74f72efe7caf tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:28.376476 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-04b1121d-5446-4fd1-a3fd-74f72efe7caf tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:28.377389 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-04b1121d-5446-4fd1-a3fd-74f72efe7caf tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:28.378193 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-04b1121d-5446-4fd1-a3fd-74f72efe7caf tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:28.379626 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-04b1121d-5446-4fd1-a3fd-74f72efe7caf tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:28.380594 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-04b1121d-5446-4fd1-a3fd-74f72efe7caf tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:28.381720 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-04b1121d-5446-4fd1-a3fd-74f72efe7caf tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:28.859786 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-04b1121d-5446-4fd1-a3fd-74f72efe7caf tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:28.875666 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-04b1121d-5446-4fd1-a3fd-74f72efe7caf tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1477 microversion: 2.1 time: 0.522269 Oct 04 21:27:28.876564 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1070/2144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:28 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1477 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:29.833128 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [req-460ab653-c98d-4308-ba55-7e5611b27476 req-5682dfa7-4d09-4323-9d35-72bdf55d206e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260be7b2-1bfe-4b9c-b3c2-914d3274dcdf", "name": "network-vif-deleted", "tag": "5815ef59-98a3-4877-800b-df28baf43ee7"}]} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:29.851797 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-460ab653-c98d-4308-ba55-7e5611b27476 req-5682dfa7-4d09-4323-9d35-72bdf55d206e service nova] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:29.852547 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-460ab653-c98d-4308-ba55-7e5611b27476 req-5682dfa7-4d09-4323-9d35-72bdf55d206e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:29.853152 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [req-460ab653-c98d-4308-ba55-7e5611b27476 req-5682dfa7-4d09-4323-9d35-72bdf55d206e service nova] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:29.876389 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.compute.server_external_events [req-460ab653-c98d-4308-ba55-7e5611b27476 req-5682dfa7-4d09-4323-9d35-72bdf55d206e service nova] Creating event network-vif-deleted:5815ef59-98a3-4877-800b-df28baf43ee7 for instance 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf on n-h1-852085-12 Oct 04 21:27:29.886133 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [req-460ab653-c98d-4308-ba55-7e5611b27476 req-5682dfa7-4d09-4323-9d35-72bdf55d206e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060787 Oct 04 21:27:29.887369 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1075/2145] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:29.917902 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-55e47b99-22b4-45aa-8195-f56b8ed028af tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:29.919031 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-55e47b99-22b4-45aa-8195-f56b8ed028af tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:29.930337 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-55e47b99-22b4-45aa-8195-f56b8ed028af tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:29.931177 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-55e47b99-22b4-45aa-8195-f56b8ed028af tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:29.932450 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-55e47b99-22b4-45aa-8195-f56b8ed028af tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:29.933844 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-55e47b99-22b4-45aa-8195-f56b8ed028af tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:29.934605 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-55e47b99-22b4-45aa-8195-f56b8ed028af tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:29.935323 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-55e47b99-22b4-45aa-8195-f56b8ed028af tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.034545 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.policy [None req-55e47b99-22b4-45aa-8195-f56b8ed028af tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:30.051785 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-55e47b99-22b4-45aa-8195-f56b8ed028af tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1435 microversion: 2.1 time: 0.141906 Oct 04 21:27:30.053983 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1071/2146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:29 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1435 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:31.093542 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:31.094852 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.compute.api [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:31.107340 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:31.108244 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:31.109035 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:31.110377 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:31.111272 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:31.115848 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:31.178338 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:31.179240 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:31.180021 n-d-852085-12 devstack@n-api.service[123539]: DEBUG oslo_concurrency.lockutils [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:31.180849 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.objects.instance [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lazy-loading 'fault' on Instance uuid 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf {{(pid=123539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:27:31.256151 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.policy [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eda3a284964e5785742149f90b2477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49486f6954e340efbf04c7b4ae8098fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:31.273239 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-8279d3a2-cb06-4602-8733-334a73ecfd74 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 200 len: 1311 microversion: 2.1 time: 0.188872 Oct 04 21:27:31.276132 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1076/2147] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:31 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:32.316836 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f28ba6e0-54ef-44a3-9090-676589d29ee1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Calling method '>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:32.317938 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.compute.api [None req-f28ba6e0-54ef-44a3-9090-676589d29ee1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] [instance: 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf] Fetching instance by UUID {{(pid=123540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:32.327561 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f28ba6e0-54ef-44a3-9090-676589d29ee1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:32.328064 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f28ba6e0-54ef-44a3-9090-676589d29ee1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:32.328564 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f28ba6e0-54ef-44a3-9090-676589d29ee1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:32.329328 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f28ba6e0-54ef-44a3-9090-676589d29ee1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Acquiring lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:32.329794 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f28ba6e0-54ef-44a3-9090-676589d29ee1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:32.330224 n-d-852085-12 devstack@n-api.service[123540]: DEBUG oslo_concurrency.lockutils [None req-f28ba6e0-54ef-44a3-9090-676589d29ee1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Lock "8c6f5a8f-3e7f-4559-98c8-58d2585358de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:32.350734 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-f28ba6e0-54ef-44a3-9090-676589d29ee1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] HTTP exception thrown: Instance 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf could not be found. Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f28ba6e0-54ef-44a3-9090-676589d29ee1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Request method failure captured: Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: request: GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf HTTP/1.1 Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 0 Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKUn2Pzwr4WdAZMjgINKLVWGTiTat3o3U7zMloqDKogeSmOvD-UYQbE-wFLtENIKfRga2cMIut6igY3vMZdcuMzDd4OYEerrfUdaC2LUhBGHMN7QHJu9eN_ettkygTpcT2_Ff2Iz0naN7Cp9q4sdyCetTav7mg-FFMkM2tJ0g2HUr1I Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 49486f6954e340efbf04c7b4ae8098fb Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-589041963 Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_49486f6954e340efbf04c7b4ae8098fb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/49486f6954e340efbf04c7b4ae8098fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/49486f6954e340efbf04c7b4ae8098fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/49486f6954e340efbf04c7b4ae8098fb"}]}] Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServersAdminNegativeTestJSON-589041963 Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 49486f6954e340efbf04c7b4ae8098fb Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-589041963 Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServersAdminNegativeTestJSON-589041963-project Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 48eda3a284964e5785742149f90b2477 Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServersAdminNegativeTestJSON-589041963-project Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: exception: Instance 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf could not be found. Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'id': '260be7b2-1bfe-4b9c-b3c2-914d3274dcdf'} Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf could not be found. Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf could not be found. Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:32.352915 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:32.364222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:32.364222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:32.364222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:32.364222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:32.364222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:32.364222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:32.364222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf could not be found. Oct 04 21:27:32.364222 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:27:32.364222 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f28ba6e0-54ef-44a3-9090-676589d29ee1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] Returning 404 to user: Instance 260be7b2-1bfe-4b9c-b3c2-914d3274dcdf could not be found. {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:32.364222 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f28ba6e0-54ef-44a3-9090-676589d29ee1 tempest-ServersAdminNegativeTestJSON-589041963 tempest-ServersAdminNegativeTestJSON-589041963-project] 10.222.0.78 "GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf" status: 404 len: 111 microversion: 2.1 time: 0.045142 Oct 04 21:27:32.364222 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1072/2148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:32 2022] GET /compute/v2.1/servers/260be7b2-1bfe-4b9c-b3c2-914d3274dcdf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:47.573461 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:47.574879 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:47.576195 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell1:SELECT=64 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:47.792475 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7e68cb63-9215-43c3-87a6-7a3e8ad3c60f tempest-DeleteServersTestJSON-965567845 tempest-DeleteServersTestJSON-965567845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1948669025", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "c893ff02-3f73-434c-b095-efea0c2aa1fd"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:47.882651 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-7e68cb63-9215-43c3-87a6-7a3e8ad3c60f tempest-DeleteServersTestJSON-965567845 tempest-DeleteServersTestJSON-965567845-project] validate_networks() for [('c893ff02-3f73-434c-b095-efea0c2aa1fd', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-7e68cb63-9215-43c3-87a6-7a3e8ad3c60f tempest-DeleteServersTestJSON-965567845 tempest-DeleteServersTestJSON-965567845-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6e4cd72d-ccfc-45fc-b68e-433121fc06e2) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:27:48.240926 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6e4cd72d-ccfc-45fc-b68e-433121fc06e2) Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-7e68cb63-9215-43c3-87a6-7a3e8ad3c60f tempest-DeleteServersTestJSON-965567845 tempest-DeleteServersTestJSON-965567845-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7e68cb63-9215-43c3-87a6-7a3e8ad3c60f tempest-DeleteServersTestJSON-965567845 tempest-DeleteServersTestJSON-965567845-project] Request method failure captured: Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 207 Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKVT9PbHabTPQMFQAmfDMwHUOZ0YaRIanZzJQH0C4AfAm0K2ss99jWzjPRlmg5vtFitI7-IRUI8wLJhBC7K3qW1Ubjpr37Xoca-sR_O09w19Tu-BaodbE77fsJKSf9A0GPCDmt_H6KqegIq02yV0sN9tWGDSC1QCXUY_g7fn_VOQTqU Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 53e157aea13344d7b3d229a8438e5017 Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-DeleteServersTestJSON-965567845 Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_53e157aea13344d7b3d229a8438e5017", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/53e157aea13344d7b3d229a8438e5017"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/53e157aea13344d7b3d229a8438e5017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/53e157aea13344d7b3d229a8438e5017"}]}] Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-DeleteServersTestJSON-965567845 Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 53e157aea13344d7b3d229a8438e5017 Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-DeleteServersTestJSON-965567845 Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-DeleteServersTestJSON-965567845-project Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 5f06190cae314128ae2f6626c3afac07 Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-DeleteServersTestJSON-965567845-project Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1948669025", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "c893ff02-3f73-434c-b095-efea0c2aa1fd"}]}} Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1948669025', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'c893ff02-3f73-434c-b095-efea0c2aa1fd'}]}}} Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:48.247261 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:27:48.253337 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6e4cd72d-ccfc-45fc-b68e-433121fc06e2) Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7e68cb63-9215-43c3-87a6-7a3e8ad3c60f tempest-DeleteServersTestJSON-965567845 tempest-DeleteServersTestJSON-965567845-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7e68cb63-9215-43c3-87a6-7a3e8ad3c60f tempest-DeleteServersTestJSON-965567845 tempest-DeleteServersTestJSON-965567845-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.683331 Oct 04 21:27:48.260430 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1077/2149] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:27:47 2022] POST /compute/v2.1/servers => generated 214 bytes in 686 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 21:28:08.080713 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:08.082376 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:08.084725 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:08.321362 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cc3c7fd2-3bba-457b-bb86-3d5591828ea7 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-824100357", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "da014bed-6f76-4f73-a94e-4e5f5cac8645"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:08.429392 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-cc3c7fd2-3bba-457b-bb86-3d5591828ea7 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] validate_networks() for [('da014bed-6f76-4f73-a94e-4e5f5cac8645', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-cc3c7fd2-3bba-457b-bb86-3d5591828ea7 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c8eeb44c-8e18-4f26-b18d-71dee2b16ab0) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:28:08.823104 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c8eeb44c-8e18-4f26-b18d-71dee2b16ab0) Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-cc3c7fd2-3bba-457b-bb86-3d5591828ea7 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cc3c7fd2-3bba-457b-bb86-3d5591828ea7 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] Request method failure captured: Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 209 Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKVnE9mUNlPaJ98aKQI6NOukAUHH7kQrMKrBynMLS8rCECyGgx4Nnz2e480QepiobDKgI9nZkp8SzDOtVd0H87jJPFqErD8dhbXpgXbK9TRaaBGfNTOQqyDly7lyvwtdxWi8GsIPsrOLdbBw6s_rurtPI6qyL4CbmCvnMELoJwrDmW8 Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: fcaad48dd9a24394a948efc94496ef1a Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1910575150 Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fcaad48dd9a24394a948efc94496ef1a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fcaad48dd9a24394a948efc94496ef1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fcaad48dd9a24394a948efc94496ef1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fcaad48dd9a24394a948efc94496ef1a"}]}] Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-ServerDiskConfigTestJSON-1910575150 Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: fcaad48dd9a24394a948efc94496ef1a Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1910575150 Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-ServerDiskConfigTestJSON-1910575150-project Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 225c41ce531d4478a5aa43c7fa6ea7f6 Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-ServerDiskConfigTestJSON-1910575150-project Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-824100357", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "da014bed-6f76-4f73-a94e-4e5f5cac8645"}]}} Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:28:08.829046 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-824100357', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'da014bed-6f76-4f73-a94e-4e5f5cac8645'}]}}} Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:28:08.834641 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c8eeb44c-8e18-4f26-b18d-71dee2b16ab0) Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-cc3c7fd2-3bba-457b-bb86-3d5591828ea7 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-cc3c7fd2-3bba-457b-bb86-3d5591828ea7 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.757299 Oct 04 21:28:08.840022 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1073/2150] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:08 2022] POST /compute/v2.1/servers => generated 214 bytes in 760 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:28:08.910279 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:08.918229 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2e3eaccd-1324-482d-8bc5-d9ea9606e317 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1377831669", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "da014bed-6f76-4f73-a94e-4e5f5cac8645"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:09.029450 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-2e3eaccd-1324-482d-8bc5-d9ea9606e317 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] validate_networks() for [('da014bed-6f76-4f73-a94e-4e5f5cac8645', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-2e3eaccd-1324-482d-8bc5-d9ea9606e317 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-727c22e1-fb74-4c19-b928-0eaead0dc37c) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:28:09.429094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-727c22e1-fb74-4c19-b928-0eaead0dc37c) Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-2e3eaccd-1324-482d-8bc5-d9ea9606e317 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:09.434710 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2e3eaccd-1324-482d-8bc5-d9ea9606e317 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] Request method failure captured: Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 210 Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKVnE9mUNlPaJ98aKQI6NOukAUHH7kQrMKrBynMLS8rCECyGgx4Nnz2e480QepiobDKgI9nZkp8SzDOtVd0H87jJPFqErD8dhbXpgXbK9TRaaBGfNTOQqyDly7lyvwtdxWi8GsIPsrOLdbBw6s_rurtPI6qyL4CbmCvnMELoJwrDmW8 Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: fcaad48dd9a24394a948efc94496ef1a Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1910575150 Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fcaad48dd9a24394a948efc94496ef1a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fcaad48dd9a24394a948efc94496ef1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fcaad48dd9a24394a948efc94496ef1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fcaad48dd9a24394a948efc94496ef1a"}]}] Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServerDiskConfigTestJSON-1910575150 Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: fcaad48dd9a24394a948efc94496ef1a Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1910575150 Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServerDiskConfigTestJSON-1910575150-project Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 225c41ce531d4478a5aa43c7fa6ea7f6 Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServerDiskConfigTestJSON-1910575150-project Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1377831669", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "da014bed-6f76-4f73-a94e-4e5f5cac8645"}]}} Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-1377831669', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'da014bed-6f76-4f73-a94e-4e5f5cac8645'}]}}} Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:28:09.439094 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-727c22e1-fb74-4c19-b928-0eaead0dc37c) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:28:09.446112 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-2e3eaccd-1324-482d-8bc5-d9ea9606e317 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-2e3eaccd-1324-482d-8bc5-d9ea9606e317 tempest-ServerDiskConfigTestJSON-1910575150 tempest-ServerDiskConfigTestJSON-1910575150-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.537333 Oct 04 21:28:09.452924 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1078/2151] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:08 2022] POST /compute/v2.1/servers => generated 214 bytes in 543 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:28:29.774659 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:30.019947 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b21b088a-a71b-4305-a733-739cbeb895a9 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] Action: 'create', calling method: .version_select at 0x7f77eeb2a1f0>, body: {"keypair": {"name": "tempest-keypair-1111785131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0c3fArJ0CNwOnbD1AxlvjDI8Vwct7olD7fS47aN8gkJdPGr11/9NjWNghvY3iq8IQs4TGOkv/YYC51RTyARHBw4G7msDLh6MMwH5635Ya1j3iFo3KQ1GnqoRjlF2QgcQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:30.056039 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-b21b088a-a71b-4305-a733-739cbeb895a9 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] Getting quotas for project b6ed030efed04e42bb7298166990f4a4. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:28:30.069327 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-b21b088a-a71b-4305-a733-739cbeb895a9 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] Getting quotas for user c91a3baba3474707a2bc7e731e8da458 and project b6ed030efed04e42bb7298166990f4a4. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:28:30.106726 n-d-852085-12 devstack@n-api.service[123540]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b21b088a-a71b-4305-a733-739cbeb895a9 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] [86cb1cd2-d0f8-4694-b449-b0b09fd9a51a] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:28:31.123744 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [None req-b21b088a-a71b-4305-a733-739cbeb895a9 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] [86cb1cd2-d0f8-4694-b449-b0b09fd9a51a] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 60612. Oct 04 21:28:31.238274 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b21b088a-a71b-4305-a733-739cbeb895a9 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.465752 Oct 04 21:28:31.239285 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1074/2152] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:28:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:35.539519 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:35.549831 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e3dda491-f1c2-42e7-a114-37744a891fb1 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-663130568", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0617578a-15c9-493f-ad7f-887e35c40601"}], "security_groups": [{"name": "tempest-securitygroup--215216494"}], "key_name": "tempest-keypair-1111785131", "user_data": "}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:35.785986 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-e3dda491-f1c2-42e7-a114-37744a891fb1 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] validate_networks() for [('0617578a-15c9-493f-ad7f-887e35c40601', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-e3dda491-f1c2-42e7-a114-37744a891fb1 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6fbbf0ed-834b-43c1-9c14-208ef31e65d2) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:28:36.262729 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6fbbf0ed-834b-43c1-9c14-208ef31e65d2) Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-e3dda491-f1c2-42e7-a114-37744a891fb1 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e3dda491-f1c2-42e7-a114-37744a891fb1 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] Request method failure captured: Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 492 Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKV9ybV5j4fa_4BMhyOQGYUM89p93i-WEtJ9NA1nmAlDTpGTnn_fmDwPXFi5BM6QtsSlVHQFR0-NXVPS8Qe5MOmJ6jHVT7VD10m7K20PF9varg_mjgPKRcyl6FepHkNld0PJ7bp3jJ8D4ai1sQdQZY72NoridbQOVRAYQIxFBZaF21E Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: b6ed030efed04e42bb7298166990f4a4 Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServerActionsTestJSON-1630488758 Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b6ed030efed04e42bb7298166990f4a4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b6ed030efed04e42bb7298166990f4a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b6ed030efed04e42bb7298166990f4a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b6ed030efed04e42bb7298166990f4a4"}]}] Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServerActionsTestJSON-1630488758 Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: b6ed030efed04e42bb7298166990f4a4 Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1630488758 Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServerActionsTestJSON-1630488758-project Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: c91a3baba3474707a2bc7e731e8da458 Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServerActionsTestJSON-1630488758-project Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServerActionsTestJSON-server-663130568", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "adminPass": "E0^XJ+r9OXfdcT+", "networks": [{"uuid": "0617578a-15c9-493f-ad7f-887e35c40601"}], "security_groups": [{"name": "tempest-securitygroup--215216494"}], "key_name": "tempest-keypair-1111785131", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:36.274583 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServerActionsTestJSON-server-663130568', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'adminPass': 'E0^XJ+r9OXfdcT+', 'networks': [{'uuid': '0617578a-15c9-493f-ad7f-887e35c40601'}], 'security_groups': [{'name': 'tempest-securitygroup--215216494'}], 'key_name': 'tempest-keypair-1111785131', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:28:36.282382 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6fbbf0ed-834b-43c1-9c14-208ef31e65d2) Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e3dda491-f1c2-42e7-a114-37744a891fb1 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e3dda491-f1c2-42e7-a114-37744a891fb1 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.741025 Oct 04 21:28:36.288515 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1079/2153] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 746 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:28:36.297948 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-f6cef08a-f04b-4115-ad8c-1a9194bc5775 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] Calling method '.version_select at 0x7f77ef9d4a60>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:36.481586 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-f6cef08a-f04b-4115-ad8c-1a9194bc5775 tempest-ServerActionsTestJSON-1630488758 tempest-ServerActionsTestJSON-1630488758-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111785131" status: 202 len: 0 microversion: 2.1 time: 0.191475 Oct 04 21:28:36.482723 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1075/2154] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 21:28:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111785131 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:28:58.802321 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:28:58.804981 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:58.809577 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:28:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Oct 04 21:28:59.133050 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c442b770-c1a2-4f4e-9e4f-8614eda5a7d4 tempest-ServersNegativeTestJSON-1766073269 tempest-ServersNegativeTestJSON-1766073269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2046982112", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "7c1ad554-c971-44f6-aecf-dc578ae5ec3d"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:59.569030 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-c442b770-c1a2-4f4e-9e4f-8614eda5a7d4 tempest-ServersNegativeTestJSON-1766073269 tempest-ServersNegativeTestJSON-1766073269-project] validate_networks() for [('7c1ad554-c971-44f6-aecf-dc578ae5ec3d', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-c442b770-c1a2-4f4e-9e4f-8614eda5a7d4 tempest-ServersNegativeTestJSON-1766073269 tempest-ServersNegativeTestJSON-1766073269-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2fae0fd0-acd6-4bfd-b25a-c6805f8c84f3) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:28:59.968798 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2fae0fd0-acd6-4bfd-b25a-c6805f8c84f3) Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-c442b770-c1a2-4f4e-9e4f-8614eda5a7d4 tempest-ServersNegativeTestJSON-1766073269 tempest-ServersNegativeTestJSON-1766073269-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c442b770-c1a2-4f4e-9e4f-8614eda5a7d4 tempest-ServersNegativeTestJSON-1766073269 tempest-ServersNegativeTestJSON-1766073269-project] Request method failure captured: Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 209 Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKWa90ldrfIgA6u2ThOWbEBBndtOQ9COOmpS1osQtuiFs28htqeTAoQcp7yz3HDYJ3aRM2VgIC3ghJlNZ9alMSGmFwNizhtH_4OZW6hrjW1iQ-QeKDnpKEyvOVAsWFrEEOz_Lh5xq1rvSZApfQk7fcN1FzkiVs1Lh1UjDdHAsfN7Ato Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: d4834e96ebfd4a33ac33e7d3e81637ac Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-ServersNegativeTestJSON-1766073269 Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4834e96ebfd4a33ac33e7d3e81637ac", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4834e96ebfd4a33ac33e7d3e81637ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4834e96ebfd4a33ac33e7d3e81637ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4834e96ebfd4a33ac33e7d3e81637ac"}]}] Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-ServersNegativeTestJSON-1766073269 Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: d4834e96ebfd4a33ac33e7d3e81637ac Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1766073269 Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-ServersNegativeTestJSON-1766073269-project Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 6433c1be19ca4644b48a5968d083e119 Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-ServersNegativeTestJSON-1766073269-project Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2046982112", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "7c1ad554-c971-44f6-aecf-dc578ae5ec3d"}]}} Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:28:59.976195 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2046982112', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '7c1ad554-c971-44f6-aecf-dc578ae5ec3d'}]}}} Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:28:59.985013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2fae0fd0-acd6-4bfd-b25a-c6805f8c84f3) Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c442b770-c1a2-4f4e-9e4f-8614eda5a7d4 tempest-ServersNegativeTestJSON-1766073269 tempest-ServersNegativeTestJSON-1766073269-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c442b770-c1a2-4f4e-9e4f-8614eda5a7d4 tempest-ServersNegativeTestJSON-1766073269 tempest-ServersNegativeTestJSON-1766073269-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.177485 Oct 04 21:28:59.990983 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1080/2155] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:58 2022] POST /compute/v2.1/servers => generated 214 bytes in 1180 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 21:30:18.927749 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:18.929204 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:18.930339 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:30:18.930579 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:30:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:30:18.932355 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:30:18.932723 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:30:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:30:19.427519 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5f429278-2697-463a-a63d-87f51774ad3f tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Action: 'create', calling method: .version_select at 0x7f77eec97040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1894636868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhuAZvorcniclxpfDe0M6Hyr3cr5Y+ZKDer3aTytBxDiXOS3lsJ2JEB9iRs7KOEIK36TD1VL3lmxKXrV57gxysLqlY24F2U43ZyEwugfhUUyxVKEYtlssUNKjnF1s6BvQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:19.467782 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-5f429278-2697-463a-a63d-87f51774ad3f tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Getting quotas for project 85b7ddd272374c81b094a377fde7a3e1. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:19.480207 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-5f429278-2697-463a-a63d-87f51774ad3f tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Getting quotas for user b83b49ea9a8c4f5fa6016e823ba673e9 and project 85b7ddd272374c81b094a377fde7a3e1. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:19.602189 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5f429278-2697-463a-a63d-87f51774ad3f tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.676304 Oct 04 21:30:19.607794 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1076/2156] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:30:18 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:19.679882 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=2 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:19.688118 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-34400f32-b27a-4fe7-bba9-bc0499aedb00 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-667110219", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1894636868", "networks": [{"uuid": "ed3c2d19-cadf-4300-8f7a-53f540eb2994"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:19.820110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-34400f32-b27a-4fe7-bba9-bc0499aedb00 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] validate_networks() for [('ed3c2d19-cadf-4300-8f7a-53f540eb2994', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-34400f32-b27a-4fe7-bba9-bc0499aedb00 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b8cb8c77-8596-45de-bfe8-30189a7577fa) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:30:20.214282 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b8cb8c77-8596-45de-bfe8-30189a7577fa) Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-34400f32-b27a-4fe7-bba9-bc0499aedb00 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-34400f32-b27a-4fe7-bba9-bc0499aedb00 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Request method failure captured: Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 272 Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKXfp-9JD6o_3e1zeO6ttxrjW6P5SVpa0Ut3tndL8eIlAgAaeWWAjIhAWYTSjNKiCH_Kos264P0WPudltPWRFXf2PDFj5rqLAQ0LW-T_fkWo84cpzjcV_8zZcZjZlf7M50CQAr-533YDzDIcSF_rptRk5U_YThtX8HNNGNcDfbUI2UA Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 85b7ddd272374c81b094a377fde7a3e1 Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestEncryptedCinderVolumes-43116842 Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_85b7ddd272374c81b094a377fde7a3e1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85b7ddd272374c81b094a377fde7a3e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85b7ddd272374c81b094a377fde7a3e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/85b7ddd272374c81b094a377fde7a3e1"}]}] Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestEncryptedCinderVolumes-43116842 Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 85b7ddd272374c81b094a377fde7a3e1 Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-43116842 Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestEncryptedCinderVolumes-43116842-project Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b83b49ea9a8c4f5fa6016e823ba673e9 Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestEncryptedCinderVolumes-43116842-project Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-667110219", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1894636868", "networks": [{"uuid": "ed3c2d19-cadf-4300-8f7a-53f540eb2994"}]}} Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:20.220741 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-667110219', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-1894636868', 'networks': [{'uuid': 'ed3c2d19-cadf-4300-8f7a-53f540eb2994'}]}}} Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:30:20.227206 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b8cb8c77-8596-45de-bfe8-30189a7577fa) Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-34400f32-b27a-4fe7-bba9-bc0499aedb00 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-34400f32-b27a-4fe7-bba9-bc0499aedb00 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.546774 Oct 04 21:30:20.233948 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1081/2157] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:30:19 2022] POST /compute/v2.1/servers => generated 214 bytes in 550 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:30:20.242380 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5078b746-6181-42db-81b9-d0dd6a185b04 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Calling method '.version_select at 0x7f77eec90160>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:20.354207 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5078b746-6181-42db-81b9-d0dd6a185b04 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1894636868" status: 202 len: 0 microversion: 2.1 time: 0.117159 Oct 04 21:30:20.354802 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1077/2158] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 4 21:30:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1894636868 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:30:20.372247 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-7f86d08d-3545-465e-a680-949f097cf8c9 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Action: 'create', calling method: .version_select at 0x7f77eed98d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1708716658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtfaTjVLHZvs7D74tmm35aaRjSJXfcjqUx2R7UP6rA/ksmPrdNME6ykKKQjwhKXryG6/j0lxfRANS93wSnrXoIDXbRSODwzYSzNdRPaj33WlJFHJdMp7ltMz7UOCws8RA=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:20.398220 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-7f86d08d-3545-465e-a680-949f097cf8c9 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Getting quotas for project 85b7ddd272374c81b094a377fde7a3e1. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:20.405905 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-7f86d08d-3545-465e-a680-949f097cf8c9 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Getting quotas for user b83b49ea9a8c4f5fa6016e823ba673e9 and project 85b7ddd272374c81b094a377fde7a3e1. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:20.533560 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-7f86d08d-3545-465e-a680-949f097cf8c9 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.165702 Oct 04 21:30:20.534740 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1082/2159] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:30:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:30:20.624383 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-396b3650-d543-46b4-9dfd-a7c240c5f3b9 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1004543844", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1708716658", "networks": [{"uuid": "ed3c2d19-cadf-4300-8f7a-53f540eb2994"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:20.975052 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-396b3650-d543-46b4-9dfd-a7c240c5f3b9 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] validate_networks() for [('ed3c2d19-cadf-4300-8f7a-53f540eb2994', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-396b3650-d543-46b4-9dfd-a7c240c5f3b9 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8ee94892-ef18-4784-8b4a-5fc2d94d1d59) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:30:21.430649 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8ee94892-ef18-4784-8b4a-5fc2d94d1d59) Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-396b3650-d543-46b4-9dfd-a7c240c5f3b9 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:21.438834 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-396b3650-d543-46b4-9dfd-a7c240c5f3b9 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Request method failure captured: Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 273 Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKXfp-9JD6o_3e1zeO6ttxrjW6P5SVpa0Ut3tndL8eIlAgAaeWWAjIhAWYTSjNKiCH_Kos264P0WPudltPWRFXf2PDFj5rqLAQ0LW-T_fkWo84cpzjcV_8zZcZjZlf7M50CQAr-533YDzDIcSF_rptRk5U_YThtX8HNNGNcDfbUI2UA Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 85b7ddd272374c81b094a377fde7a3e1 Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestEncryptedCinderVolumes-43116842 Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_85b7ddd272374c81b094a377fde7a3e1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85b7ddd272374c81b094a377fde7a3e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85b7ddd272374c81b094a377fde7a3e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/85b7ddd272374c81b094a377fde7a3e1"}]}] Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestEncryptedCinderVolumes-43116842 Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 85b7ddd272374c81b094a377fde7a3e1 Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-43116842 Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestEncryptedCinderVolumes-43116842-project Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: b83b49ea9a8c4f5fa6016e823ba673e9 Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestEncryptedCinderVolumes-43116842-project Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1004543844", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1708716658", "networks": [{"uuid": "ed3c2d19-cadf-4300-8f7a-53f540eb2994"}]}} Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-1004543844', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-1708716658', 'networks': [{'uuid': 'ed3c2d19-cadf-4300-8f7a-53f540eb2994'}]}}} Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:30:21.443506 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8ee94892-ef18-4784-8b4a-5fc2d94d1d59) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:30:21.454964 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-396b3650-d543-46b4-9dfd-a7c240c5f3b9 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-396b3650-d543-46b4-9dfd-a7c240c5f3b9 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.823462 Oct 04 21:30:21.472397 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1078/2160] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:30:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 834 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 21:30:21.477151 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-714630c5-6f57-4467-82a2-6b267543dd8a tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Calling method '.version_select at 0x7f77eeadbb80>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:21.585387 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-714630c5-6f57-4467-82a2-6b267543dd8a tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1708716658" status: 202 len: 0 microversion: 2.1 time: 0.131211 Oct 04 21:30:21.587262 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1083/2161] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 4 21:30:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1708716658 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:30:21.613092 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-7921e95e-7e9c-406c-8fdb-5c4f5d12b844 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Action: 'create', calling method: .version_select at 0x7f77f7331700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-704221672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdC10AlvPTF4Fu5GZ9wcIKGQOZ/4nGR/bALu9aj/F6dEm9Tr5Ao//1Rm/18jhGt1rSZ3Mtt2T+u1X6GJ1DKDdfu6VAVwoeoaPhxYpZFyjPfgYsxpL1pfVcNeLV3a/Bhsg=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:21.648063 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-7921e95e-7e9c-406c-8fdb-5c4f5d12b844 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Getting quotas for project 85b7ddd272374c81b094a377fde7a3e1. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:21.661797 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-7921e95e-7e9c-406c-8fdb-5c4f5d12b844 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Getting quotas for user b83b49ea9a8c4f5fa6016e823ba673e9 and project 85b7ddd272374c81b094a377fde7a3e1. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:21.785043 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-7921e95e-7e9c-406c-8fdb-5c4f5d12b844 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.180714 Oct 04 21:30:21.787197 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1079/2162] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:30:21 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:30:21.892121 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-189b3c87-4068-4a1f-97f1-aaa57e75aa7f tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-797293577", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-704221672", "networks": [{"uuid": "ed3c2d19-cadf-4300-8f7a-53f540eb2994"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:22.000615 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-189b3c87-4068-4a1f-97f1-aaa57e75aa7f tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] validate_networks() for [('ed3c2d19-cadf-4300-8f7a-53f540eb2994', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-189b3c87-4068-4a1f-97f1-aaa57e75aa7f tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b698402d-e824-4a7f-8086-d40609a22edc) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:30:22.316125 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b698402d-e824-4a7f-8086-d40609a22edc) Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-189b3c87-4068-4a1f-97f1-aaa57e75aa7f tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-189b3c87-4068-4a1f-97f1-aaa57e75aa7f tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Request method failure captured: Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 271 Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKXfp-9JD6o_3e1zeO6ttxrjW6P5SVpa0Ut3tndL8eIlAgAaeWWAjIhAWYTSjNKiCH_Kos264P0WPudltPWRFXf2PDFj5rqLAQ0LW-T_fkWo84cpzjcV_8zZcZjZlf7M50CQAr-533YDzDIcSF_rptRk5U_YThtX8HNNGNcDfbUI2UA Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 85b7ddd272374c81b094a377fde7a3e1 Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestEncryptedCinderVolumes-43116842 Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_85b7ddd272374c81b094a377fde7a3e1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85b7ddd272374c81b094a377fde7a3e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85b7ddd272374c81b094a377fde7a3e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/85b7ddd272374c81b094a377fde7a3e1"}]}] Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestEncryptedCinderVolumes-43116842 Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 85b7ddd272374c81b094a377fde7a3e1 Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-43116842 Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestEncryptedCinderVolumes-43116842-project Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: b83b49ea9a8c4f5fa6016e823ba673e9 Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestEncryptedCinderVolumes-43116842-project Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-797293577", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-704221672", "networks": [{"uuid": "ed3c2d19-cadf-4300-8f7a-53f540eb2994"}]}} Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:22.323013 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-797293577', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-704221672', 'networks': [{'uuid': 'ed3c2d19-cadf-4300-8f7a-53f540eb2994'}]}}} Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:30:22.338752 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b698402d-e824-4a7f-8086-d40609a22edc) Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-189b3c87-4068-4a1f-97f1-aaa57e75aa7f tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-189b3c87-4068-4a1f-97f1-aaa57e75aa7f tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.440160 Oct 04 21:30:22.346541 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1084/2163] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:30:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 448 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:30:22.353259 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-0f2b81aa-0b5b-4163-9379-024893fb0e69 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] Calling method '.version_select at 0x7f77eeb0fd30>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:22.469100 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-0f2b81aa-0b5b-4163-9379-024893fb0e69 tempest-TestEncryptedCinderVolumes-43116842 tempest-TestEncryptedCinderVolumes-43116842-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-704221672" status: 202 len: 0 microversion: 2.1 time: 0.135452 Oct 04 21:30:22.470617 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1080/2164] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 4 21:30:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-704221672 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:31:18.510787 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:18.512161 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:18.513405 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:31:18.513633 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:31:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:31:18.515365 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:31:18.515583 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:31:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:31:18.526904 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-e7f51a39-3f5e-4088-bf1a-46da79c65614 tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Action: 'create', calling method: .version_select at 0x7f77eeb36790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-107274144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh+xPhqubO9gOaetxQr4j/GUBxRxe3FNoOogiRfm14ITm9Ps0mrHXUNnvpt/XHu87oO0KHhMCF39LuOV0eC9CokdceTZNm9YxvEZcfUllppWN7wjGiVa/9EhJ1KqKUzUg=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:18.562421 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-e7f51a39-3f5e-4088-bf1a-46da79c65614 tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Getting quotas for project bb447ffc303348ce826e0d5bbb56f7f2. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:31:18.574551 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-e7f51a39-3f5e-4088-bf1a-46da79c65614 tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Getting quotas for user 0feaeaa5e2da4e15bccb37fd42695ef1 and project bb447ffc303348ce826e0d5bbb56f7f2. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:31:18.812447 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-e7f51a39-3f5e-4088-bf1a-46da79c65614 tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.303624 Oct 04 21:31:18.813255 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1085/2165] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:31:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:18.901863 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=8 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:18.903267 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:18.911109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5288d987-bca4-446d-abe1-51bb0f99382d tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-242732744", "imageRef": "f0b332dc-0c83-4b57-ae65-e6ce928d7b00", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-107274144", "networks": [{"uuid": "998c3aee-0b65-4efb-bb93-b4fc9f316b4c"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:19.011931 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-5288d987-bca4-446d-abe1-51bb0f99382d tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] validate_networks() for [('998c3aee-0b65-4efb-bb93-b4fc9f316b4c', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-5288d987-bca4-446d-abe1-51bb0f99382d tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b2aedde5-183e-4087-9849-5f07f602877c) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:31:19.456559 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b2aedde5-183e-4087-9849-5f07f602877c) Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-5288d987-bca4-446d-abe1-51bb0f99382d tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5288d987-bca4-446d-abe1-51bb0f99382d tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Request method failure captured: Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 267 Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKYKjY_qycpaA5poF0XtMTtMeT3zruq4KA4KG3MjVZP8OFoeeV3K3w3-vCZVh_P2a-o23Szc051rbp3c3LAySzX-S6sQSbU7orE81UEPPNVYW67NhliGMJ0DAmgBWF7FCPkDYZtzJXSRE985dj1jdBBxNA_m0bJ12KOZ_QVnFfBI9uc Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: bb447ffc303348ce826e0d5bbb56f7f2 Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestMinimumBasicScenario-887229371 Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bb447ffc303348ce826e0d5bbb56f7f2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bb447ffc303348ce826e0d5bbb56f7f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bb447ffc303348ce826e0d5bbb56f7f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bb447ffc303348ce826e0d5bbb56f7f2"}]}] Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestMinimumBasicScenario-887229371 Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: bb447ffc303348ce826e0d5bbb56f7f2 Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestMinimumBasicScenario-887229371 Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestMinimumBasicScenario-887229371-project Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 0feaeaa5e2da4e15bccb37fd42695ef1 Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestMinimumBasicScenario-887229371-project Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-TestMinimumBasicScenario-server-242732744", "imageRef": "f0b332dc-0c83-4b57-ae65-e6ce928d7b00", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-107274144", "networks": [{"uuid": "998c3aee-0b65-4efb-bb93-b4fc9f316b4c"}]}} Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:31:19.462647 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-TestMinimumBasicScenario-server-242732744', 'imageRef': 'f0b332dc-0c83-4b57-ae65-e6ce928d7b00', 'flavorRef': '452', 'key_name': 'tempest-TestMinimumBasicScenario-107274144', 'networks': [{'uuid': '998c3aee-0b65-4efb-bb93-b4fc9f316b4c'}]}}} Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:31:19.468359 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b2aedde5-183e-4087-9849-5f07f602877c) Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-5288d987-bca4-446d-abe1-51bb0f99382d tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-5288d987-bca4-446d-abe1-51bb0f99382d tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.519801 Oct 04 21:31:19.475377 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1081/2166] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:31:18 2022] POST /compute/v2.1/servers => generated 214 bytes in 522 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:31:19.480333 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6d4c3955-c622-4d1d-8e37-2ce941480709 tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Calling method '.version_select at 0x7f77eea36790>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:19.575165 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6d4c3955-c622-4d1d-8e37-2ce941480709 tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-107274144" status: 202 len: 0 microversion: 2.1 time: 0.139474 Oct 04 21:31:19.576592 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1086/2167] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 21:31:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-107274144 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:31:37.228350 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:37.236060 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-3fa41675-272e-409e-b9ca-7de97b7375e0 tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Action: 'create', calling method: .version_select at 0x7f77eec90700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-807442866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOlul3Rea0uuxP1nOcdbO0oIgmvngJsOGHuLjK5kQJd+sFyBmB/6y3jTC49o1UmW6kyrTdK8RJnw7jE8OjsJpF7iq1wIOcO3ozvwjtIPG79qUQXdc79n1iyv8Kyshm7yA=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:37.269199 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-3fa41675-272e-409e-b9ca-7de97b7375e0 tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Getting quotas for project bb447ffc303348ce826e0d5bbb56f7f2. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:31:37.280361 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-3fa41675-272e-409e-b9ca-7de97b7375e0 tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Getting quotas for user 0feaeaa5e2da4e15bccb37fd42695ef1 and project bb447ffc303348ce826e0d5bbb56f7f2. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:31:37.412964 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-3fa41675-272e-409e-b9ca-7de97b7375e0 tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.185989 Oct 04 21:31:37.414140 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1082/2168] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:31:37 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:37.505190 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:37.507767 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:37.514694 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-622e8da6-1172-4b61-a279-d7e6d0f8ddcb tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-305677757", "imageRef": "83d56bfc-e19a-47fc-a0cc-edab37068eff", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-807442866", "networks": [{"uuid": "998c3aee-0b65-4efb-bb93-b4fc9f316b4c"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:37.614514 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-622e8da6-1172-4b61-a279-d7e6d0f8ddcb tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] validate_networks() for [('998c3aee-0b65-4efb-bb93-b4fc9f316b4c', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-622e8da6-1172-4b61-a279-d7e6d0f8ddcb tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ef01766e-705b-4a6f-85e6-7749233a9f1b) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:31:38.042102 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ef01766e-705b-4a6f-85e6-7749233a9f1b) Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-622e8da6-1172-4b61-a279-d7e6d0f8ddcb tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-622e8da6-1172-4b61-a279-d7e6d0f8ddcb tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Request method failure captured: Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 267 Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKYKjY_qycpaA5poF0XtMTtMeT3zruq4KA4KG3MjVZP8OFoeeV3K3w3-vCZVh_P2a-o23Szc051rbp3c3LAySzX-S6sQSbU7orE81UEPPNVYW67NhliGMJ0DAmgBWF7FCPkDYZtzJXSRE985dj1jdBBxNA_m0bJ12KOZ_QVnFfBI9uc Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: bb447ffc303348ce826e0d5bbb56f7f2 Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestMinimumBasicScenario-887229371 Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bb447ffc303348ce826e0d5bbb56f7f2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bb447ffc303348ce826e0d5bbb56f7f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bb447ffc303348ce826e0d5bbb56f7f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bb447ffc303348ce826e0d5bbb56f7f2"}]}] Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestMinimumBasicScenario-887229371 Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: bb447ffc303348ce826e0d5bbb56f7f2 Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestMinimumBasicScenario-887229371 Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestMinimumBasicScenario-887229371-project Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 0feaeaa5e2da4e15bccb37fd42695ef1 Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestMinimumBasicScenario-887229371-project Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestMinimumBasicScenario-server-305677757", "imageRef": "83d56bfc-e19a-47fc-a0cc-edab37068eff", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-807442866", "networks": [{"uuid": "998c3aee-0b65-4efb-bb93-b4fc9f316b4c"}]}} Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:31:38.048805 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestMinimumBasicScenario-server-305677757', 'imageRef': '83d56bfc-e19a-47fc-a0cc-edab37068eff', 'flavorRef': '452', 'key_name': 'tempest-TestMinimumBasicScenario-807442866', 'networks': [{'uuid': '998c3aee-0b65-4efb-bb93-b4fc9f316b4c'}]}}} Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:31:38.055773 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ef01766e-705b-4a6f-85e6-7749233a9f1b) Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-622e8da6-1172-4b61-a279-d7e6d0f8ddcb tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-622e8da6-1172-4b61-a279-d7e6d0f8ddcb tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.548532 Oct 04 21:31:38.070594 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1087/2169] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:31:37 2022] POST /compute/v2.1/servers => generated 214 bytes in 551 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:31:38.074856 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-4d49d963-8849-4ef2-b95d-82caa529e382 tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] Calling method '.version_select at 0x7f77f4a059d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:38.205564 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-4d49d963-8849-4ef2-b95d-82caa529e382 tempest-TestMinimumBasicScenario-887229371 tempest-TestMinimumBasicScenario-887229371-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-807442866" status: 202 len: 0 microversion: 2.1 time: 0.144763 Oct 04 21:31:38.206551 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1083/2170] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 21:31:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-807442866 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:31:59.402316 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:59.762217 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-72de4e97-d55f-4416-8f0e-ddf76bcccaa4 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Action: 'create', calling method: .version_select at 0x7f77eea34160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1869835532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkxFIFS+5h/0K4Sfnb+NLT37v+ViFHdqwBOUbGGhjepJ4ALHOmHFIlCkuB1QC5XpGYQgYimnvOTWgZoj6lZKfTy+jVzREW/Wy8sbJfrJQDvSVHw3CVNdc9zznbN8hnp+g=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:59.797619 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-72de4e97-d55f-4416-8f0e-ddf76bcccaa4 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Getting quotas for project 6fc5c72665164a0c8d9e7e476c283e98. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:31:59.808673 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-72de4e97-d55f-4416-8f0e-ddf76bcccaa4 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Getting quotas for user 7b1f3277f1cd436ba2d864142da13dce and project 6fc5c72665164a0c8d9e7e476c283e98. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:31:59.931439 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-72de4e97-d55f-4416-8f0e-ddf76bcccaa4 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.530998 Oct 04 21:31:59.932473 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1088/2171] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:31:59 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:14.796180 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:14.797767 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:14.806773 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-25a7e7ef-f314-4998-b7e9-64a5a4148cff tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-135497027", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "76daae96-6421-44e2-8529-62ef69164d2e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1869835532", "security_groups": [{"name": "tempest-secgroup-smoke-837291908"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:15.019613 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-25a7e7ef-f314-4998-b7e9-64a5a4148cff tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] validate_networks() for [('76daae96-6421-44e2-8529-62ef69164d2e', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-25a7e7ef-f314-4998-b7e9-64a5a4148cff tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bb866013-38e2-42fc-84a5-bad9d7467f0d) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:32:15.449812 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bb866013-38e2-42fc-84a5-bad9d7467f0d) Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-25a7e7ef-f314-4998-b7e9-64a5a4148cff tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:32:15.458068 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-25a7e7ef-f314-4998-b7e9-64a5a4148cff tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Request method failure captured: Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 343 Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKZO3Z6nPsqBBkZLNyrsucJ8ArIOHKNHdWte29Ok2rAWH9GZUXmfKzgp-QJVL5HMIjIjPbHv6Zmm2Pxq06qGDFN__Ud4TnEmE5McKarA6fgsgNFqnv_JJxRucwtx8xhkRjOPfiJJakwGZnQ4HorP0EnxOQjPOEY-9T8A1cLC7kqESF0 Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 6fc5c72665164a0c8d9e7e476c283e98 Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6fc5c72665164a0c8d9e7e476c283e98", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6fc5c72665164a0c8d9e7e476c283e98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6fc5c72665164a0c8d9e7e476c283e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6fc5c72665164a0c8d9e7e476c283e98"}]}] Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 6fc5c72665164a0c8d9e7e476c283e98 Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestNetworkAdvancedServerOps-377206252-project Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 7b1f3277f1cd436ba2d864142da13dce Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestNetworkAdvancedServerOps-377206252-project Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-135497027", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "76daae96-6421-44e2-8529-62ef69164d2e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1869835532", "security_groups": [{"name": "tempest-secgroup-smoke-837291908"}]}} Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-135497027', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '76daae96-6421-44e2-8529-62ef69164d2e'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1869835532', 'security_groups': [{'name': 'tempest-secgroup-smoke-837291908'}]}}} Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:32:15.476027 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bb866013-38e2-42fc-84a5-bad9d7467f0d) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:32:15.482746 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-25a7e7ef-f314-4998-b7e9-64a5a4148cff tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-25a7e7ef-f314-4998-b7e9-64a5a4148cff tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.679774 Oct 04 21:32:15.491109 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1084/2172] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:32:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 683 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 21:32:23.009724 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6bc3833d-171c-4e7c-8206-378db21a428a tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Calling method '.version_select at 0x7f77eea2f670>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:23.017965 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:23.018872 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:23.177183 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6bc3833d-171c-4e7c-8206-378db21a428a tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1869835532" status: 202 len: 0 microversion: 2.1 time: 0.171706 Oct 04 21:32:23.178008 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1089/2173] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Oct 4 21:32:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1869835532 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:32:23.202520 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-9a645de7-6b8a-4c29-ba4f-91dac63fd1bd tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Action: 'create', calling method: .version_select at 0x7f77eeb2a3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1964061042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZuzskrJ9pSwHCSO7t4918Hn+8QfzEPVwK/1IJBx+7XdkXj8ofeYCSwZUDikjyAcxs5Px+Uv9hk5sj1RBWfNw4y10R51s1P4MXu4Wal7pev4x8veaVT3ASby/GCr/scfQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:23.234218 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-9a645de7-6b8a-4c29-ba4f-91dac63fd1bd tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Getting quotas for project 6fc5c72665164a0c8d9e7e476c283e98. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:23.245356 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-9a645de7-6b8a-4c29-ba4f-91dac63fd1bd tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Getting quotas for user 7b1f3277f1cd436ba2d864142da13dce and project 6fc5c72665164a0c8d9e7e476c283e98. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:23.378025 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-9a645de7-6b8a-4c29-ba4f-91dac63fd1bd tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.183579 Oct 04 21:32:23.379607 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1085/2174] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:32:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:38.777959 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-80447bca-f131-42dd-a045-3bce8283bafd tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-798164549", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "1f0188cc-e7b9-4a59-96eb-bff5f373b8df"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1964061042", "security_groups": [{"name": "tempest-secgroup-smoke-784476948"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:38.989557 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-80447bca-f131-42dd-a045-3bce8283bafd tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] validate_networks() for [('1f0188cc-e7b9-4a59-96eb-bff5f373b8df', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-80447bca-f131-42dd-a045-3bce8283bafd tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1f145378-8816-4e86-b4a9-e05d528ebd87) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:32:39.404714 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1f145378-8816-4e86-b4a9-e05d528ebd87) Oct 04 21:32:39.410743 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:32:39.413861 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-80447bca-f131-42dd-a045-3bce8283bafd tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:32:39.413861 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-80447bca-f131-42dd-a045-3bce8283bafd tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Request method failure captured: Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 343 Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKZO3Z6nPsqBBkZLNyrsucJ8ArIOHKNHdWte29Ok2rAWH9GZUXmfKzgp-QJVL5HMIjIjPbHv6Zmm2Pxq06qGDFN__Ud4TnEmE5McKarA6fgsgNFqnv_JJxRucwtx8xhkRjOPfiJJakwGZnQ4HorP0EnxOQjPOEY-9T8A1cLC7kqESF0 Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 6fc5c72665164a0c8d9e7e476c283e98 Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6fc5c72665164a0c8d9e7e476c283e98", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6fc5c72665164a0c8d9e7e476c283e98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6fc5c72665164a0c8d9e7e476c283e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6fc5c72665164a0c8d9e7e476c283e98"}]}] Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 6fc5c72665164a0c8d9e7e476c283e98 Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestNetworkAdvancedServerOps-377206252-project Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 7b1f3277f1cd436ba2d864142da13dce Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestNetworkAdvancedServerOps-377206252-project Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-798164549", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "1f0188cc-e7b9-4a59-96eb-bff5f373b8df"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1964061042", "security_groups": [{"name": "tempest-secgroup-smoke-784476948"}]}} Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-798164549', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': '1f0188cc-e7b9-4a59-96eb-bff5f373b8df'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1964061042', 'security_groups': [{'name': 'tempest-secgroup-smoke-784476948'}]}}} Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:32:39.416474 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1f145378-8816-4e86-b4a9-e05d528ebd87) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:32:39.428106 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-80447bca-f131-42dd-a045-3bce8283bafd tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-80447bca-f131-42dd-a045-3bce8283bafd tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.650834 Oct 04 21:32:39.437928 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1090/2175] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:32:38 2022] POST /compute/v2.1/servers => generated 214 bytes in 656 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:32:46.759867 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:46.761510 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:46.769935 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b87dc106-32e3-4ad9-a6ea-2340d810f03f tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Calling method '.version_select at 0x7f77eeb2ab80>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:46.925207 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b87dc106-32e3-4ad9-a6ea-2340d810f03f tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1964061042" status: 202 len: 0 microversion: 2.1 time: 0.166589 Oct 04 21:32:46.926291 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1086/2176] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Oct 4 21:32:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1964061042 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:32:46.951507 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-173fe6b1-bb99-40a1-b84c-c1fa4fa5ed23 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Action: 'create', calling method: .version_select at 0x7f77eeaa7430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1319722986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9d5AvN2lZjeFy/eSbkuqSEPvQ+mgiHduBTmUZJB58MjEZk9FGNPgWbq7uDgfRjok4c338IyhJ4UzV5uvOt60tO/l4RK2s98bf3vQ5gM6y3BFO4/CXZkUAUpepkSB6VGA=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:46.993324 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-173fe6b1-bb99-40a1-b84c-c1fa4fa5ed23 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Getting quotas for project 6fc5c72665164a0c8d9e7e476c283e98. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:47.000923 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-173fe6b1-bb99-40a1-b84c-c1fa4fa5ed23 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Getting quotas for user 7b1f3277f1cd436ba2d864142da13dce and project 6fc5c72665164a0c8d9e7e476c283e98. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:47.152846 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-173fe6b1-bb99-40a1-b84c-c1fa4fa5ed23 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.210480 Oct 04 21:32:47.154875 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1091/2177] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:32:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:01.508804 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-46ac6281-5ff4-4f21-8edb-311f2d599f4f tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-533257461", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "c6775902-8faa-40a7-b7f0-24bf091bf915"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1319722986", "security_groups": [{"name": "tempest-secgroup-smoke-1701005403"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:01.807856 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-46ac6281-5ff4-4f21-8edb-311f2d599f4f tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] validate_networks() for [('c6775902-8faa-40a7-b7f0-24bf091bf915', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-46ac6281-5ff4-4f21-8edb-311f2d599f4f tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9197eb14-b81b-461d-9e23-29f302506ae0) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:33:02.285447 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9197eb14-b81b-461d-9e23-29f302506ae0) Oct 04 21:33:02.292282 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:02.296833 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-46ac6281-5ff4-4f21-8edb-311f2d599f4f tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:02.296833 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-46ac6281-5ff4-4f21-8edb-311f2d599f4f tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Request method failure captured: Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 344 Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKZO3Z6nPsqBBkZLNyrsucJ8ArIOHKNHdWte29Ok2rAWH9GZUXmfKzgp-QJVL5HMIjIjPbHv6Zmm2Pxq06qGDFN__Ud4TnEmE5McKarA6fgsgNFqnv_JJxRucwtx8xhkRjOPfiJJakwGZnQ4HorP0EnxOQjPOEY-9T8A1cLC7kqESF0 Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 6fc5c72665164a0c8d9e7e476c283e98 Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6fc5c72665164a0c8d9e7e476c283e98", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6fc5c72665164a0c8d9e7e476c283e98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6fc5c72665164a0c8d9e7e476c283e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6fc5c72665164a0c8d9e7e476c283e98"}]}] Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 6fc5c72665164a0c8d9e7e476c283e98 Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestNetworkAdvancedServerOps-377206252-project Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 7b1f3277f1cd436ba2d864142da13dce Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestNetworkAdvancedServerOps-377206252-project Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-533257461", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "c6775902-8faa-40a7-b7f0-24bf091bf915"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1319722986", "security_groups": [{"name": "tempest-secgroup-smoke-1701005403"}]}} Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-533257461', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'c6775902-8faa-40a7-b7f0-24bf091bf915'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1319722986', 'security_groups': [{'name': 'tempest-secgroup-smoke-1701005403'}]}}} Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:33:02.303366 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9197eb14-b81b-461d-9e23-29f302506ae0) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:02.310319 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:02.322357 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:02.328469 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-46ac6281-5ff4-4f21-8edb-311f2d599f4f tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:02.328469 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:02.329999 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-46ac6281-5ff4-4f21-8edb-311f2d599f4f tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.825997 Oct 04 21:33:02.331431 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1087/2178] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:33:01 2022] POST /compute/v2.1/servers => generated 214 bytes in 831 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 21:33:09.285486 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:09.288426 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:09.299558 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-c41da101-6798-40e0-954a-004bd4cca6aa tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Calling method '.version_select at 0x7f77eeaa1670>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:09.454721 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-c41da101-6798-40e0-954a-004bd4cca6aa tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1319722986" status: 202 len: 0 microversion: 2.1 time: 0.172005 Oct 04 21:33:09.455659 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1092/2179] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Oct 4 21:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1319722986 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:33:09.479016 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2f9ac06a-b566-411d-9229-db5dbf5c1e13 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Action: 'create', calling method: .version_select at 0x7f77f753cb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1092172141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb6au3ihTc6X3ecESQJrChJsgIzmdSiuD7VB1aC+YVtLs2UZX6Uoyr4+ILyWd+JdnKXMRbewPjut67BjCSYNnAhjULmTN+oHMgkdF7HDUMqlvxKgVPbGnGgwKziabncCQ=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:09.514554 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-2f9ac06a-b566-411d-9229-db5dbf5c1e13 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Getting quotas for project 6fc5c72665164a0c8d9e7e476c283e98. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:33:09.525438 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-2f9ac06a-b566-411d-9229-db5dbf5c1e13 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Getting quotas for user 7b1f3277f1cd436ba2d864142da13dce and project 6fc5c72665164a0c8d9e7e476c283e98. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:33:09.713653 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2f9ac06a-b566-411d-9229-db5dbf5c1e13 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.242662 Oct 04 21:33:09.715187 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1088/2180] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:33:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:24.313488 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3981702b-aa64-430a-9ae8-e1734a82fb4d tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1688394926", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "d1e24038-f5b9-4c89-b219-2da945f09d84"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1092172141", "security_groups": [{"name": "tempest-secgroup-smoke-1893449357"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:24.526110 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-3981702b-aa64-430a-9ae8-e1734a82fb4d tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] validate_networks() for [('d1e24038-f5b9-4c89-b219-2da945f09d84', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-3981702b-aa64-430a-9ae8-e1734a82fb4d tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-543d231d-9533-4424-8f82-6c38e7ebef73) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:33:24.925971 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-543d231d-9533-4424-8f82-6c38e7ebef73) Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-3981702b-aa64-430a-9ae8-e1734a82fb4d tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3981702b-aa64-430a-9ae8-e1734a82fb4d tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Request method failure captured: Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 345 Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKZO3Z6nPsqBBkZLNyrsucJ8ArIOHKNHdWte29Ok2rAWH9GZUXmfKzgp-QJVL5HMIjIjPbHv6Zmm2Pxq06qGDFN__Ud4TnEmE5McKarA6fgsgNFqnv_JJxRucwtx8xhkRjOPfiJJakwGZnQ4HorP0EnxOQjPOEY-9T8A1cLC7kqESF0 Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 6fc5c72665164a0c8d9e7e476c283e98 Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6fc5c72665164a0c8d9e7e476c283e98", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6fc5c72665164a0c8d9e7e476c283e98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6fc5c72665164a0c8d9e7e476c283e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6fc5c72665164a0c8d9e7e476c283e98"}]}] Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 6fc5c72665164a0c8d9e7e476c283e98 Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestNetworkAdvancedServerOps-377206252-project Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 7b1f3277f1cd436ba2d864142da13dce Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestNetworkAdvancedServerOps-377206252-project Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1688394926", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "d1e24038-f5b9-4c89-b219-2da945f09d84"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1092172141", "security_groups": [{"name": "tempest-secgroup-smoke-1893449357"}]}} Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:24.935638 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1688394926', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'd1e24038-f5b9-4c89-b219-2da945f09d84'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1092172141', 'security_groups': [{'name': 'tempest-secgroup-smoke-1893449357'}]}}} Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:33:24.943435 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-543d231d-9533-4424-8f82-6c38e7ebef73) Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-3981702b-aa64-430a-9ae8-e1734a82fb4d tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-3981702b-aa64-430a-9ae8-e1734a82fb4d tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.627563 Oct 04 21:33:24.950800 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1093/2181] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:33:24 2022] POST /compute/v2.1/servers => generated 214 bytes in 629 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:33:31.643617 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:31.644929 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:31.653148 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-b09c90b0-c308-453b-bd40-809feeaaf7e5 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Calling method '.version_select at 0x7f77eec909d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:31.794008 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-b09c90b0-c308-453b-bd40-809feeaaf7e5 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1092172141" status: 202 len: 0 microversion: 2.1 time: 0.150366 Oct 04 21:33:31.795119 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1089/2182] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Oct 4 21:33:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1092172141 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:33:31.818623 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-301a8c63-19d4-404b-b8c1-313a26d730bb tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Action: 'create', calling method: .version_select at 0x7f77eed03700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1448702563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzjGuG4eNfwtjxDHtJsx6A2ocX0lCLPlA8FS0mNMOvEPm6BEnB0trqO8Mt2pdE/Ph3JBcKRoEnmuCZtqQX0Il9jcmNXOpMH55KLaWTaEHEPVQk87CLcadRsuj1pDCqfsw=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:31.849592 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-301a8c63-19d4-404b-b8c1-313a26d730bb tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Getting quotas for project 6fc5c72665164a0c8d9e7e476c283e98. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:33:31.861071 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-301a8c63-19d4-404b-b8c1-313a26d730bb tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Getting quotas for user 7b1f3277f1cd436ba2d864142da13dce and project 6fc5c72665164a0c8d9e7e476c283e98. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:33:31.992919 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-301a8c63-19d4-404b-b8c1-313a26d730bb tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.181953 Oct 04 21:33:31.994039 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1094/2183] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:33:31 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:46.924382 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d7c95e96-d3ab-44d4-ad69-4cf266c03879 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-325241308", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "d25972dc-60d0-47f5-b831-4a3bf81123c2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1448702563", "security_groups": [{"name": "tempest-secgroup-smoke-848597109"}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:47.176959 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-d7c95e96-d3ab-44d4-ad69-4cf266c03879 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] validate_networks() for [('d25972dc-60d0-47f5-b831-4a3bf81123c2', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-d7c95e96-d3ab-44d4-ad69-4cf266c03879 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd092647-a297-41fd-91b7-b2fb88e15d53) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:33:47.646785 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd092647-a297-41fd-91b7-b2fb88e15d53) Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-d7c95e96-d3ab-44d4-ad69-4cf266c03879 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d7c95e96-d3ab-44d4-ad69-4cf266c03879 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Request method failure captured: Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 343 Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKZO3Z6nPsqBBkZLNyrsucJ8ArIOHKNHdWte29Ok2rAWH9GZUXmfKzgp-QJVL5HMIjIjPbHv6Zmm2Pxq06qGDFN__Ud4TnEmE5McKarA6fgsgNFqnv_JJxRucwtx8xhkRjOPfiJJakwGZnQ4HorP0EnxOQjPOEY-9T8A1cLC7kqESF0 Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 6fc5c72665164a0c8d9e7e476c283e98 Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6fc5c72665164a0c8d9e7e476c283e98", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6fc5c72665164a0c8d9e7e476c283e98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6fc5c72665164a0c8d9e7e476c283e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6fc5c72665164a0c8d9e7e476c283e98"}]}] Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 6fc5c72665164a0c8d9e7e476c283e98 Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-377206252 Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestNetworkAdvancedServerOps-377206252-project Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 7b1f3277f1cd436ba2d864142da13dce Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestNetworkAdvancedServerOps-377206252-project Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-325241308", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "networks": [{"uuid": "d25972dc-60d0-47f5-b831-4a3bf81123c2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1448702563", "security_groups": [{"name": "tempest-secgroup-smoke-848597109"}]}} Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:47.663822 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-325241308', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'networks': [{'uuid': 'd25972dc-60d0-47f5-b831-4a3bf81123c2'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1448702563', 'security_groups': [{'name': 'tempest-secgroup-smoke-848597109'}]}}} Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:33:47.668936 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd092647-a297-41fd-91b7-b2fb88e15d53) Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-d7c95e96-d3ab-44d4-ad69-4cf266c03879 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-d7c95e96-d3ab-44d4-ad69-4cf266c03879 tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.741985 Oct 04 21:33:47.676963 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1090/2184] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:33:46 2022] POST /compute/v2.1/servers => generated 214 bytes in 745 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:33:54.668782 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:54.670301 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:54.678497 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-6f773e72-ee18-4e13-88a2-b2b0fc001dbe tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] Calling method '.version_select at 0x7f77eeaa1a60>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:54.842688 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-6f773e72-ee18-4e13-88a2-b2b0fc001dbe tempest-TestNetworkAdvancedServerOps-377206252 tempest-TestNetworkAdvancedServerOps-377206252-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1448702563" status: 202 len: 0 microversion: 2.1 time: 0.177200 Oct 04 21:33:54.843478 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1095/2185] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Oct 4 21:33:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1448702563 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:34:20.416731 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:34:20.417680 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:34:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:34:20.418990 n-d-852085-12 devstack@n-api.service[123540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:34:20.419451 n-d-852085-12 devstack@n-api.service[123540]: Tue Oct 4 21:34:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.78) !!! Oct 04 21:34:20.421471 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:20.750930 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-c6292dae-3b9a-4a55-aa3b-9c450636e792 tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Action: 'create', calling method: .version_select at 0x7f77ef2094c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-49463459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFPITq03csVBUbaz3nKGbhSg0ZCrrBTzGoBIjRxi4nH/utBbiF/FSuOtWtDkpzU//yV2cbntNqH7QJuWkIJuZG8/6BTLNKbXb1t/b68u1QIK+Ejw3pvFNSOVa1enjMoyw=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:20.777155 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-c6292dae-3b9a-4a55-aa3b-9c450636e792 tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Getting quotas for project 6a14a0b665fd4c4d98138e39f75314bc. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:34:20.786755 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-c6292dae-3b9a-4a55-aa3b-9c450636e792 tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Getting quotas for user 570063e6ff0b4ef383149d832a7768c0 and project 6a14a0b665fd4c4d98138e39f75314bc. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:34:20.922637 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-c6292dae-3b9a-4a55-aa3b-9c450636e792 tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.507236 Oct 04 21:34:20.924286 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1091/2186] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:34:20 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:34:24.899170 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d1822eed-02f4-4a4f-acee-a513ef3b509e tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1968543934", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-49463459", "security_groups": [{"name": "tempest-secgroup-smoke-520758528"}], "networks": [{"uuid": "a06351c4-36af-4262-9946-3608cacb37bd"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:25.317187 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-d1822eed-02f4-4a4f-acee-a513ef3b509e tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] validate_networks() for [('a06351c4-36af-4262-9946-3608cacb37bd', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-d1822eed-02f4-4a4f-acee-a513ef3b509e tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a1a9c2bb-b258-4544-b6fb-4f77a90da9d0) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:34:25.654360 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a1a9c2bb-b258-4544-b6fb-4f77a90da9d0) Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-d1822eed-02f4-4a4f-acee-a513ef3b509e tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d1822eed-02f4-4a4f-acee-a513ef3b509e tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Request method failure captured: Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 322 Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKbQOrdNgF2ibFBGvnlSlrGNNZHUeSxPvaP0MrPqPoud19MrFe-rViblOY9DjiOjLIM1nYlGd0-Mcyk5xntJH2Bh9hlFn901KZDpDH9ApaEtrxcPeMX0xULI88Ayb7J83tAY5xdKB8ZAu0AD0zLwprfRNNd-9WGMTKV1XgDrJP0OubU Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: 6a14a0b665fd4c4d98138e39f75314bc Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestShelveInstance-34956895 Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6a14a0b665fd4c4d98138e39f75314bc", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6a14a0b665fd4c4d98138e39f75314bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6a14a0b665fd4c4d98138e39f75314bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6a14a0b665fd4c4d98138e39f75314bc"}]}] Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestShelveInstance-34956895 Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: 6a14a0b665fd4c4d98138e39f75314bc Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestShelveInstance-34956895 Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestShelveInstance-34956895-project Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 570063e6ff0b4ef383149d832a7768c0 Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestShelveInstance-34956895-project Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestShelveInstance-server-1968543934", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-49463459", "security_groups": [{"name": "tempest-secgroup-smoke-520758528"}], "networks": [{"uuid": "a06351c4-36af-4262-9946-3608cacb37bd"}]}} Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:34:25.675914 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestShelveInstance-server-1968543934', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'key_name': 'tempest-TestShelveInstance-49463459', 'security_groups': [{'name': 'tempest-secgroup-smoke-520758528'}], 'networks': [{'uuid': 'a06351c4-36af-4262-9946-3608cacb37bd'}]}}} Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:34:25.682962 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a1a9c2bb-b258-4544-b6fb-4f77a90da9d0) Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-d1822eed-02f4-4a4f-acee-a513ef3b509e tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-d1822eed-02f4-4a4f-acee-a513ef3b509e tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.771913 Oct 04 21:34:25.691982 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1096/2187] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:34:24 2022] POST /compute/v2.1/servers => generated 214 bytes in 775 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 04 21:34:26.168153 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-bbf823f9-165a-4a31-859c-16550574d5f1 tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Calling method '.version_select at 0x7f77f7331700>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:26.293448 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-bbf823f9-165a-4a31-859c-16550574d5f1 tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-49463459" status: 202 len: 0 microversion: 2.1 time: 0.131706 Oct 04 21:34:26.294419 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1092/2188] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 21:34:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-49463459 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:34:26.317318 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-172d7038-c7d8-49ab-b91f-186e2c1efe67 tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Action: 'create', calling method: .version_select at 0x7f77ef03ee50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1219410960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzrAzdui7P3e4I8nKr9/4ZjnBC3bMX6Vrw7dJQeEbn403DPG+urvVHFK+dCGnYu6O17jtnJDXocSlLH/73CF1lGMj89rxXwt9avTBmq70q3Ui9kFT2OpsDMt0Q2C1e9OA=="}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:26.341241 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-172d7038-c7d8-49ab-b91f-186e2c1efe67 tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Getting quotas for project 6a14a0b665fd4c4d98138e39f75314bc. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:34:26.351499 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.quota [None req-172d7038-c7d8-49ab-b91f-186e2c1efe67 tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Getting quotas for user 570063e6ff0b4ef383149d832a7768c0 and project 6a14a0b665fd4c4d98138e39f75314bc. Resources: {'key_pairs'} {{(pid=123539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:34:26.487862 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-172d7038-c7d8-49ab-b91f-186e2c1efe67 tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.177096 Oct 04 21:34:26.488946 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1097/2189] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:34:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:03.904988 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_cell0:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:03.906591 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:03.915244 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-19adbc42-5a50-4f7c-9f32-bb5673af1bbb tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2111890094", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1219410960", "security_groups": [{"name": "tempest-secgroup-smoke-1426684595"}], "networks": [{"uuid": "a06351c4-36af-4262-9946-3608cacb37bd"}], "block_device_mapping_v2": [{"uuid": "344a22d2-b282-4042-9c97-6fe68a107a20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:04.116388 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.network.neutron [None req-19adbc42-5a50-4f7c-9f32-bb5673af1bbb tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] validate_networks() for [('a06351c4-36af-4262-9946-3608cacb37bd', None, None, None, None, None)] {{(pid=123540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [None req-19adbc42-5a50-4f7c-9f32-bb5673af1bbb tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a03b3c4-3db7-4baf-88e0-91cdf87982ba) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:35:04.496830 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a03b3c4-3db7-4baf-88e0-91cdf87982ba) Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.wsgi [None req-19adbc42-5a50-4f7c-9f32-bb5673af1bbb tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-19adbc42-5a50-4f7c-9f32-bb5673af1bbb tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Request method failure captured: Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: Accept: application/json Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: Accept-Encoding: identity Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: Connection: close Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: Content-Length: 471 Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: Content-Type: application/json Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: Host: 10.222.0.78 Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: Openstack-System-Scope: None Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: User-Agent: python-urllib3/1.26.12 Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Auth-Token: gAAAAABjPKbQOrdNgF2ibFBGvnlSlrGNNZHUeSxPvaP0MrPqPoud19MrFe-rViblOY9DjiOjLIM1nYlGd0-Mcyk5xntJH2Bh9hlFn901KZDpDH9ApaEtrxcPeMX0xULI88Ayb7J83tAY5xdKB8ZAu0AD0zLwprfRNNd-9WGMTKV1XgDrJP0OubU Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Id: None Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Domain-Name: None Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Identity-Status: Confirmed Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Is-Admin-Project: True Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Id: default Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Domain-Name: Default Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Id: 6a14a0b665fd4c4d98138e39f75314bc Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Project-Name: tempest-TestShelveInstance-34956895 Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Role: member,reader Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Roles: member,reader Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6a14a0b665fd4c4d98138e39f75314bc", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6a14a0b665fd4c4d98138e39f75314bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6a14a0b665fd4c4d98138e39f75314bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6a14a0b665fd4c4d98138e39f75314bc"}]}] Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant: tempest-TestShelveInstance-34956895 Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Id: 6a14a0b665fd4c4d98138e39f75314bc Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-Tenant-Name: tempest-TestShelveInstance-34956895 Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-User: tempest-TestShelveInstance-34956895-project Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Id: default Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-User-Domain-Name: Default Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-User-Id: 570063e6ff0b4ef383149d832a7768c0 Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: X-User-Name: tempest-TestShelveInstance-34956895-project Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: {"server": {"name": "tempest-TestShelveInstance-server-2111890094", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1219410960", "security_groups": [{"name": "tempest-secgroup-smoke-1426684595"}], "networks": [{"uuid": "a06351c4-36af-4262-9946-3608cacb37bd"}], "block_device_mapping_v2": [{"uuid": "344a22d2-b282-4042-9c97-6fe68a107a20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: method: > Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:35:04.503860 n-d-852085-12 devstack@n-api.service[123540]: Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: action_args: {'body': {'server': {'name': 'tempest-TestShelveInstance-server-2111890094', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestShelveInstance-1219410960', 'security_groups': [{'name': 'tempest-secgroup-smoke-1426684595'}], 'networks': [{'uuid': 'a06351c4-36af-4262-9946-3608cacb37bd'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '344a22d2-b282-4042-9c97-6fe68a107a20'}]}}} Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:35:04.509685 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a03b3c4-3db7-4baf-88e0-91cdf87982ba) Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: ERROR nova.api.openstack.wsgi Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-19adbc42-5a50-4f7c-9f32-bb5673af1bbb tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: {{(pid=123540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-19adbc42-5a50-4f7c-9f32-bb5673af1bbb tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.600671 Oct 04 21:35:04.514068 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1093/2190] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:35:03 2022] POST /compute/v2.1/servers => generated 214 bytes in 603 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:35:04.923833 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_cell0:SELECT=4 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:04.925236 n-d-852085-12 devstack@n-api.service[123539]: DEBUG dbcounter [-] [123539] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:04.927315 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:35:04.927507 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:35:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219410960 (ip 10.222.0.78) !!! Oct 04 21:35:04.930243 n-d-852085-12 devstack@n-api.service[123539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:35:04.930243 n-d-852085-12 devstack@n-api.service[123539]: Tue Oct 4 21:35:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219410960 (ip 10.222.0.78) !!! Oct 04 21:35:04.940197 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-5b407b4b-f385-4a84-9fe3-920e92885862 tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] Calling method '.version_select at 0x7f77eed98670>' {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:05.077192 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-5b407b4b-f385-4a84-9fe3-920e92885862 tempest-TestShelveInstance-34956895 tempest-TestShelveInstance-34956895-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219410960" status: 202 len: 0 microversion: 2.1 time: 0.155935 Oct 04 21:35:05.078237 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1098/2191] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 4 21:35:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219410960 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:35:43.776951 n-d-852085-12 devstack@n-api.service[123540]: DEBUG dbcounter [-] [123540] Writing DB stats nova_api:SELECT=4 {{(pid=123540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:44.094454 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-2995a0b9-a5f0-4466-a4b3-0e9ebc196919 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] Action: 'create', calling method: .version_select at 0x7f77eea87940>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-766069720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3qFmWy3tIGzfBXmoQZiyqXeSC7rjtPBRtZHMai+DqXgEk11OuyHH+7n8dOl+gP7BIgyHcGRsqB5b5N36U2IKO6WiZgbnwzvYv1nuFpxN3dEnuYGvkyo9215TK5j9mghw=="}} {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:44.126511 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-2995a0b9-a5f0-4466-a4b3-0e9ebc196919 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] Getting quotas for project ff8c73de4bee4a1a86546a72ba04b0f4. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:35:44.138396 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.quota [None req-2995a0b9-a5f0-4466-a4b3-0e9ebc196919 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] Getting quotas for user 55e9386df0044a1eb9651d4a46570fa8 and project ff8c73de4bee4a1a86546a72ba04b0f4. Resources: {'key_pairs'} {{(pid=123540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:35:44.281637 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-2995a0b9-a5f0-4466-a4b3-0e9ebc196919 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.506313 Oct 04 21:35:44.282736 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1094/2192] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Oct 4 21:35:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:48.340010 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-db5c8e00-8a36-4a71-ae19-db0ab181ea91 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-884672854", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-766069720", "security_groups": [{"name": "tempest-secgroup-smoke-1317794137"}], "networks": [{"uuid": "2f6af9be-1ad7-41f0-b2f3-df1febab73ff"}]}} {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:48.552141 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.network.neutron [None req-db5c8e00-8a36-4a71-ae19-db0ab181ea91 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] validate_networks() for [('2f6af9be-1ad7-41f0-b2f3-df1febab73ff', None, None, None, None, None)] {{(pid=123539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [None req-db5c8e00-8a36-4a71-ae19-db0ab181ea91 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7b1816f0-83e2-4070-8ca2-24dd8c457e17) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:35:48.939789 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7b1816f0-83e2-4070-8ca2-24dd8c457e17) Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.wsgi [None req-db5c8e00-8a36-4a71-ae19-db0ab181ea91 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-db5c8e00-8a36-4a71-ae19-db0ab181ea91 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] Request method failure captured: Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: Accept: application/json Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: Accept-Encoding: identity Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: Connection: close Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: Content-Length: 325 Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: Content-Type: application/json Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: Host: 10.222.0.78 Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: Openstack-System-Scope: None Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: User-Agent: python-urllib3/1.26.12 Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Auth-Token: gAAAAABjPKck_WBx5rnhEIWhLbfupihHm0jda8Bx4K6FQMyNd-OGxxfO2ycxRYntLkbWa5XDuLbDbIua4Y4G8obxzCiP0HqqRBAiFoEUxLibLr_iYkHR1oX-BPAyeWcXbOw7cY-Nfj5TXXun7jHt8hgDz9iitdD5CBYthQKOXBGdgCMfg11OyRg Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Id: None Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Domain-Name: None Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Identity-Status: Confirmed Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Is-Admin-Project: True Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Id: default Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Domain-Name: Default Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Id: ff8c73de4bee4a1a86546a72ba04b0f4 Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Project-Name: tempest-TestSnapshotPattern-2019571311 Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Role: member,reader Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Roles: member,reader Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ff8c73de4bee4a1a86546a72ba04b0f4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff8c73de4bee4a1a86546a72ba04b0f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff8c73de4bee4a1a86546a72ba04b0f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ff8c73de4bee4a1a86546a72ba04b0f4"}]}] Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant: tempest-TestSnapshotPattern-2019571311 Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Id: ff8c73de4bee4a1a86546a72ba04b0f4 Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-Tenant-Name: tempest-TestSnapshotPattern-2019571311 Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-User: tempest-TestSnapshotPattern-2019571311-project Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Id: default Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-User-Domain-Name: Default Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-User-Id: 55e9386df0044a1eb9651d4a46570fa8 Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: X-User-Name: tempest-TestSnapshotPattern-2019571311-project Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: {"server": {"name": "tempest-TestSnapshotPattern-server-884672854", "imageRef": "72e89793-9b3c-463e-96d2-f69d6ab1a9d9", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-766069720", "security_groups": [{"name": "tempest-secgroup-smoke-1317794137"}], "networks": [{"uuid": "2f6af9be-1ad7-41f0-b2f3-df1febab73ff"}]}} Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: method: > Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:35:48.948130 n-d-852085-12 devstack@n-api.service[123539]: Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: action_args: {'body': {'server': {'name': 'tempest-TestSnapshotPattern-server-884672854', 'imageRef': '72e89793-9b3c-463e-96d2-f69d6ab1a9d9', 'flavorRef': '452', 'key_name': 'tempest-TestSnapshotPattern-766069720', 'security_groups': [{'name': 'tempest-secgroup-smoke-1317794137'}], 'networks': [{'uuid': '2f6af9be-1ad7-41f0-b2f3-df1febab73ff'}]}}} Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 04 21:35:48.962428 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7b1816f0-83e2-4070-8ca2-24dd8c457e17) Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: ERROR nova.api.openstack.wsgi Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: DEBUG nova.api.openstack.wsgi [None req-db5c8e00-8a36-4a71-ae19-db0ab181ea91 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: {{(pid=123539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: INFO nova.api.openstack.requestlog [None req-db5c8e00-8a36-4a71-ae19-db0ab181ea91 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.619015 Oct 04 21:35:48.968318 n-d-852085-12 devstack@n-api.service[123539]: [pid: 123539|app: 0|req: 1099/2193] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 21:35:48 2022] POST /compute/v2.1/servers => generated 214 bytes in 622 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 21:35:49.376330 n-d-852085-12 devstack@n-api.service[123540]: DEBUG nova.api.openstack.wsgi [None req-01e5ff76-8228-47a2-b0a1-a7d8cc565281 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] Calling method '.version_select at 0x7f77eea230d0>' {{(pid=123540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:49.578972 n-d-852085-12 devstack@n-api.service[123540]: INFO nova.api.openstack.requestlog [None req-01e5ff76-8228-47a2-b0a1-a7d8cc565281 tempest-TestSnapshotPattern-2019571311 tempest-TestSnapshotPattern-2019571311-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-766069720" status: 202 len: 0 microversion: 2.1 time: 0.209865 Oct 04 21:35:49.579958 n-d-852085-12 devstack@n-api.service[123540]: [pid: 123540|app: 0|req: 1095/2194] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 4 21:35:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-766069720 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)